-- Logs begin at Thu 2022-07-21 20:56:33 UTC, end at Thu 2022-07-21 22:50:11 UTC. -- Jul 21 21:49:54.052769 dv-cinder-820027-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 21:49:54.061552 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 21:49:54.063542 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 21:49:54 2022] *** Jul 21 21:49:54.063542 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 21:49:54.063542 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 21:49:54.063542 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: nodename: dv-cinder-820027-15-iscsi Jul 21 21:49:54.063542 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: machine: x86_64 Jul 21 21:49:54.063542 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: clock source: unix Jul 21 21:49:54.063542 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: pcre jit disabled Jul 21 21:49:54.063542 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: detected number of CPU cores: 4 Jul 21 21:49:54.063542 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: current working directory: / Jul 21 21:49:54.063542 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: detected binary path: /usr/bin/uwsgi-core Jul 21 21:49:54.064217 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: your processes number limit is 47680 Jul 21 21:49:54.064217 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: your memory page size is 4096 bytes Jul 21 21:49:54.064217 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: detected max file descriptor number: 2048 Jul 21 21:49:54.064217 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: lock engine: pthread robust mutexes Jul 21 21:49:54.064217 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: thunder lock: enabled Jul 21 21:49:54.064217 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 21:49:54.064217 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 21:49:54.109387 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: Python main interpreter initialized at 0x557a4186d9c0 Jul 21 21:49:54.109387 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: python threads support enabled Jul 21 21:49:54.109387 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: your server socket listen backlog is limited to 100 connections Jul 21 21:49:54.109387 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: your mercy for graceful operations on workers is 90 seconds Jul 21 21:49:54.109750 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 21:49:54.109834 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: *** Operational MODE: preforking *** Jul 21 21:49:54.110041 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: *** uWSGI is running in multiple interpreter mode *** Jul 21 21:49:54.110041 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: spawned uWSGI master process (pid: 103250) Jul 21 21:49:54.110227 dv-cinder-820027-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 21:49:54.110782 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: spawned uWSGI worker 1 (pid: 103251, cores: 1) Jul 21 21:49:54.111126 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: spawned uWSGI worker 2 (pid: 103252, cores: 1) Jul 21 21:49:54.111299 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 21:49:54.765502 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 21:49:54.768006 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 21:49:55.905398 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 21:49:55.905398 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: from cryptography.utils import int_from_bytes Jul 21 21:49:55.906081 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 21:49:55.906081 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: from cryptography.utils import int_from_bytes Jul 21 21:49:55.906571 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 21:49:55.906571 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: from cryptography.utils import int_from_bytes Jul 21 21:49:55.907629 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 21:49:55.907629 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: from cryptography.utils import int_from_bytes Jul 21 21:49:58.402731 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 21:49:58.403333 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 21:49:58.403519 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 21:49:58.403877 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 21:49:58.404136 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 21:49:58.404521 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.404850 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.405170 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.405487 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.405815 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.406125 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.406445 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.406790 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.406987 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 21:49:58.407418 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.407506 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 21:49:58.407588 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.407691 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.407778 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 21:49:58.408014 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-15-iscsi {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.408110 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 21:49:58.408334 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.408432 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 21:49:58.408642 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.408751 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.408953 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.409061 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.409265 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.409349 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.409568 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.409660 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.409889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.409973 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.410192 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.410316 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.410584 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.410689 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.410907 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.411146 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.411246 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.411453 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.411551 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.411764 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.411851 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.412100 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.412185 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-15-iscsi {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.412416 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.412509 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.412720 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.412804 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.413046 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.413249 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.413440 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.413619 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.413619 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.413949 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.413949 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.414300 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.414300 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.414642 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-15-iscsi {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.414642 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.414952 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.415281 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.415468 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.415678 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.415869 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.415869 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.416191 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.416191 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.416535 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.416682 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.416829 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.416829 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.417094 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.417225 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.417352 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.417506 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.417628 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.417746 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.417887 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.418009 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.418156 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.418156 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.418398 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-15-iscsi {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.418524 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.418644 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.418776 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.418898 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.419057 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.419179 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.419298 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.419416 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.419581 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.419709 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.419829 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.420084 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.420228 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.420356 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.420485 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.420626 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.420766 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.420934 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.421059 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.421261 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.421398 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.421579 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.421705 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.421823 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.421953 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.422118 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.422272 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.422424 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.422558 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.422702 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.422966 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.423132 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.423315 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.423468 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.423604 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.423726 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.423916 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.424070 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.424217 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.424344 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.424513 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.424636 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.424826 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.424971 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.425132 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.425257 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.425450 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.425582 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.425767 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.425939 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.426085 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.426205 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.426325 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.426454 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.426582 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.426712 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.426865 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.427088 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.427214 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.427352 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.427505 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.427636 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.427812 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.427944 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.428121 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.428257 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.428428 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.428563 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.428734 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.428868 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.429039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.429171 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.429343 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.429469 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.429660 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.429783 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.429974 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.430121 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.430307 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.430432 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.430587 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.430720 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.430906 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.431061 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.431260 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.431394 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.431562 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.431687 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.431867 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.431997 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.432182 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.432304 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.432488 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.432621 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.432793 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.432918 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.433098 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.433222 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.433399 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.433531 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.433704 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.433836 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.434008 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.434142 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.434309 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.434440 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.434620 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.434744 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.434924 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.435075 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.435250 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.435383 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.435503 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.435630 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.435809 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.435932 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.436113 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.436247 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.436429 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.436554 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.436736 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.436860 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.437025 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.437146 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.437328 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.437452 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.437625 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.437747 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.438446 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.438589 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.438759 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.438882 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.439092 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.439217 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.439398 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.439522 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.439699 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.439829 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.440003 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.440127 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.440339 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.440525 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.440656 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.440786 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.440908 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.441027 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.441180 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.441309 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.441498 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.441669 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.441792 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.441911 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.442081 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.442206 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.442382 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.442513 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.442686 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.442817 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.442986 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.443129 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.443308 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.443431 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.443609 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.443743 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.443910 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.444035 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.444212 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.444336 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.444511 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.444645 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.444812 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.444936 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.445099 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.445220 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.445410 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.445544 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.445724 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.445850 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.446021 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.446154 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.446323 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.446455 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.446625 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.446754 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.446926 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.447109 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.447257 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.447391 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.447547 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.447669 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.447846 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.447969 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.448147 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.448273 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.448449 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.448572 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.448748 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.448871 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.449051 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.449175 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.449349 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.449465 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.449664 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.449796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.449982 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.450107 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.450288 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.450420 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.450620 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.450764 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.450885 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.451023 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.451230 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:49:58.451354 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.451561 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.451694 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.451887 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.452018 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.452201 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.452323 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.452517 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.452649 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.452834 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.452957 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.453144 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.453267 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.453460 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.454204 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.454397 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.454544 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.454677 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.454798 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.454956 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.455136 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.455297 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.455421 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.455616 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.455743 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.455928 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.456062 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.456246 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.456370 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.456563 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.456734 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.456867 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.456995 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.457169 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.457294 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.457480 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.457598 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.457800 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.457938 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.458110 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.458233 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.458427 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.458549 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.458744 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.458870 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.459087 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.459223 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.459400 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.459524 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.459710 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.459844 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.460021 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.460145 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.460332 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.460464 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.461169 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.461302 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.461302 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.461506 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.461616 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.461727 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.461829 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.461931 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.462033 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.462141 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.462243 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.462418 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.462524 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.462632 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.462787 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.462906 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.463118 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.463289 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.463691 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.463872 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.463992 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.464186 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.464304 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.464497 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.464610 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.464809 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.464920 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.465118 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.465237 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.465464 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.465575 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.465780 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.465889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.466099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.466222 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.466406 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.466537 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.466716 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.466840 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.467041 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.467184 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.467350 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.467475 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.467657 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.467780 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.467964 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.468095 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.468267 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.468399 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.468572 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.468703 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.468879 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.469004 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.469202 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.469328 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.469527 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.469730 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.469868 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.470042 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.470167 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.470348 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.470473 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.470667 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.470799 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.470980 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.471174 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.471363 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.471487 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.471607 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.471736 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.471916 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.472042 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.472244 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.472370 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.472551 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.472675 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.472840 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.472979 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.473162 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.473293 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.473472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.473597 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.473777 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.473900 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.474097 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.474228 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.474403 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.474529 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.474706 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.474829 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.475031 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.475158 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.475353 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.475477 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.475657 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.475780 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.475965 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.476097 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.476271 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.476395 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.476583 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.476707 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.476891 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.477028 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.477202 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.477296 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.477509 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.477617 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.477818 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.477926 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.478132 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.478227 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.478455 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.478555 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.478768 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.478871 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.479098 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.479191 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.479407 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.479509 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.479726 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.479826 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.480062 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.480156 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.480366 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.480458 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.480671 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.480764 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.480985 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.481081 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.481285 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.481377 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.481931 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.482003 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.482068 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.482133 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.482197 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.482277 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.482469 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.482555 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.482777 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.482872 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.483108 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.483219 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.483415 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.483501 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.483719 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.483805 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.484023 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.484119 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.484366 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.484450 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.484669 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.484759 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.485020 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.485119 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.485339 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.485432 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.485659 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.485744 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.485966 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.486059 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.486274 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.486358 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.486589 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.486686 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.486899 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.486993 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.487245 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.487331 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.487556 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.487654 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.487864 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.487948 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.488182 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.488357 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.488556 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.488721 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.488870 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.489006 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.489202 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.489394 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.489558 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.489761 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.489953 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.490095 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.490337 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.490488 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.490718 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.490926 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.491104 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.491244 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.491378 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.491540 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.491828 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.491973 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.492106 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.492239 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.492372 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.492505 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.492645 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.492834 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.492987 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.493129 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.493263 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.493443 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.493593 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.493767 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.493910 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.494080 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.494222 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.494390 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.494540 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.494701 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.494850 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.494995 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.495170 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.495374 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.495526 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.495686 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.495825 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.496000 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.496139 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.496309 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.496457 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.496620 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.496760 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.496923 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.497078 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.497221 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.497354 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.497530 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.497678 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.497821 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.497953 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.498123 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.498272 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.498435 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.498578 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.498756 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.498904 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.499103 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.499260 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.499395 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.499527 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.499700 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.499853 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.499989 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.500120 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.500292 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.500931 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.501127 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.501275 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.501428 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.501562 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.501800 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.501956 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.502098 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.502241 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.502391 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.502526 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.502658 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.502790 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.502923 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.503100 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.503249 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.503394 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.503541 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.503703 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.503848 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.503983 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.504123 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.504266 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.504432 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.504573 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.504743 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.504886 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.505064 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.505205 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.505383 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.505523 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.505687 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.505835 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.505993 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.506133 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.506303 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.506443 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.506614 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.506756 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.506918 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.507094 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.507233 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.507397 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.507533 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.507666 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.507855 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.508002 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.508168 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.508321 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.508457 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.508591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.508766 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.508905 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.509075 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.509243 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.509379 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.509510 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.509681 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.509950 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.510091 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.510283 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.510433 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.510600 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.510752 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.510914 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.511085 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.511251 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.511402 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.511567 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.511707 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.511874 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.512091 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.512233 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.512367 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.512509 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.512649 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.512800 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.512943 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.513086 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.513226 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.513378 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.513514 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.513669 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.513810 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.513956 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.514098 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.514271 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.514421 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.514579 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.514727 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.514875 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.515169 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.515314 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.515498 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.515640 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.515811 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.515961 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.516666 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.516812 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.516968 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.517110 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.517289 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.517431 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.517596 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.517737 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.517909 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.518058 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.518206 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.518348 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.518565 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.518716 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.518857 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.518993 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.519161 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.519307 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.519442 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.519577 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.519761 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.519911 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.520052 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.520256 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.520404 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.520539 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.520673 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.520818 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.520961 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.521104 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.521238 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.521401 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.521549 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.521691 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.521844 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.522002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.522230 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.522372 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.522506 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.522647 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.522792 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.522926 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.523119 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.523257 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.523406 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.523542 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.523697 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.523832 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.523991 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.524132 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.524306 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.524447 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.524605 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.524740 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.524902 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.525042 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.525244 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.525393 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.525551 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.525701 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.525869 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.526009 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.526175 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.526324 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.526491 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.526631 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.526800 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.526942 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.527124 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.527228 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.527420 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.527510 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.527730 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.527820 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.528033 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.528129 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.528334 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.528421 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.528641 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.528729 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.528942 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.529031 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.529243 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.529335 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.529551 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.529643 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.529855 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.529943 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.530158 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.530245 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.530467 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.530613 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.530771 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.530860 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.531099 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.531190 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.531405 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.531545 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.531746 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.531846 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.532050 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.532136 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.532351 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.532448 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.532651 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.532737 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.532953 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.533038 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.533256 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.533351 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.533555 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.533640 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.533862 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.533947 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.534165 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.534263 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.534467 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.534561 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.534771 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.534863 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.535098 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.535205 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.535404 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.535491 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.535732 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.535828 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.536062 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.536151 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.536364 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.536461 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.536665 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.536750 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.536969 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.537057 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.537276 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.537362 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.537574 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.537658 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.537882 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.537968 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.538184 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.538270 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.538486 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.538579 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.538791 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.538883 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.539122 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.539211 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.539442 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.539544 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.539745 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.539839 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.540052 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.540139 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.540354 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.540449 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.540655 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.540743 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.540959 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.541053 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.541264 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.541364 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.541566 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.541699 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.541867 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.541954 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.542168 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.542268 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.542468 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.542563 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.542767 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.542854 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.543115 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.543206 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.543425 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.543519 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.543725 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.543812 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.544028 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.544116 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.544331 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.544431 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.544640 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.544726 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.544962 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.545060 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.545282 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.545369 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.545609 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.545694 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.545914 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.546000 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.546223 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.546309 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.546533 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.546626 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.546840 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.546927 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.547173 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.547278 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.548003 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.548101 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.548314 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.548399 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.548621 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.548706 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.548932 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.549025 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.549232 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.549319 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.549535 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.549620 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.549840 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.549934 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.550149 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.550236 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.550456 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.550541 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.550759 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.550856 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.551108 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.551211 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.551435 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.551522 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.551739 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.551826 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.552050 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.552136 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.552360 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.552446 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.552670 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.552759 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.552973 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.553058 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.553278 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.553404 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.553585 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.553717 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.553894 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.554028 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.554205 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.554336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.554517 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.554612 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.554828 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.554916 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.555163 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.555265 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.555475 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.555562 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.555783 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.555869 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.556088 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.556258 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.556412 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.556570 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.556732 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.556867 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.557035 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.557182 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.557346 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.557489 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.557654 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.557794 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.557965 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.558105 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.558272 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.558433 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.558714 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.558809 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.559051 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.559167 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.559380 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.559537 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.559736 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.559856 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.560003 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.560149 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.560334 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.560444 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.560677 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.560803 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.561004 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.561313 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.561541 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.561747 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.562107 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.562317 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.563233 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.563865 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.564481 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.565670 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.565998 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.566096 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.566330 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.566656 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.566835 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.567023 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.567257 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.567545 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.567726 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.567863 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.567977 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.568098 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.568268 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.568599 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.568738 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.568931 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.569088 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.569259 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.569434 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.569588 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.569761 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.570008 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.570102 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.570340 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.570463 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.570657 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.570754 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.570984 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.571122 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.571339 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.571435 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.571651 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.571784 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.572001 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.572107 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.572275 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.572407 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.572583 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.572833 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.572927 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.573153 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.573246 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.573471 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.573565 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.573802 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.573896 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.574115 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.574207 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.574430 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.574523 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.574738 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.574825 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.575075 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.575166 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.575457 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.575569 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.575713 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.575808 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.576039 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.576133 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.576358 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.576457 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.576680 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.576773 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.576991 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.577084 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.577297 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.577393 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.577627 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.577720 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.577941 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.578028 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.578250 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.578349 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.579083 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.579204 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.579402 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.579531 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.579747 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.579836 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.580055 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.580148 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.580380 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.580474 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.580712 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.580809 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.581043 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.581136 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.581357 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.581451 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.581662 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.581749 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.581971 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.582059 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.582296 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.582392 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.582605 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.582694 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.582919 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.583025 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.583260 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.583364 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.583598 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.583684 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.583908 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.584004 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.584217 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.584316 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.584525 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.584617 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.584834 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.584929 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.585145 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.585244 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.585450 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.585665 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.585762 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.585842 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.586048 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.586151 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.586371 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.586465 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.586679 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.586773 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.586989 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.587106 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.587321 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.587409 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.587624 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.587716 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.587928 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.588015 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.588239 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.588333 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.588841 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.588928 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.589153 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.589246 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.589490 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.589594 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.589809 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.589907 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.590133 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.590230 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.590459 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.590556 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.590770 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.590870 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.591115 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.591207 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.591436 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.591537 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.591752 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.591846 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.592056 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.592142 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.592361 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.592447 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.592672 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.592770 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.592978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.593073 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.593283 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.593377 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.593588 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.593687 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.593897 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.593999 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.594303 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.594894 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.595166 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.595275 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.595487 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.595714 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.595828 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.596048 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.596160 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.596367 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.596468 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.596681 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.596784 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.596996 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.597097 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.597304 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.597407 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.597610 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.597707 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.597955 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.598127 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.598255 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.598335 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.598595 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.598694 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.598908 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.599020 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.599264 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.599368 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.599589 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.599687 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.599899 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.599989 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.600222 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.600321 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.600540 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.600632 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.600855 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.600945 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.601169 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.601269 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.601481 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.601590 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.601794 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.601892 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.602114 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.602213 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.602430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.602532 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.602742 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.602830 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.603080 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.603184 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.603398 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.603498 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.603713 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.603811 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.604023 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.604247 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.604347 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.604578 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.604669 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.604894 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.604985 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.605210 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.605378 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.605529 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.605634 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.605842 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.605934 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.606155 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.606256 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.606468 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.606557 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.606781 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.606877 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.607118 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.607222 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.607434 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.607520 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.607754 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.607848 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.608075 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.608280 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.608401 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.608597 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.608737 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.608931 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.609060 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.609260 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.609375 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.609587 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.609744 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.609932 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.610049 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.610253 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.610410 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.610581 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.610728 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.610891 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.611057 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.611233 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.611376 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.611548 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.611694 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.611860 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.612165 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.612488 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.612607 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.612800 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.612930 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.613106 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.613245 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.613493 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.613586 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.613817 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.613917 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.614168 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.614355 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.614482 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.614707 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.614794 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.615050 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.615146 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.615377 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.615464 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.615708 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.615851 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.616032 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.616130 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.616341 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.616438 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.616667 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.616770 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.616976 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.617070 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.617285 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.617495 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.617588 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.617812 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.617906 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.618145 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.618240 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.618472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.618566 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.618785 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.618872 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.619117 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.619207 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.619426 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.619522 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.619737 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.619879 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.620042 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.620137 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.620372 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.620520 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.620674 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.620761 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.620982 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.621068 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.621291 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.621380 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.621604 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.621703 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.621911 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.622033 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.622218 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.622343 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.622523 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.622665 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.622829 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.622974 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.623162 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.623469 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.623555 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.623777 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.623893 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.624082 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.624213 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.624392 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.624544 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.624696 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.624942 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.625029 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.625271 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.625358 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.625609 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.625702 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.625957 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.626106 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.626248 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.626336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.626557 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.626653 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.626867 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.626960 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.627205 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.627303 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.627515 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.627603 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.627823 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.627916 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.628134 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.628227 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.628444 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.628531 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.628756 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.629016 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.629111 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.629361 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.629456 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.629688 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.629788 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.629995 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.630083 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.630303 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.630390 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.630608 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.630707 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.630918 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.631024 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.631262 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.631358 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.631570 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.631666 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.631885 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.631977 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.632190 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.632275 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.632502 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.632595 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.632804 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.632898 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.633109 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.633202 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.633413 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.633499 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.633721 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.633806 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.634023 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.634108 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.634331 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.634418 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.634642 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.634735 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.634954 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.635058 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.635308 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.635398 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.635611 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.635696 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.635931 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.636074 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.636270 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.636362 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.636566 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.636654 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.636880 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.636977 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.637194 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.637286 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.637506 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.637603 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.637815 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.637923 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.638130 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.638367 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.638462 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.638702 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.638801 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.639056 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.639164 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.639382 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.639481 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.639698 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.639803 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.640068 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.640179 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.640309 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.640422 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.640613 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.640738 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.640937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.641586 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.641787 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.641912 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.642100 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.642223 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.642413 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.642545 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.642725 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.642869 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.643055 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.643215 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.643369 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.643536 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.643679 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.643846 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.643989 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.644175 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.644297 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.644511 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.644604 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.644900 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.644995 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.645210 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.645297 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.645516 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.645610 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.645826 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.645919 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.646134 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.646280 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.646448 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.646535 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.646767 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.646855 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.647101 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.647191 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.647410 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.647497 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.647714 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.647813 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.648022 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.648108 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.648322 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.648407 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.648631 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.648719 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.648936 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.649029 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.649241 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.649336 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.649549 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.649643 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.649851 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.649938 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.650154 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.650270 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.650455 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.650587 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.650757 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.650908 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.651082 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.651258 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.651385 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.651572 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.651691 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.651899 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.651995 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.652223 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.652318 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.652538 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.652625 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.652906 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.653047 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.653161 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.653246 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.653490 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.653636 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.653823 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.653919 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.654136 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.654223 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.654457 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.654550 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.654764 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.654858 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.655116 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.655208 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.655428 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.655526 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.655742 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.655831 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.656060 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.656148 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.656374 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.656473 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.657289 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.657384 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.657596 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.657683 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.657909 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.657996 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.658219 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.658305 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.658522 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.658607 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.658827 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.658913 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.659161 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.659249 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.659476 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.659564 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.659804 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.659899 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.660130 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.660215 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.660435 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.660524 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.660739 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.660834 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.661040 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.661134 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.661342 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.661451 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.661649 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.661771 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.661953 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.662087 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.662257 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.662419 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.662559 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.662732 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.662862 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.663072 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.663192 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.663387 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.663525 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.663700 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.663858 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.664012 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.664172 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.664327 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.664495 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.664639 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.664804 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.664951 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.665125 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.665271 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.665435 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.665588 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.665738 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.665916 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.666059 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.666244 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.666395 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.666556 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.666668 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.666884 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.667173 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.667282 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.667490 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.667585 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.667810 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.667904 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.668121 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.668216 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.668434 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.668521 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.668745 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.668832 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.669058 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.669146 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.669385 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.669471 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.669658 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 21:49:58.669743 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.670007 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.670332 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.670652 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.670971 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.671315 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.671628 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.671990 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.672265 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.672600 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.672910 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.673222 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.673532 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.673848 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.674157 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.674493 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.674833 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.675197 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.675527 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.675854 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.676165 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.676492 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.676819 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.677169 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.677488 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.677833 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.678163 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.678478 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.678789 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.679118 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:49:58.679366 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103251) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 21:49:58.732561 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO dbcounter [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Registered counter for database nova_api Jul 21 21:49:58.742112 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO dbcounter [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] Registered counter for database nova_api Jul 21 21:49:58.847746 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_db.sqlalchemy.engines [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:49:58.854713 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writer thread running {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:49:58.855117 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG oslo_db.sqlalchemy.engines [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103251) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:49:58.861608 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writer thread running {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:49:58.911252 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.context [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0(cell1) {{(pid=103252) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 21:49:58.915305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:49:58.916891 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:49:58.917678 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:49:58.919860 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:49:58.921080 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.context [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0(cell1) {{(pid=103251) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 21:49:58.921884 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO dbcounter [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Registered counter for database nova_cell0 Jul 21 21:49:58.925180 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:49:58.926035 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO dbcounter [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Registered counter for database nova_cell1 Jul 21 21:49:58.926774 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:49:58.927993 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:49:58.930939 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG oslo_concurrency.lockutils [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103251) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:49:58.933072 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO dbcounter [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] Registered counter for database nova_cell0 Jul 21 21:49:58.934905 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_db.sqlalchemy.engines [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:49:58.936720 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_db.sqlalchemy.engines [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:49:58.937331 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO dbcounter [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] Registered counter for database nova_cell1 Jul 21 21:49:58.943918 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writer thread running {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:49:58.945226 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writer thread running {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:49:58.952419 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG oslo_db.sqlalchemy.engines [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103251) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:49:58.954501 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG oslo_db.sqlalchemy.engines [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103251) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:49:58.961959 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writer thread running {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:49:58.962304 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writer thread running {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:49:59.097521 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO dbcounter [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Registered counter for database nova_cell0 Jul 21 21:49:59.109737 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_db.sqlalchemy.engines [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:49:59.113121 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO dbcounter [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] Registered counter for database nova_cell0 Jul 21 21:49:59.114170 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writer thread running {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:49:59.124539 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG oslo_db.sqlalchemy.engines [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103251) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:49:59.130333 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writer thread running {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:49:59.458710 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: WARNING keystonemiddleware.auth_token [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 21:49:59.466269 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: WARNING keystonemiddleware.auth_token [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 21:49:59.501639 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: WARNING keystonemiddleware.auth_token [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 21:49:59.509146 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: WARNING keystonemiddleware.auth_token [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 21:49:59.815885 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: WARNING keystonemiddleware.auth_token [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 21:49:59.821862 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: WARNING keystonemiddleware.auth_token [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 21:49:59.827168 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557a4186d9c0 pid: 103252 (default app) Jul 21 21:49:59.829256 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:49:59.830478 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001760 Jul 21 21:49:59.831226 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Thu Jul 21 21:49:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:49:59.855044 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: WARNING keystonemiddleware.auth_token [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 21:49:59.861112 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: WARNING keystonemiddleware.auth_token [None req-950ba66f-de42-4ba2-babc-b4966bb36a66 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 21:49:59.866921 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557a4186d9c0 pid: 103251 (default app) Jul 21 21:51:16.253348 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:16.254336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jul 21 21:51:16.254900 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:51:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:51:16.266808 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_api:SELECT=3 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:51:16.267715 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_cell0:SELECT=3 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:51:16.268578 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_cell1:SELECT=3 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:51:16.269572 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:51:17.149281 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-11ab68b8-9367-41bb-82ad-f7c30e6e8954 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:17.180203 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-11ab68b8-9367-41bb-82ad-f7c30e6e8954 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.918663 Jul 21 21:51:17.184845 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jul 21 21:51:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:51:19.440622 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:19.441604 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-6642517f-be78-4e27-9641-3fcd9ceb0070 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001387 Jul 21 21:51:19.441985 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:51:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:51:19.948376 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-04a88a79-7ccb-4d90-b576-16ba150093bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256, "disk": 1, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:19.966948 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 21:51:19.966948 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: warnings.warn(msg) Jul 21 21:51:19.995399 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-04a88a79-7ccb-4d90-b576-16ba150093bb admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.547251 Jul 21 21:51:19.996071 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 21:51:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:51:20.010252 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_api:SELECT=3 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:51:20.011574 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_cell1:SELECT=3 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:51:20.012406 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_cell0:SELECT=3 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:51:20.013228 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:51:20.222953 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a12754fc-7ddc-4331-879f-423833972f61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:20.225543 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 21:51:20.225543 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: warnings.warn(msg) Jul 21 21:51:20.292251 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-a12754fc-7ddc-4331-879f-423833972f61 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287446 Jul 21 21:51:20.293134 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jul 21 21:51:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:51:22.555484 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-04a88a79-7ccb-4d90-b576-16ba150093bb admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:22.556695 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-04a88a79-7ccb-4d90-b576-16ba150093bb admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Jul 21 21:51:22.557272 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:51:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:51:23.219697 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-b56bdb25-ca9c-453f-ba7d-b773e54f07d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:23.237952 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 21:51:23.237952 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: warnings.warn(msg) Jul 21 21:51:23.282120 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-b56bdb25-ca9c-453f-ba7d-b773e54f07d0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.718818 Jul 21 21:51:23.283191 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 21:51:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:51:23.298216 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-8a647dc8-7291-467b-af9b-d481e1c1b0fd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:23.301361 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 21:51:23.301361 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: warnings.warn(msg) Jul 21 21:51:23.345586 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-8a647dc8-7291-467b-af9b-d481e1c1b0fd admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051924 Jul 21 21:51:23.347079 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jul 21 21:51:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:51:25.662677 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-b56bdb25-ca9c-453f-ba7d-b773e54f07d0 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:25.664660 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-b56bdb25-ca9c-453f-ba7d-b773e54f07d0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002675 Jul 21 21:51:25.665214 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:51:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:51:26.067791 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-bd124e68-88f7-427a-a19f-094ac0933aa6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:26.086488 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-bd124e68-88f7-427a-a19f-094ac0933aa6 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.415171 Jul 21 21:51:26.086951 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 21:51:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:51:26.099143 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a53065f7-2d86-4a37-a196-a24f3fee6a13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:26.121209 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-a53065f7-2d86-4a37-a196-a24f3fee6a13 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025811 Jul 21 21:51:26.121757 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jul 21 21:51:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:51:28.378300 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-bd124e68-88f7-427a-a19f-094ac0933aa6 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:28.379331 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-bd124e68-88f7-427a-a19f-094ac0933aa6 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 21 21:51:28.379716 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:51:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:51:28.861989 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-55fa2d0e-d83e-4cde-9734-366a0bb69ccf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:28.882655 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-55fa2d0e-d83e-4cde-9734-366a0bb69ccf admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.497258 Jul 21 21:51:28.888861 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 21:51:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:51:28.895127 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-916baa50-392d-4773-a463-9e77028fe62c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:28.922377 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-916baa50-392d-4773-a463-9e77028fe62c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030847 Jul 21 21:51:28.923359 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jul 21 21:51:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:51:31.236997 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-55fa2d0e-d83e-4cde-9734-366a0bb69ccf admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:31.237910 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-55fa2d0e-d83e-4cde-9734-366a0bb69ccf admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Jul 21 21:51:31.238300 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:51:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:51:31.689922 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-b101db8e-18ff-4582-b9ca-894746f21e34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "id": "d4", "vcpus": 4, "name": "ds4G", "swap": 0}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:31.711513 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-b101db8e-18ff-4582-b9ca-894746f21e34 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.467148 Jul 21 21:51:31.712363 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 21:51:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 21:51:31.725700 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-d9637e6f-58c7-47a5-affa-4dd748b6f188 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:31.750407 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-d9637e6f-58c7-47a5-affa-4dd748b6f188 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028726 Jul 21 21:51:31.751235 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Thu Jul 21 21:51:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:51:34.256844 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-b101db8e-18ff-4582-b9ca-894746f21e34 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:34.257949 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-b101db8e-18ff-4582-b9ca-894746f21e34 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Jul 21 21:51:34.258409 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:51:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:51:34.692006 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-85ec3cd4-d177-4be4-aeb4-39c2c80e2ac4 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:34.716469 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-85ec3cd4-d177-4be4-aeb4-39c2c80e2ac4 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.452124 Jul 21 21:51:34.717288 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jul 21 21:51:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:51:37.117318 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-b101db8e-18ff-4582-b9ca-894746f21e34 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:37.118332 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-b101db8e-18ff-4582-b9ca-894746f21e34 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 21 21:51:37.118792 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:51:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:51:37.560178 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-b8d25b46-6a08-4478-a8dd-dba5ca5cc3cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:37.584047 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-b8d25b46-6a08-4478-a8dd-dba5ca5cc3cf admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.459257 Jul 21 21:51:37.584616 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 21:51:37 2022] POST /compute/v2.1/flavors => generated 402 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:51:37.598135 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-81ed5bc1-8fe4-4d18-813d-76852cfc09e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:37.623665 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-81ed5bc1-8fe4-4d18-813d-76852cfc09e3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029969 Jul 21 21:51:37.624442 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jul 21 21:51:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:51:39.900422 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-b8d25b46-6a08-4478-a8dd-dba5ca5cc3cf admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:39.901476 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-b8d25b46-6a08-4478-a8dd-dba5ca5cc3cf admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 21 21:51:39.902174 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:51:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:51:40.306123 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-b5eb95b7-bd43-44c6-b58c-ff117cc45c47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 2048, "disk": 20, "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:40.323193 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-b5eb95b7-bd43-44c6-b58c-ff117cc45c47 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.415095 Jul 21 21:51:40.323675 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 21:51:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:51:40.335430 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-f98f4d50-c445-484c-8177-88beecd7c6f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:40.358285 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-f98f4d50-c445-484c-8177-88beecd7c6f9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026428 Jul 21 21:51:40.358983 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jul 21 21:51:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:51:42.623536 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-b5eb95b7-bd43-44c6-b58c-ff117cc45c47 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:42.624537 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-b5eb95b7-bd43-44c6-b58c-ff117cc45c47 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jul 21 21:51:42.624931 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:51:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:51:43.014001 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-43f90575-f170-4056-b42c-714d1c3ccf05 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "vcpus": 2, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "os-flavor-access:is_public": true}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:43.035353 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-43f90575-f170-4056-b42c-714d1c3ccf05 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.404517 Jul 21 21:51:43.036329 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 21:51:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:51:43.047816 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-52f06803-f7a5-4f66-b845-fc20ba94c98c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:43.073597 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-52f06803-f7a5-4f66-b845-fc20ba94c98c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029398 Jul 21 21:51:43.074115 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jul 21 21:51:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:51:45.379262 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-43f90575-f170-4056-b42c-714d1c3ccf05 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:45.380956 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-43f90575-f170-4056-b42c-714d1c3ccf05 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002110 Jul 21 21:51:45.383323 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:51:45 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:51:45.853775 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-e95b661b-74a8-4e47-9d0a-2eaf89a0a38c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:45.873362 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-e95b661b-74a8-4e47-9d0a-2eaf89a0a38c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.485600 Jul 21 21:51:45.874244 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 21:51:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:51:45.888306 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-67ff0485-cd3d-4e96-9cda-62e0159037a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:45.920441 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-67ff0485-cd3d-4e96-9cda-62e0159037a9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036417 Jul 21 21:51:45.921025 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jul 21 21:51:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:51:48.218654 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-e95b661b-74a8-4e47-9d0a-2eaf89a0a38c admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:51:48.220990 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-e95b661b-74a8-4e47-9d0a-2eaf89a0a38c admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Jul 21 21:51:48.221387 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:51:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:51:48.696956 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a0bc2415-4d07-48a8-97b9-1f00514e3468 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "disk": 160, "rxtx_factor": 1.0}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:48.716988 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-a0bc2415-4d07-48a8-97b9-1f00514e3468 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.489654 Jul 21 21:51:48.717955 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Thu Jul 21 21:51:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 21:51:48.732194 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-4a41f568-8082-45ea-b260-58adbbec9df0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:51:48.737625 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:51:48.763311 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-4a41f568-8082-45ea-b260-58adbbec9df0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036791 Jul 21 21:51:48.764527 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Thu Jul 21 21:51:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:52:08.448044 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a0bc2415-4d07-48a8-97b9-1f00514e3468 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:08.449040 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-a0bc2415-4d07-48a8-97b9-1f00514e3468 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 21 21:52:08.449432 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:52:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:52:08.868858 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-07089feb-da2d-4e08-9124-4f46decded48 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:08.886102 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-07089feb-da2d-4e08-9124-4f46decded48 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.430384 Jul 21 21:52:08.886648 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jul 21 21:52:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:52:09.953651 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a0bc2415-4d07-48a8-97b9-1f00514e3468 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:09.954685 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-a0bc2415-4d07-48a8-97b9-1f00514e3468 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 21 21:52:09.955090 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 21:52:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:52:10.482979 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-3bec2b7e-6d0c-415c-98fe-b1cd21ea72e8 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:10.488165 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.wsgi [None req-3bec2b7e-6d0c-415c-98fe-b1cd21ea72e8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-3bec2b7e-6d0c-415c-98fe-b1cd21ea72e8 admin admin] Request method failure captured: Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Accept: application/json Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Accept-Encoding: gzip, deflate Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Connection: keep-alive Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Content-Length: 0 Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Host: 10.222.0.44 Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Openstack-Api-Version: compute 2.90 Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Openstack-System-Scope: None Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: User-Agent: python-novaclient Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Auth-Token: gAAAAABi2cqJXQljvr4U2L4NtIZGgHyedFW1394DLAjqsRUZiGa5OEdGPRK6M0dTkbIHqEkbwPcy9Mjx9WQPMh_R8jJ98hZvpo7eDi_JQgAPmoRgcmwfNepgOvVkJlnbvo5Ooq2RFURYAPX36-2yRsM9Mj4V8o0121_QjsaYyiANMS4vWIWOm_Q Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Domain-Id: None Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Domain-Name: None Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Identity-Status: Confirmed Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Is-Admin-Project: True Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Project-Domain-Id: default Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Project-Domain-Name: Default Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Project-Id: 693b2c68fbb04241a4427380014d36bf Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Project-Name: admin Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Role: admin,reader,member Jul 21 21:52:10.491430 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Roles: admin,reader,member Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_693b2c68fbb04241a4427380014d36bf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Tenant: admin Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Tenant-Id: 693b2c68fbb04241a4427380014d36bf Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Tenant-Name: admin Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User: admin Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User-Domain-Id: default Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User-Domain-Name: Default Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User-Id: c57e06d14fea43d18b9e9b616a38e6dc Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User-Name: admin Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: method: > Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: exception: Flavor 42 could not be found. Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: action_args: {'id': '42'} Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:52:10.493048 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:52:10.494039 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:10.495472 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-3bec2b7e-6d0c-415c-98fe-b1cd21ea72e8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103251) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:52:10.496780 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-3bec2b7e-6d0c-415c-98fe-b1cd21ea72e8 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.399967 Jul 21 21:52:10.496780 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jul 21 21:52:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 21:52:10.503080 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a55f2039-67ed-4539-b476-729df93ed5d6 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:10.505997 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:52:10.525865 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-a55f2039-67ed-4539-b476-729df93ed5d6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027077 Jul 21 21:52:10.526387 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jul 21 21:52:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:52:10.536092 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-5572065d-3bd3-475d-8996-56f460f89870 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:10.558022 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-5572065d-3bd3-475d-8996-56f460f89870 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025485 Jul 21 21:52:10.558586 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jul 21 21:52:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:52:10.571505 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-6a26ee19-c98a-4025-9627-598aa329ab12 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:10.580049 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.wsgi [None req-6a26ee19-c98a-4025-9627-598aa329ab12 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-6a26ee19-c98a-4025-9627-598aa329ab12 admin admin] Request method failure captured: Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Accept: application/json Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Accept-Encoding: gzip, deflate Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Connection: keep-alive Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Content-Length: 0 Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Host: 10.222.0.44 Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Openstack-Api-Version: compute 2.90 Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Openstack-System-Scope: None Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: User-Agent: python-novaclient Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Auth-Token: gAAAAABi2cqJXQljvr4U2L4NtIZGgHyedFW1394DLAjqsRUZiGa5OEdGPRK6M0dTkbIHqEkbwPcy9Mjx9WQPMh_R8jJ98hZvpo7eDi_JQgAPmoRgcmwfNepgOvVkJlnbvo5Ooq2RFURYAPX36-2yRsM9Mj4V8o0121_QjsaYyiANMS4vWIWOm_Q Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Domain-Id: None Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Domain-Name: None Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Identity-Status: Confirmed Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Is-Admin-Project: True Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Project-Domain-Id: default Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Project-Domain-Name: Default Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Project-Id: 693b2c68fbb04241a4427380014d36bf Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Project-Name: admin Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Role: admin,reader,member Jul 21 21:52:10.583336 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Roles: admin,reader,member Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_693b2c68fbb04241a4427380014d36bf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Tenant: admin Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Tenant-Id: 693b2c68fbb04241a4427380014d36bf Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Tenant-Name: admin Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User: admin Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User-Domain-Id: default Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User-Domain-Name: Default Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User-Id: c57e06d14fea43d18b9e9b616a38e6dc Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User-Name: admin Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: method: > Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: exception: Flavor 42 could not be found. Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: action_args: {'id': '42'} Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:52:10.584889 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:52:10.585796 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:10.586878 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-6a26ee19-c98a-4025-9627-598aa329ab12 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:52:10.588146 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-6a26ee19-c98a-4025-9627-598aa329ab12 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017396 Jul 21 21:52:10.588146 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jul 21 21:52:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 21:52:11.549274 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-5572065d-3bd3-475d-8996-56f460f89870 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:11.550211 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-5572065d-3bd3-475d-8996-56f460f89870 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 21 21:52:11.550606 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 21:52:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:52:12.076535 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-bd56d256-c32a-4f3e-8d85-b908b3c64bbc admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:12.082516 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.wsgi [None req-bd56d256-c32a-4f3e-8d85-b908b3c64bbc admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-bd56d256-c32a-4f3e-8d85-b908b3c64bbc admin admin] Request method failure captured: Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Accept: application/json Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Accept-Encoding: gzip, deflate Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Connection: keep-alive Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Content-Length: 0 Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Host: 10.222.0.44 Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Openstack-Api-Version: compute 2.90 Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Openstack-System-Scope: None Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: User-Agent: python-novaclient Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Auth-Token: gAAAAABi2cqLeJZjWuzv0vDe2XeXTEQVEcTzQQMD_3qu6I4yUkv9OM7EeA6I1oLUP7QAZicuTQQI2GnsI5mQkSwLDjI986LW9oLb_2IS91tx8yTCG5MDeIX9ACoyOzWUvMNc684Z44evuaxBh7CwunNfuiAx04_uYJHi4R6mg0m-9m4ssEcgTjY Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Domain-Id: None Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Domain-Name: None Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Identity-Status: Confirmed Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Is-Admin-Project: True Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Project-Domain-Id: default Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Project-Domain-Name: Default Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Project-Id: 693b2c68fbb04241a4427380014d36bf Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Project-Name: admin Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Role: admin,reader,member Jul 21 21:52:12.084067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Roles: admin,reader,member Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_693b2c68fbb04241a4427380014d36bf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Tenant: admin Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Tenant-Id: 693b2c68fbb04241a4427380014d36bf Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Tenant-Name: admin Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User: admin Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User-Domain-Id: default Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User-Domain-Name: Default Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User-Id: c57e06d14fea43d18b9e9b616a38e6dc Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User-Name: admin Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: method: > Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: exception: Flavor 84 could not be found. Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: action_args: {'id': '84'} Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:52:12.085307 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:52:12.086063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:12.087305 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-bd56d256-c32a-4f3e-8d85-b908b3c64bbc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:52:12.088485 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-bd56d256-c32a-4f3e-8d85-b908b3c64bbc admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398560 Jul 21 21:52:12.088485 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jul 21 21:52:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 21 21:52:12.097127 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-30a2b5b7-3290-4073-b508-369300907fa0 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:12.111064 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-30a2b5b7-3290-4073-b508-369300907fa0 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018336 Jul 21 21:52:12.111622 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jul 21 21:52:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:52:12.121173 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-cc1bcba8-6a4e-4ac2-8a92-c270c5fb9739 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:12.135965 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-cc1bcba8-6a4e-4ac2-8a92-c270c5fb9739 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018306 Jul 21 21:52:12.136496 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jul 21 21:52:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:52:12.146543 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-75414e5a-2727-42db-ba5c-1ab83416e4e4 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:12.152011 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.wsgi [None req-75414e5a-2727-42db-ba5c-1ab83416e4e4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-75414e5a-2727-42db-ba5c-1ab83416e4e4 admin admin] Request method failure captured: Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Accept: application/json Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Accept-Encoding: gzip, deflate Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Connection: keep-alive Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Content-Length: 0 Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Host: 10.222.0.44 Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Openstack-Api-Version: compute 2.90 Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Openstack-System-Scope: None Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: User-Agent: python-novaclient Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Auth-Token: gAAAAABi2cqLeJZjWuzv0vDe2XeXTEQVEcTzQQMD_3qu6I4yUkv9OM7EeA6I1oLUP7QAZicuTQQI2GnsI5mQkSwLDjI986LW9oLb_2IS91tx8yTCG5MDeIX9ACoyOzWUvMNc684Z44evuaxBh7CwunNfuiAx04_uYJHi4R6mg0m-9m4ssEcgTjY Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Domain-Id: None Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Domain-Name: None Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Identity-Status: Confirmed Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Is-Admin-Project: True Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Project-Domain-Id: default Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Project-Domain-Name: Default Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Project-Id: 693b2c68fbb04241a4427380014d36bf Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Project-Name: admin Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Role: admin,reader,member Jul 21 21:52:12.153494 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Roles: admin,reader,member Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_693b2c68fbb04241a4427380014d36bf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Tenant: admin Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Tenant-Id: 693b2c68fbb04241a4427380014d36bf Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Tenant-Name: admin Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User: admin Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User-Domain-Id: default Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User-Domain-Name: Default Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User-Id: c57e06d14fea43d18b9e9b616a38e6dc Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User-Name: admin Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: method: > Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: exception: Flavor 84 could not be found. Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: action_args: {'id': '84'} Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:52:12.155099 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:52:12.156045 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:12.157937 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-75414e5a-2727-42db-ba5c-1ab83416e4e4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103251) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:52:12.159135 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-75414e5a-2727-42db-ba5c-1ab83416e4e4 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011914 Jul 21 21:52:12.159135 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Thu Jul 21 21:52:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 21 21:52:13.140663 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-cc1bcba8-6a4e-4ac2-8a92-c270c5fb9739 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:13.142266 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-cc1bcba8-6a4e-4ac2-8a92-c270c5fb9739 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jul 21 21:52:13.142657 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 21:52:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:52:13.674095 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-b81af244-8313-4afe-a5d2-6e6d40cc3ebc admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:13.679943 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.wsgi [None req-b81af244-8313-4afe-a5d2-6e6d40cc3ebc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-b81af244-8313-4afe-a5d2-6e6d40cc3ebc admin admin] Request method failure captured: Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Accept: application/json Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Accept-Encoding: gzip, deflate Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Connection: keep-alive Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Content-Length: 0 Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Host: 10.222.0.44 Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Openstack-Api-Version: compute 2.90 Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Openstack-System-Scope: None Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: User-Agent: python-novaclient Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Auth-Token: gAAAAABi2cqNyKfKJ7t5sOJK7ATQV67-DD7fk1-QyIPts0YmIBAJ0ZhaRojMCYAQc5LjTBV9KuKEezRDHxSQUXUlFa8UxL_eZxEgpsR8Q-k1J2hU8saT6NTvt-3z8mNAdzKidxekFkjOL9PSPTjQrBKMvhSs5U48btrnsGntRWSJK98SIl9NYG0 Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Domain-Id: None Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Domain-Name: None Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Identity-Status: Confirmed Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Is-Admin-Project: True Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Project-Domain-Id: default Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Project-Domain-Name: Default Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Project-Id: 693b2c68fbb04241a4427380014d36bf Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Project-Name: admin Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Role: admin,reader,member Jul 21 21:52:13.681458 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Roles: admin,reader,member Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_693b2c68fbb04241a4427380014d36bf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Tenant: admin Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Tenant-Id: 693b2c68fbb04241a4427380014d36bf Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-Tenant-Name: admin Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User: admin Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User-Domain-Id: default Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User-Domain-Name: Default Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User-Id: c57e06d14fea43d18b9e9b616a38e6dc Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: X-User-Name: admin Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: method: > Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: exception: Flavor 451 could not be found. Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: action_args: {'id': '451'} Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:52:13.682978 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:52:13.684016 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: ERROR nova.api.openstack.wsgi Jul 21 21:52:13.685400 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-b81af244-8313-4afe-a5d2-6e6d40cc3ebc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103251) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:52:13.686756 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-b81af244-8313-4afe-a5d2-6e6d40cc3ebc admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.404671 Jul 21 21:52:13.686756 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jul 21 21:52:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 21 21:52:13.694042 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-2ea7d7f7-aae5-401f-8655-45b55d76a051 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:13.708067 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-2ea7d7f7-aae5-401f-8655-45b55d76a051 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017859 Jul 21 21:52:13.708596 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jul 21 21:52:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:52:13.718522 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:13.733972 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019389 Jul 21 21:52:13.734511 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Thu Jul 21 21:52:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:52:13.744588 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-9f7fed5a-a852-4be9-b36d-6e16a6c05dcf admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:13.749984 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.wsgi [None req-9f7fed5a-a852-4be9-b36d-6e16a6c05dcf admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-9f7fed5a-a852-4be9-b36d-6e16a6c05dcf admin admin] Request method failure captured: Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Accept: application/json Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Accept-Encoding: gzip, deflate Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Connection: keep-alive Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Content-Length: 0 Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Host: 10.222.0.44 Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Openstack-Api-Version: compute 2.90 Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Openstack-System-Scope: None Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: User-Agent: python-novaclient Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Auth-Token: gAAAAABi2cqNyKfKJ7t5sOJK7ATQV67-DD7fk1-QyIPts0YmIBAJ0ZhaRojMCYAQc5LjTBV9KuKEezRDHxSQUXUlFa8UxL_eZxEgpsR8Q-k1J2hU8saT6NTvt-3z8mNAdzKidxekFkjOL9PSPTjQrBKMvhSs5U48btrnsGntRWSJK98SIl9NYG0 Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Domain-Id: None Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Domain-Name: None Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Identity-Status: Confirmed Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Is-Admin-Project: True Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Openstack-Nova-Api-Version: 2.90 Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Project-Domain-Id: default Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Project-Domain-Name: Default Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Project-Id: 693b2c68fbb04241a4427380014d36bf Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Project-Name: admin Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Role: admin,reader,member Jul 21 21:52:13.751492 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Roles: admin,reader,member Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/693b2c68fbb04241a4427380014d36bf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_693b2c68fbb04241a4427380014d36bf", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Tenant: admin Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Tenant-Id: 693b2c68fbb04241a4427380014d36bf Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-Tenant-Name: admin Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User: admin Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User-Domain-Id: default Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User-Domain-Name: Default Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User-Id: c57e06d14fea43d18b9e9b616a38e6dc Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: X-User-Name: admin Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: method: > Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: exception: Flavor 451 could not be found. Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: action_args: {'id': '451'} Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:52:13.753002 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:52:13.753939 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: ERROR nova.api.openstack.wsgi Jul 21 21:52:13.755591 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-9f7fed5a-a852-4be9-b36d-6e16a6c05dcf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103252) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:52:13.756839 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-9f7fed5a-a852-4be9-b36d-6e16a6c05dcf admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011848 Jul 21 21:52:13.756839 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jul 21 21:52:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 21 21:52:14.740133 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:14.741466 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002292 Jul 21 21:52:14.741999 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 21:52:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:52:15.262950 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-803e76b9-2bf7-4b0b-b86b-23b7e46c1391 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:52:15.281208 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-803e76b9-2bf7-4b0b-b86b-23b7e46c1391 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.403691 Jul 21 21:52:15.281748 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jul 21 21:52:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:52:16.258205 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:16.259239 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jul 21 21:52:16.259629 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 21:52:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:52:16.787226 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-8d19d23a-f362-4853-a76c-527849cfe26c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:52:16.804856 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-8d19d23a-f362-4853-a76c-527849cfe26c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408169 Jul 21 21:52:16.805397 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jul 21 21:52:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:52:17.786746 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:17.787780 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 21 21:52:17.788180 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 21:52:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:52:18.322296 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-4f0848e6-80ea-427b-9e47-5cb05de17d2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:52:18.342040 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-4f0848e6-80ea-427b-9e47-5cb05de17d2c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.412544 Jul 21 21:52:18.342528 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jul 21 21:52:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:52:19.339325 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:19.340881 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002219 Jul 21 21:52:19.341468 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 21:52:19 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:52:19.888228 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-4a8ed727-98a7-4cbe-9112-b9e1b9f80bbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:52:19.908403 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-4a8ed727-98a7-4cbe-9112-b9e1b9f80bbe admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.426173 Jul 21 21:52:19.908964 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Thu Jul 21 21:52:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:52:20.900244 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:20.901242 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 21 21:52:20.901639 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 21:52:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:52:21.435295 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-feae9bb0-26b7-47d4-8332-453eb45dfa8b admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:52:21.455789 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-feae9bb0-26b7-47d4-8332-453eb45dfa8b admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.416031 Jul 21 21:52:21.456328 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Thu Jul 21 21:52:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:53:14.021323 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:53:14.022326 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-4234858b-6e66-4f6e-a3e6-f794e1669b94 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 21 21:53:14.022720 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Thu Jul 21 21:53:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:53:14.033732 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:53:14.436602 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-98589726-f334-46b6-86e7-8846b3e02899 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:53:14.456130 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-98589726-f334-46b6-86e7-8846b3e02899 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.427261 Jul 21 21:53:14.456597 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Thu Jul 21 21:53:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:53:14.478295 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG dbcounter [-] [103251] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103251) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:53:14.482038 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-8af3865e-7b55-46a3-bec6-91f72c64c0a2 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:53:14.490227 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-8af3865e-7b55-46a3-bec6-91f72c64c0a2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013449 Jul 21 21:53:14.490763 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Thu Jul 21 21:53:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:53:14.502584 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-8224b0ff-532a-48f5-9949-c49eae67ffa5 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:53:14.510285 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-8224b0ff-532a-48f5-9949-c49eae67ffa5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011399 Jul 21 21:53:14.510813 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Thu Jul 21 21:53:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:53:14.522572 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-5c35aa30-5c9c-49a4-81b3-0a2a76306e33 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:53:14.530344 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-5c35aa30-5c9c-49a4-81b3-0a2a76306e33 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011315 Jul 21 21:53:14.530893 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Thu Jul 21 21:53:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:53:14.542772 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-4d7a977b-1a7c-44f8-b293-a604a828f8cc admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:53:14.550490 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-4d7a977b-1a7c-44f8-b293-a604a828f8cc admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011268 Jul 21 21:53:14.551028 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Thu Jul 21 21:53:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:56:37.320222 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-5c35aa30-5c9c-49a4-81b3-0a2a76306e33 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:56:37.321235 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-5c35aa30-5c9c-49a4-81b3-0a2a76306e33 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 21 21:56:37.321635 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 21:56:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:56:37.461419 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_api:SELECT=6 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:56:37.635528 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-9ec8f8eb-4f20-4cde-8ee1-23df38eb3493 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:56:37.636715 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 21:56:37.636715 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: warnings.warn(msg) Jul 21 21:56:37.637930 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-9ec8f8eb-4f20-4cde-8ee1-23df38eb3493 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:56:37.638366 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-9ec8f8eb-4f20-4cde-8ee1-23df38eb3493 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:56:37.639185 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-9ec8f8eb-4f20-4cde-8ee1-23df38eb3493 admin admin] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:56:37.639641 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-9ec8f8eb-4f20-4cde-8ee1-23df38eb3493 admin admin] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:56:37.674412 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-9ec8f8eb-4f20-4cde-8ee1-23df38eb3493 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.214375 Jul 21 21:56:37.674991 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jul 21 21:56:37 2022] GET /compute/v2.1/os-services => generated 794 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:56:38.527699 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-5c35aa30-5c9c-49a4-81b3-0a2a76306e33 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:56:38.528695 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-5c35aa30-5c9c-49a4-81b3-0a2a76306e33 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001620 Jul 21 21:56:38.529089 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 21:56:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:56:38.722993 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-a738a6cf-01c1-4ab4-81eb-2ea7d893cc96 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:56:38.724197 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 21:56:38.724197 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: warnings.warn(msg) Jul 21 21:56:38.725388 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-a738a6cf-01c1-4ab4-81eb-2ea7d893cc96 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:56:38.725827 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-a738a6cf-01c1-4ab4-81eb-2ea7d893cc96 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:56:38.726612 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-a738a6cf-01c1-4ab4-81eb-2ea7d893cc96 admin admin] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:56:38.727066 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-a738a6cf-01c1-4ab4-81eb-2ea7d893cc96 admin admin] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:56:38.753285 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-a738a6cf-01c1-4ab4-81eb-2ea7d893cc96 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.084867 Jul 21 21:56:38.753810 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jul 21 21:56:38 2022] GET /compute/v2.1/os-services => generated 794 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:56:50.035995 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-5c35aa30-5c9c-49a4-81b3-0a2a76306e33 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:56:50.036996 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-5c35aa30-5c9c-49a4-81b3-0a2a76306e33 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001650 Jul 21 21:56:50.037390 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 21:56:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:56:50.195521 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_cell0:SELECT=4 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:56:50.196246 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_cell1:SELECT=4 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:56:50.196957 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG dbcounter [-] [103252] Writing DB stats nova_api:SELECT=8 {{(pid=103252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:56:50.248242 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-c340925b-a099-4ff4-81a1-61b080bfdf23 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:56:50.249440 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 21:56:50.249440 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: warnings.warn(msg) Jul 21 21:56:50.250613 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-c340925b-a099-4ff4-81a1-61b080bfdf23 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:56:50.251063 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-c340925b-a099-4ff4-81a1-61b080bfdf23 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:56:50.251841 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-c340925b-a099-4ff4-81a1-61b080bfdf23 admin admin] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:56:50.252271 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-c340925b-a099-4ff4-81a1-61b080bfdf23 admin admin] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:56:50.277136 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-c340925b-a099-4ff4-81a1-61b080bfdf23 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.086468 Jul 21 21:56:50.277695 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jul 21 21:56:50 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:56:51.122293 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: DEBUG nova.api.openstack.wsgi [None req-5c35aa30-5c9c-49a4-81b3-0a2a76306e33 admin admin] Calling method '>' {{(pid=103251) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:56:51.130855 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: INFO nova.api.openstack.requestlog [None req-5c35aa30-5c9c-49a4-81b3-0a2a76306e33 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001947 Jul 21 21:56:51.131426 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: [pid: 103251|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Thu Jul 21 21:56:51 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:56:51.325261 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG nova.api.openstack.wsgi [None req-50f378e9-98ce-4b36-b8ab-352fd29c6011 admin admin] Calling method '>' {{(pid=103252) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:56:51.326426 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 21:56:51.326426 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: warnings.warn(msg) Jul 21 21:56:51.327678 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-50f378e9-98ce-4b36-b8ab-352fd29c6011 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:56:51.328114 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-50f378e9-98ce-4b36-b8ab-352fd29c6011 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:56:51.328886 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-50f378e9-98ce-4b36-b8ab-352fd29c6011 admin admin] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:56:51.329297 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: DEBUG oslo_concurrency.lockutils [None req-50f378e9-98ce-4b36-b8ab-352fd29c6011 admin admin] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103252) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:56:51.352098 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: INFO nova.api.openstack.requestlog [None req-50f378e9-98ce-4b36-b8ab-352fd29c6011 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.081663 Jul 21 21:56:51.352579 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: [pid: 103252|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Thu Jul 21 21:56:51 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:57:48.836729 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: Thu Jul 21 21:57:48 2022 - graceful shutdown triggered... Jul 21 21:57:48.837284 dv-cinder-820027-15-iscsi devstack@n-api.service[103252]: Gracefully killing worker 2 (pid: 103252)... Jul 21 21:57:48.837676 dv-cinder-820027-15-iscsi devstack@n-api.service[103251]: Gracefully killing worker 1 (pid: 103251)... Jul 21 21:57:48.839019 dv-cinder-820027-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 21 21:57:49.837950 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: worker 1 buried after 1 seconds Jul 21 21:57:49.837950 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: worker 2 buried after 1 seconds Jul 21 21:57:49.837950 dv-cinder-820027-15-iscsi devstack@n-api.service[103250]: goodbye to uWSGI. Jul 21 21:57:49.839463 dv-cinder-820027-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 21 21:57:49.839999 dv-cinder-820027-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 21 21:57:49.842841 dv-cinder-820027-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 21 21:57:49.853536 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 21 21:57:49.856237 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 21:57:49 2022] *** Jul 21 21:57:49.856400 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 21:57:49.856531 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 21:57:49.856658 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: nodename: dv-cinder-820027-15-iscsi Jul 21 21:57:49.856765 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: machine: x86_64 Jul 21 21:57:49.856880 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: clock source: unix Jul 21 21:57:49.856988 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: pcre jit disabled Jul 21 21:57:49.857095 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: detected number of CPU cores: 4 Jul 21 21:57:49.857202 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: current working directory: / Jul 21 21:57:49.857956 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: detected binary path: /usr/bin/uwsgi-core Jul 21 21:57:49.858093 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: your processes number limit is 47680 Jul 21 21:57:49.858222 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: your memory page size is 4096 bytes Jul 21 21:57:49.858341 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: detected max file descriptor number: 2048 Jul 21 21:57:49.858452 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: lock engine: pthread robust mutexes Jul 21 21:57:49.858738 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: thunder lock: enabled Jul 21 21:57:49.859070 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 21 21:57:49.859273 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 21:57:49.903936 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: Python main interpreter initialized at 0x55d1424539c0 Jul 21 21:57:49.903936 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: python threads support enabled Jul 21 21:57:49.903936 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: your server socket listen backlog is limited to 100 connections Jul 21 21:57:49.903936 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: your mercy for graceful operations on workers is 90 seconds Jul 21 21:57:49.904396 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 21:57:49.904396 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: *** Operational MODE: preforking *** Jul 21 21:57:49.904672 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: *** uWSGI is running in multiple interpreter mode *** Jul 21 21:57:49.904672 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: spawned uWSGI master process (pid: 117963) Jul 21 21:57:49.904896 dv-cinder-820027-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 21 21:57:49.906016 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: spawned uWSGI worker 1 (pid: 117978, cores: 1) Jul 21 21:57:49.906016 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: spawned uWSGI worker 2 (pid: 117979, cores: 1) Jul 21 21:57:49.906016 dv-cinder-820027-15-iscsi devstack@n-api.service[117963]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 21:57:50.569665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 21:57:50.594656 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 21 21:57:51.773489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 21:57:51.773489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: from cryptography.utils import int_from_bytes Jul 21 21:57:51.774027 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 21:57:51.774027 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: from cryptography.utils import int_from_bytes Jul 21 21:57:51.844019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 21:57:51.844019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: from cryptography.utils import int_from_bytes Jul 21 21:57:51.844636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 21:57:51.844636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: from cryptography.utils import int_from_bytes Jul 21 21:57:54.098870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 21:57:54.099457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 21:57:54.099764 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 21:57:54.100010 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 21:57:54.100265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 21:57:54.100654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.100984 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.101302 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.101617 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.101946 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.102260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.102581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.102910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.103260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.103521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.103837 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.104159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-15-iscsi {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.104486 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.104797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.105110 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.105431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.105736 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.106057 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.106362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.106866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-15-iscsi {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.111836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.112278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.113348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.113348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.113348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.113348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.113730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.114954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.114954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.114954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.114954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.115645 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.115645 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.115954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.116102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.116778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.116778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.117095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.117234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.117517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.117839 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.118093 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.118344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.118665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.118986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.119324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.119632 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.119939 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.120247 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.120553 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.120859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.121164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.121475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.121787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.122099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.122421 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.122726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.123069 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.123479 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.123730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.124040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.124384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.125605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.125605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.125605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.125605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.126178 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.126346 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.127079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.127079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.127410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.127558 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.127761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.128079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.128384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.128707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.129014 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.129324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.129646 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.129937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.130239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.131076 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.131400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.131703 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.132010 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.132492 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.132721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.132912 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.133215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.133536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.133853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.134158 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.134463 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.134766 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.135099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.135422 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.135728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.136033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.136356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.136666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.136969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.137285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.137670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.137883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.138207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.138509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.138820 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.139180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.139534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.139813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.140117 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.140419 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.140727 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.141033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.141512 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.141619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.141923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.142245 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.142566 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.142875 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.143209 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.143516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.143836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.144224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.144508 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.144850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.145172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.145501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.145832 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.146179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.147057 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.147377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.147705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.148018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.148330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.148641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.148961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.149278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.149604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.149922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.150237 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.150555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.150866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.151209 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.151538 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.151860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.152171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.152516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.152861 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.153173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.153495 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.153817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.154128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.154438 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.154747 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.155092 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.155425 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.155737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.156054 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.156367 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.156679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.156989 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.157304 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.157820 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.157965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.158247 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.158564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.158879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.159236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.159568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.159880 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.160209 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.160514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.160814 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.161217 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.161435 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.161738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.162114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.162446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.162769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.163138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.163448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.163755 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.164066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.164377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.164682 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.164992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.165308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.165614 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.165937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.166247 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.166552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.166873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.167222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.167531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.167847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.168157 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.168465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.168783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.169098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.169415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.169740 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.170052 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.170388 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.170723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.171056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.171378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.171706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.172022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.172401 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.172638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.172948 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.173251 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.173742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.174223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.174691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.175182 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.175655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.176120 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.176728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.177216 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.177722 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.178034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.178341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.178648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.178994 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.179460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.179810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.180150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.180533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.180791 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.181281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.181765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.182302 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.182732 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.182994 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.183348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.183793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.184129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.184442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.184756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.185087 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.185406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.185730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.186030 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.186348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.186787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.188008 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.188008 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.188008 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.188273 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.188493 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.188797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.189100 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.189410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.189775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.190080 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.190830 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.190830 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.191234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.191324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.191638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.191954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.192258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.192574 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.192908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.193769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.194082 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.194395 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.194717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.195047 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.195361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.195670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.195979 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.196282 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.196597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.196913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.197238 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.197548 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.197849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.198200 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.198481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.198784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.199108 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.199423 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.199741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.200050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.200367 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.200690 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.200991 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.201294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.201638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.201925 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.202232 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.202653 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.202965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.203363 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.203652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.203819 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 21:57:54.205747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 21:57:54.205747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 21:57:54.205747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 21:57:54.206454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.206690 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 21:57:54.206911 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.207230 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.207453 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.207687 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.207839 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.207977 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.208104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.208267 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.208387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.208563 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.209377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.209547 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.209671 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.209790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.209933 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.210070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.210204 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.210333 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.210502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.210502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.210823 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.211018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.211153 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.211283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.211426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-15-iscsi {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.211564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.211703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.211831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.211831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.212079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.212248 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.212530 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.212663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.212790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.212923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.212923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.213171 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.213171 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.213439 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.214223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.214359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.214520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.214679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.214815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.214949 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.215102 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.215230 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.215369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.215508 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.215636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.215762 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.215895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.216028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.216155 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.216324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.216455 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.216692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.216832 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.216960 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.217093 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.217226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.217226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.217476 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.217618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.217753 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-15-iscsi {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.217887 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.218013 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.218153 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.218298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.218435 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.218829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.218964 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.219139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.219278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.219278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.219527 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.219664 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.219808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.219954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.220082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.220222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.220356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.220483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.220615 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.220743 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.220883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.221010 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.221143 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.221277 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.221411 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.221545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.221685 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.221814 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.221940 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.222066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.222200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.222326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.222480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.222707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.222848 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.222983 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.223149 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.223292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.223421 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.223555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.223689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.223824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.223960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.224095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.224234 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.224425 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.224567 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.224729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.224864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.225012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.225148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.225284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.225409 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.225536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.225670 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.225826 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.226017 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.226151 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.226277 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.226410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.226546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.226681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.226808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.226942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.227092 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.227220 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.227363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.227499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.227632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.227765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.227900 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.228040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.228175 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.228302 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.228434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.228560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.228685 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.228822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.228957 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.229094 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.229254 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.229385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.229579 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.229719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.229944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.230079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.230214 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.230347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.230529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.230668 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.230830 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.230962 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.231151 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.231281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.231455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.231586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.231757 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.231879 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.232070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.232207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.232377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.232530 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.232744 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.232880 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.232992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.233304 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.233616 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.233838 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.233990 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.234176 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.234326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.234475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.234634 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.234777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.234928 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.235120 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.235264 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.235413 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.235563 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.235711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.235851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.235992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.236129 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.236278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.236420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.236585 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.236741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.236882 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.237033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.237181 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.237323 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.237462 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.237609 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.237755 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.237896 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.238048 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.238196 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.238343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.238492 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.238633 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.238830 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.239015 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.239167 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.239318 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.239460 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.239599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.239739 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.239866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.240088 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.240222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.240348 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.240459 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.240629 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.240848 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.240979 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.241105 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.241221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.241345 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.241536 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.241689 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.241826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.241982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.242132 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.242267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.242450 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.242592 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.242849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.243115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.243257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.243385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.243511 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.243644 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.243780 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.243917 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.244044 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.244171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.244348 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.244479 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.244656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.244786 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.244957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.245092 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.245271 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.245403 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.245625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.245764 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.245891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.246026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.246696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.246881 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.247217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.247353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.247480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.247607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.247741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.247868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.248009 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.248144 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.248272 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.248412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.248540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.248712 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.248848 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.249007 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.249134 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.249260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.249386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.249532 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.249660 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.249794 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.249921 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.250050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.250168 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.250321 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.250452 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.250578 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.250578 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.250833 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 21:57:54.250950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.251096 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.251250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.251380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.251630 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.251771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.251913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.252048 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.252185 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.252352 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.252483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.252610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.252745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.253207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.253353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.253483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.253599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.253724 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.253860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.253987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.254114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.254240 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.254367 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.254502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.254629 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.254761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.254888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.255087 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.255220 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.255366 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.255494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.256136 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.256397 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.256753 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.257086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.257409 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.257737 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.258042 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.258174 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.258381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.258520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.258698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.258835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.259025 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.259158 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.259409 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.259553 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.259798 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.259947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.260074 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.260199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.260363 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.260503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.260670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.260809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.260974 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.261097 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.261286 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.261436 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.261607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.261738 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.261911 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.262051 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.262214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.262354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.262518 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.262648 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.262838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.263024 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.263186 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.263384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.263522 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.263650 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.263804 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.263933 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.264133 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.264265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.264475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.264604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.264794 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.264963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.265104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.265242 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.265423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.265554 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.265746 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.265893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.266065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.266205 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.266381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.266511 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.266687 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.266835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.266994 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.267190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.267329 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.267463 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.267623 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.267762 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.267939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.268072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.268249 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.268389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.268558 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.268730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.268860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.268988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.269168 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.269299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.269488 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.269628 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.269801 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.270005 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.270143 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.270278 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.270420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.270547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.270726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.270857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.271057 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.271233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.272027 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.272168 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.272349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.272508 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.272647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.272816 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.273026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.273230 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.273446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.273730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.273914 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.274099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.274284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.274469 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.274667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.274847 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.275099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.275280 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.275452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.275638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.275831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.276008 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.276008 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.276008 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.276610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.276837 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.277006 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.277151 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.277300 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.277519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.277671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.277840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.277991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.278139 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.278290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.278434 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.278574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.278721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.278852 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.278976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.279162 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.279274 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.279389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.279501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.279609 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.279717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.279834 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.279945 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.280159 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.280300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.280430 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.280558 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.280694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.280859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.280994 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.281155 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.281282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.281418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.281554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.281690 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.281825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.281960 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.282095 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.282231 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.282367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.282494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.282621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.282747 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.282875 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.283069 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.283211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.283456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.283778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.284100 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.284490 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.284717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.284852 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.284980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.284980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.285238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.285448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.285580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.285715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.285853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.285981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.286114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.286256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.286390 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.286517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.286692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.286934 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.287124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.287270 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.287400 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.287527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.287692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.287829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.288012 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.288151 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.288308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.288488 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.288626 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.288754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.288880 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.289017 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.289179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.289312 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.289519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.289657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.289822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.289956 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.290199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.290347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.290483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.290611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.290769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.290901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.291122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.291256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.291434 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.291565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.291756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.291888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.292072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.292203 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.292384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.292516 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.292698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.292830 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.293012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.293165 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.293326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.293470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.293638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.293789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.293982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.294110 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.294238 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.294384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.294536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.294666 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.294847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.294978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.295201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.295346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.295524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.295774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.295911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.296099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.296239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.296412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.296552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.296722 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.296886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.297023 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.297203 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.297335 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.297462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.297624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.297755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.297938 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.298079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.298246 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.298386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.298553 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.298692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.298859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.299049 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.299212 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.299354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.299536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.299668 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.299858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.299999 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.300167 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.300377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.300510 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.300637 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.300777 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.300913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.301087 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.301225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.301394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.301525 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.301708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.301838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.302019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.302151 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.302339 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.302496 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.302672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.302802 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.302979 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.303126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.303358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.303510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.303641 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.303768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.303934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.304159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.304276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.304395 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.304537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.304662 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.304846 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.304972 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.305155 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.305484 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.305787 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.305931 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.306104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.306250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.306415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.306568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.306723 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.306894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.307134 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.307268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.307391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.307566 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.307685 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.307884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.308002 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.308196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.308324 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.308514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.308653 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.308911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.309048 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.309223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.309352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.309534 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.309664 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.309849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.309980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.310176 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.310311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.310496 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.310635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.311386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.311541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.311665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.311776 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.311885 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.312002 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.312120 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.312230 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.312348 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.312458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.312573 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.312683 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.312791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.312950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.313066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.313209 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.313326 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.313443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.313561 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.313749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.313862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.313971 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.314204 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.314355 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.314760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.314888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.315125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.315244 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.315452 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.315579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.315770 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.315896 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.316095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.316231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.316410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.316528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.316714 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.316843 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.317036 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.317152 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.317343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.317471 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.317647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.317779 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.317968 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.318628 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.318810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.318929 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.319138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.319269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.319444 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.319630 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.319780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.319892 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.320049 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.320168 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.320351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.320478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.320715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.320849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.320968 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.321077 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.321268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.321394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.321570 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.321688 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.321874 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.322000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.322177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.322302 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.322486 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.322610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.322787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.322917 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.323112 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.323240 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.323418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.323539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.323719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.323851 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.324029 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.324146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.324338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.324471 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.324637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.324769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.324936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.325052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.325245 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.325361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.325547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.325665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.325852 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.325969 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.326207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.326331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.326531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.326651 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.326834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.326958 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.327170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.327297 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.327461 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.327594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.327775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.327906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.328082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.328217 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.328391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.328520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.328830 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.329004 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.329146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.329320 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.329452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.329725 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.329867 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.329987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.330184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.330312 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.330506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.330625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.330845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.330972 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.331177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.331311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.331497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.331622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.331801 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.331926 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.332105 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.332231 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.332413 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.332537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.332720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.332845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.333029 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.333162 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.333331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.333446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.333656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.334388 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.334575 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.334699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.334819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.334937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.335249 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.335519 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.335663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.335886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.336031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.336181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.336323 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.336441 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.336559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.336677 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.336787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.336895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.337034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.337163 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.337287 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.337406 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.337541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.337675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.337812 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.337946 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.338090 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.338214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.338397 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.338523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.338706 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.338825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.339062 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.339194 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.339343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.339470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.339712 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.339952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.340085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.340211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.340347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.340483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.340618 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.340745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.340888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.341094 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.341225 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.341353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.341464 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.341580 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.341727 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.341869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.342037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.342188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.342347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.342508 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.342656 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.342817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.342965 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.343163 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.343314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.343483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.343874 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.344056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.344184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.344375 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.344493 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.344686 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.344803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.344995 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.345127 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.345328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.345449 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.345654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.345778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.345979 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.346099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.346285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.346402 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.346586 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.346704 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.346891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.347074 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.347227 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.347370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.347544 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.347676 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.347856 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.347987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.348159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.348297 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.348461 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.348600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.348769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.348954 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.349093 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.349221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.349376 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.349517 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.349672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.349818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.350104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.350242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.350380 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.350517 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.350653 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.350782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.350908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.351057 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.351256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.351399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.351528 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.351639 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.351758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.351870 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.352029 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.352162 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.352334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.352460 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.352638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.352755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.352941 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.353061 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.353241 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.353359 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.353543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.353668 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.353843 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.353963 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.354171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.354299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.354500 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.354626 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.354834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.354961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.355126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.355252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.355442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.355569 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.355762 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.355881 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.356068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.356192 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.356385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.356516 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.356700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.356824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.357010 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.357126 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.357319 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.357449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.357636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.357753 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.357974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.358100 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.358326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.358463 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.358582 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.358692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.358856 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.358974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.359214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.359350 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.359525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.359657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.359851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.359968 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.360273 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.360411 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.360539 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.360672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.360806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.360942 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.361079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.361308 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.361451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.361578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.361704 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.361859 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.361997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.362180 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.362308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.362486 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.362611 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.362795 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.362922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.363135 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.363307 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.363469 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.363594 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.363780 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.363894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.364082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.364199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.364387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.364502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.364696 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.364831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.365517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.365635 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.365824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.365943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.366148 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.366274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.366475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.366626 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.366780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.366912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.367152 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.367314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.367483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.367625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.367834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.367975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.368184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.368314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.368529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.368654 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.368793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.368924 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.369106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.369235 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.369418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.369543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.369721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.369839 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.369950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117979) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 21:57:54.370066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.370360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.370677 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.371015 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.371328 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.371658 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.372041 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.372302 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.373106 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.373106 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.373377 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.373698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.374031 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.374363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.374683 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.374995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.375335 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.375648 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.375959 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.376290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.376604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.376925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.377243 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.377585 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.377866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.378266 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.378625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.378817 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.379176 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.379503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.379836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.380169 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.381266 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.381432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.381710 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.381995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.382310 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.382622 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.382977 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.383322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.383653 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.383995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.384334 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.384660 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.385000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.385336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.385749 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.385981 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.386313 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.386626 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.386938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.387284 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.387597 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.387909 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.388218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.388535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.388845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.389154 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.389462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.389796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.390106 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.390433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.390753 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.391085 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.391455 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.391903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.392073 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.392351 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.392821 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.393019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.393343 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.393682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.393997 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.394329 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.394656 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.394977 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.395344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.395665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.395988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.396347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.396668 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.396983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.397307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.397627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.397988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.398562 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.398983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.399228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.399550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.399871 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.400193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.400514 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.400865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.401145 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.401461 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.402202 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.402202 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.402485 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.402742 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.403135 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.403461 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.403784 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.404105 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.404426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.404800 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.405126 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.405439 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.405758 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.406080 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.406401 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.406719 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.407058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.407384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.407701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.408016 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.408332 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.408708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.408967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.409306 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.409651 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.409978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.410296 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.410615 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.411053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.411557 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.411955 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.412496 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.412654 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.412888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.413269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.413534 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.413869 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.414181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.414503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.417849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.417849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.417849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.417849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.417849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.417849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.417849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.417849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.419539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.419539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.419539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.419539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.419539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.419539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.419539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.420569 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.420569 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.420569 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.421000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.421300 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.421448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.421686 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.422104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.422561 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.422862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.423039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.423270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.423606 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.423916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.424228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.424543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.424860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.425170 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.425478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.425788 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.426096 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.426414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.426723 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.427058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.427371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.428215 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.428525 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.428839 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.429210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.429607 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.429857 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.430166 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.430490 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.430806 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.431232 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.434590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.434590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.434590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.434590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.434590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.434590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.434590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.434590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.435866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.435866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.435866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.435866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.435866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.436528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.436528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.436820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.436961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.437177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.437488 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.437805 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.438122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.438439 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.438753 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.439106 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.439423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.440398 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.440398 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.440398 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.440847 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.440998 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.441325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.441757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.441949 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.442264 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.442581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.442896 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.443808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.444153 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.444552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.445145 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.445346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.445529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.445843 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.446171 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.446487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.446817 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.447268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.447554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.447889 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.448206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.448544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.448892 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.449228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.449565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.449925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.450187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.450499 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.450816 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.451169 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.451487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.451814 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.452104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.452421 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.452735 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.453045 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.453356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.453665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.453982 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.454292 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.454670 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.455309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.455309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.455628 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.455834 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.456149 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.456459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.456770 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.457079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.457408 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.457694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.458044 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.458385 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.458750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.459102 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.459427 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.459757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.460073 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.460392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.460717 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.461039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.461354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.461693 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.462012 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.462329 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.462645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.462962 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.463302 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.470299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.470299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.470299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.470299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.470299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.470299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.470299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.470299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.471568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.471568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.471568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.471568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.471568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.471568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.471568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.471568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.472901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.472901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.472901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.472901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.472901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.472901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.472901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.472901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.473975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.473975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.473975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.473975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.473975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.473975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.473975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.473975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 21:57:54.475161 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 21:57:54.521483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO dbcounter [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] Registered counter for database nova_api Jul 21 21:57:54.544043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_db.sqlalchemy.engines [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117979) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:57:54.554211 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writer thread running {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:57:54.615816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.context [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0(cell1) {{(pid=117979) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 21:57:54.619877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:57:54.621521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:57:54.622643 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:57:54.624684 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:57:54.626674 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO dbcounter [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] Registered counter for database nova_cell0 Jul 21 21:57:54.629160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO dbcounter [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] Registered counter for database nova_api Jul 21 21:57:54.631400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO dbcounter [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] Registered counter for database nova_cell1 Jul 21 21:57:54.638686 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_db.sqlalchemy.engines [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117979) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:57:54.640986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_db.sqlalchemy.engines [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117979) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:57:54.646109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writer thread running {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:57:54.648825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writer thread running {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:57:54.649723 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_db.sqlalchemy.engines [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117978) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:57:54.656249 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writer thread running {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:57:54.713601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.context [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0(cell1) {{(pid=117978) load_cells /opt/stack/nova/nova/context.py:464}} Jul 21 21:57:54.717708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:57:54.719610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:57:54.720442 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:57:54.722426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:57:54.724959 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO dbcounter [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] Registered counter for database nova_cell0 Jul 21 21:57:54.728973 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO dbcounter [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] Registered counter for database nova_cell1 Jul 21 21:57:54.736095 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_db.sqlalchemy.engines [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117978) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:57:54.738251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_db.sqlalchemy.engines [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117978) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:57:54.743572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writer thread running {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:57:54.746659 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writer thread running {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:57:54.797755 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO dbcounter [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] Registered counter for database nova_cell0 Jul 21 21:57:54.804355 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_db.sqlalchemy.engines [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117979) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:57:54.808653 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writer thread running {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:57:54.892866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO dbcounter [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] Registered counter for database nova_cell0 Jul 21 21:57:54.902268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_db.sqlalchemy.engines [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117978) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 21:57:54.906654 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writer thread running {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 21:57:55.132893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: WARNING keystonemiddleware.auth_token [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 21:57:55.140194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: WARNING keystonemiddleware.auth_token [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 21:57:55.234703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: WARNING keystonemiddleware.auth_token [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 21:57:55.242513 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: WARNING keystonemiddleware.auth_token [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 21:57:55.495428 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: WARNING keystonemiddleware.auth_token [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 21:57:55.502725 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: WARNING keystonemiddleware.auth_token [None req-14f426f1-d988-4313-979b-5bd4481adfa6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 21:57:55.509638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1424539c0 pid: 117979 (default app) Jul 21 21:57:55.592493 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: WARNING keystonemiddleware.auth_token [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 21 21:57:55.598891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: WARNING keystonemiddleware.auth_token [None req-522c3352-9590-4c48-906b-88e1c8a40a41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 21 21:57:55.605837 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1424539c0 pid: 117978 (default app) Jul 21 21:58:38.808498 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=3 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:58:38.810371 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=3 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:58:38.811465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=3 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:58:38.812519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=3 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:58:39.250129 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:58:39.254558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:58:39.257937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:58:39.261230 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:58:40.526735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a2dc769b-69d6-4901-aeb0-6c60a3d2fc8d tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] Action: 'create', calling method: .version_select at 0x7faca4707d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1592915438", "metadata": {"Type": "work"}}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:58:40.794380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7a46a8ab-c493-4c71-9d06-bf1fffb3d756 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Action: 'create', calling method: .version_select at 0x7faca4706ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1654943681"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:58:42.624909 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a2dc769b-69d6-4901-aeb0-6c60a3d2fc8d tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.841741 Jul 21 21:58:42.625980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jul 21 21:58:38 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3844 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 21:58:42.640241 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d0ad1f53-2e3b-4927-b73b-b9eadba18fbb tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] Calling method '.version_select at 0x7faca455db80>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:42.749253 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7a46a8ab-c493-4c71-9d06-bf1fffb3d756 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.517673 Jul 21 21:58:42.750784 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1/2] 10.222.0.44 () {60 vars in 1154 bytes} [Thu Jul 21 21:58:39 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3521 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 21 21:58:42.775257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-356f3355-3147-43b8-b7b4-d1fbb5c195b7 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca4555af0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:42.935330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d0ad1f53-2e3b-4927-b73b-b9eadba18fbb tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1a9bfd47-3615-4254-b98a-e5fe310699c8" status: 200 len: 353 microversion: 2.1 time: 0.300116 Jul 21 21:58:42.936437 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:58:42 2022] GET /compute/v2.1/os-volumes/1a9bfd47-3615-4254-b98a-e5fe310699c8 => generated 353 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:43.108053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-356f3355-3147-43b8-b7b4-d1fbb5c195b7 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f" status: 200 len: 345 microversion: 2.1 time: 0.343471 Jul 21 21:58:43.109251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:58:42 2022] GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f => generated 345 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:58:43.949210 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9b653b42-1712-4c42-ab51-505c30a036d6 tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] Calling method '.version_select at 0x7faca455ddc0>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:44.087752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9b653b42-1712-4c42-ab51-505c30a036d6 tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1a9bfd47-3615-4254-b98a-e5fe310699c8" status: 200 len: 354 microversion: 2.1 time: 0.142226 Jul 21 21:58:44.088709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 3/5] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:58:43 2022] GET /compute/v2.1/os-volumes/1a9bfd47-3615-4254-b98a-e5fe310699c8 => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:44.100898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-eadd3b67-ac49-4770-ace7-3ddf872f7978 tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] Calling method '.version_select at 0x7faca4555d30>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:44.130102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9853273d-00b0-4a26-ac64-e5fc1d95f5a0 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca4577310>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:44.197617 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-eadd3b67-ac49-4770-ace7-3ddf872f7978 tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1a9bfd47-3615-4254-b98a-e5fe310699c8" status: 200 len: 354 microversion: 2.1 time: 0.100989 Jul 21 21:58:44.198822 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 3/6] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:58:44 2022] GET /compute/v2.1/os-volumes/1a9bfd47-3615-4254-b98a-e5fe310699c8 => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:58:44.215130 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6bac5430-963f-41ad-b6f6-a2d770dad53a tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] Calling method '.version_select at 0x7faca45773a0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:44.224632 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9853273d-00b0-4a26-ac64-e5fc1d95f5a0 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f" status: 200 len: 345 microversion: 2.1 time: 0.106094 Jul 21 21:58:44.225692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:58:44 2022] GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:44.395167 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6bac5430-963f-41ad-b6f6-a2d770dad53a tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/1a9bfd47-3615-4254-b98a-e5fe310699c8" status: 202 len: 0 microversion: 2.1 time: 0.188550 Jul 21 21:58:44.396400 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 21:58:44 2022] DELETE /compute/v2.1/os-volumes/1a9bfd47-3615-4254-b98a-e5fe310699c8 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 21:58:44.408302 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-68635925-72e1-4933-9e64-be58e25d5929 tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] Calling method '.version_select at 0x7faca4577a60>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:44.536741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-68635925-72e1-4933-9e64-be58e25d5929 tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1a9bfd47-3615-4254-b98a-e5fe310699c8" status: 200 len: 353 microversion: 2.1 time: 0.132583 Jul 21 21:58:44.538104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 5/9] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:58:44 2022] GET /compute/v2.1/os-volumes/1a9bfd47-3615-4254-b98a-e5fe310699c8 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:45.239935 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f70ef13d-85ec-4c27-ae6c-c6e948a7116f tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca4577a60>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:45.460118 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f70ef13d-85ec-4c27-ae6c-c6e948a7116f tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f" status: 200 len: 346 microversion: 2.1 time: 0.225852 Jul 21 21:58:45.461063 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 5/10] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:58:45 2022] GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f => generated 346 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:45.473970 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-294405ea-64fe-4a17-a7b6-c42401df524b tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Action: 'create', calling method: .version_select at 0x7faca45559d0>, body: {"snapshot": {"volume_id": "3b221798-e6c4-4483-97c1-829df5437b9f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-234312717"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:58:45.522910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-374934703", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:58:45.727146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.network.neutron [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] validate_networks() for [('d8f19f10-5578-4f0e-b346-f7ab3c1df0d6', None, None, None, None, None)] {{(pid=117979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:58:46.263063 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-294405ea-64fe-4a17-a7b6-c42401df524b tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.794144 Jul 21 21:58:46.264202 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 6/11] 10.222.0.44 () {60 vars in 1161 bytes} [Thu Jul 21 21:58:45 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:46.269741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cde94e1d-79a6-4b00-b986-d5cd5ffb36f6 tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] Calling method '.version_select at 0x7faca4577670>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:46.322590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-cde94e1d-79a6-4b00-b986-d5cd5ffb36f6 tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] HTTP exception thrown: Volume 1a9bfd47-3615-4254-b98a-e5fe310699c8 could not be found. Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cde94e1d-79a6-4b00-b986-d5cd5ffb36f6 tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] Request method failure captured: Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/os-volumes/1a9bfd47-3615-4254-b98a-e5fe310699c8 HTTP/1.1 Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwOo5rugohrL5X7l8Tc83g8SkHFB8XKsOqQSUx5JN1YVdp8rknPmhZb6rh_znd-BPlOpsic3ziqVlaFB_9KEHDr2cPcb_oRn4-i70ezuvA_Q1VVygrjKN2fpEBul0cRRPs09e9Pt575tegM_HP7x-ZxU_UnwdAkGyOiRWaLv8-JR10 Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 57ca2bbf828f462ea4de060604a82021 Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesGetTestJSON-986786006 Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 21:58:46.326761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 21:58:46.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/57ca2bbf828f462ea4de060604a82021"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/57ca2bbf828f462ea4de060604a82021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/57ca2bbf828f462ea4de060604a82021"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_57ca2bbf828f462ea4de060604a82021", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 21:58:46.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesGetTestJSON-986786006 Jul 21 21:58:46.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 57ca2bbf828f462ea4de060604a82021 Jul 21 21:58:46.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesGetTestJSON-986786006 Jul 21 21:58:46.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesGetTestJSON-986786006-project Jul 21 21:58:46.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 21:58:46.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 21:58:46.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 3e7439e32f244df6861e5c166c80e34e Jul 21 21:58:46.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesGetTestJSON-986786006-project Jul 21 21:58:46.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: Jul 21 21:58:46.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Volume 1a9bfd47-3615-4254-b98a-e5fe310699c8 could not be found. Jul 21 21:58:46.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': '1a9bfd47-3615-4254-b98a-e5fe310699c8'} Jul 21 21:58:46.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1a9bfd47-3615-4254-b98a-e5fe310699c8 could not be found. (HTTP 404) (Request-ID: req-0509a135-422c-4d70-9d68-c6f2cb710843) Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:46.328700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:58:46.329691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1a9bfd47-3615-4254-b98a-e5fe310699c8 could not be found. Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 21:58:46.332679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1a9bfd47-3615-4254-b98a-e5fe310699c8 could not be found. Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1a9bfd47-3615-4254-b98a-e5fe310699c8 could not be found. Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cde94e1d-79a6-4b00-b986-d5cd5ffb36f6 tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] Returning 404 to user: Volume 1a9bfd47-3615-4254-b98a-e5fe310699c8 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cde94e1d-79a6-4b00-b986-d5cd5ffb36f6 tempest-VolumesGetTestJSON-986786006 tempest-VolumesGetTestJSON-986786006-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1a9bfd47-3615-4254-b98a-e5fe310699c8" status: 404 len: 109 microversion: 2.1 time: 0.063028 Jul 21 21:58:46.333663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 7/12] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:58:46 2022] GET /compute/v2.1/os-volumes/1a9bfd47-3615-4254-b98a-e5fe310699c8 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:58:46.341249 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7f746968-15ee-41a4-9124-7096ca287369 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca44e34c0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:46.389683 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7f746968-15ee-41a4-9124-7096ca287369 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c" status: 200 len: 286 microversion: 2.1 time: 0.058337 Jul 21 21:58:46.390634 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 8/13] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 21:58:46 2022] GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:46.402655 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d5951400-0cf3-41c7-a448-5ed32fee2f70 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca44e3b80>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:46.518456 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d5951400-0cf3-41c7-a448-5ed32fee2f70 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.120946 Jul 21 21:58:46.520140 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 9/14] 10.222.0.44 () {58 vars in 1139 bytes} [Thu Jul 21 21:58:46 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:58:46.533388 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-755d8b35-756b-4331-9315-7ff378ea9668 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca44e3c10>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:46.668146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-755d8b35-756b-4331-9315-7ff378ea9668 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c" status: 200 len: 286 microversion: 2.1 time: 0.140579 Jul 21 21:58:46.668978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 10/15] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 21:58:46 2022] GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c => generated 286 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:58:47.682298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4ee6f4b8-95d8-4f25-bd34-6fbf2e69078f tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca44e34c0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:47.786513 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4ee6f4b8-95d8-4f25-bd34-6fbf2e69078f tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c" status: 200 len: 286 microversion: 2.1 time: 0.108426 Jul 21 21:58:47.787674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 11/16] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 21:58:47 2022] GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:48.699780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Flavor limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:58:48.700995 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Image limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:58:48.702147 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Flavor pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:58:48.702986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Image pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:58:48.703677 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:58:48.763893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:58:48.766951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:58:48.775192 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:58:48.776034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:58:48.798480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8616fb05-392a-4866-b7d9-9f261fc666b1 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca44ef3a0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:48.919922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Getting quotas for project 3f8010f68f0c4fd4ac77cb9221777078. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:58:48.944129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Getting quotas for user 40f128f6095f425eb5b2f7bcce092e5a and project 3f8010f68f0c4fd4ac77cb9221777078. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:58:48.946541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8616fb05-392a-4866-b7d9-9f261fc666b1 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c" status: 200 len: 286 microversion: 2.1 time: 0.152392 Jul 21 21:58:48.947493 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 12/17] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 21:58:48 2022] GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c => generated 286 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:48.979213 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Going to run 1 instances... {{(pid=117979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:58:48.988469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:58:49.211120 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-104b3f32-d15f-453c-b8aa-41b108f39ec5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.918103 Jul 21 21:58:49.219365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 6/18] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 21:58:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 3927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 21:58:49.224501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ca321964-a14e-475e-8f6e-7eac1d91b2c8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:49.225324 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ca321964-a14e-475e-8f6e-7eac1d91b2c8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:58:49.596310 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ca321964-a14e-475e-8f6e-7eac1d91b2c8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:58:49.615457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ca321964-a14e-475e-8f6e-7eac1d91b2c8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1221 microversion: 2.1 time: 0.395837 Jul 21 21:58:49.624982 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 13/19] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:58:49 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1221 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:58:49.844009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1975752293", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:58:49.977798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.network.neutron [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] validate_networks() for [('d8f19f10-5578-4f0e-b346-f7ab3c1df0d6', None, None, None, None, None)] {{(pid=117979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:58:49.982324 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-339287b2-534d-45ab-9db4-bd7415db0d04 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca4555af0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:50.043241 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-339287b2-534d-45ab-9db4-bd7415db0d04 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c" status: 200 len: 286 microversion: 2.1 time: 0.086689 Jul 21 21:58:50.044229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 14/20] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 21:58:49 2022] GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:51.055603 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-39e98df6-fe59-4b1a-8400-94a292bcd5e4 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca44a29d0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:51.144201 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-39e98df6-fe59-4b1a-8400-94a292bcd5e4 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c" status: 200 len: 286 microversion: 2.1 time: 0.092325 Jul 21 21:58:51.148522 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 15/21] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 21:58:51 2022] GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c => generated 286 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:51.356997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Flavor limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:58:51.357924 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Image limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:58:51.358412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Flavor pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:58:51.358838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Image pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:58:51.359519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:58:51.379421 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:58:51.380340 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:58:51.392286 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:58:51.393681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:58:51.451096 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Getting quotas for project 3f8010f68f0c4fd4ac77cb9221777078. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:58:51.466922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Getting quotas for user 40f128f6095f425eb5b2f7bcce092e5a and project 3f8010f68f0c4fd4ac77cb9221777078. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:58:51.557339 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Going to run 1 instances... {{(pid=117979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:58:51.576039 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:58:51.758711 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-78dccdfa-767f-4fe2-9489-94e812cd74de tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.922410 Jul 21 21:58:51.761023 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 7/22] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 21:58:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 21:58:51.781829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-871f5f58-e206-4e80-9135-54fab417d414 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:51.787460 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-871f5f58-e206-4e80-9135-54fab417d414 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:58:52.157198 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2a21fb70-894a-4409-9b69-fe9b9d89d9a1 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca4477940>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:52.192646 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-871f5f58-e206-4e80-9135-54fab417d414 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:58:52.200499 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-871f5f58-e206-4e80-9135-54fab417d414 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1222 microversion: 2.1 time: 0.431800 Jul 21 21:58:52.205568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 16/23] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:58:51 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1222 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:58:52.270329 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2a21fb70-894a-4409-9b69-fe9b9d89d9a1 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c" status: 200 len: 286 microversion: 2.1 time: 0.117125 Jul 21 21:58:52.270992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 8/24] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 21:58:52 2022] GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c => generated 286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:53.227239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b8266fc3-da9a-4d6e-a964-04d962f7af73 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:53.227866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b8266fc3-da9a-4d6e-a964-04d962f7af73 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:58:53.281671 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-20eb6286-6969-4263-adf3-f6fbd4c92eba tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca340a040>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:53.348582 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-20eb6286-6969-4263-adf3-f6fbd4c92eba tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c" status: 200 len: 287 microversion: 2.1 time: 0.070518 Jul 21 21:58:53.349823 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 9/25] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 21:58:53 2022] GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:53.359838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-30e23117-7291-4ef2-b67c-7e258e5eecd8 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca4477b80>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:53.444939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b8266fc3-da9a-4d6e-a964-04d962f7af73 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:58:53.490253 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b8266fc3-da9a-4d6e-a964-04d962f7af73 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1222 microversion: 2.1 time: 0.235133 Jul 21 21:58:53.496300 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 17/26] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:58:53 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1222 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:58:53.571295 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-30e23117-7291-4ef2-b67c-7e258e5eecd8 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c" status: 202 len: 0 microversion: 2.1 time: 0.215077 Jul 21 21:58:53.571879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 10/27] 10.222.0.44 () {58 vars in 1253 bytes} [Thu Jul 21 21:58:53 2022] DELETE /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 21:58:53.590219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-42e93912-5971-420a-a0e3-7333c651f15e tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca44aa0d0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:53.678191 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-42e93912-5971-420a-a0e3-7333c651f15e tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c" status: 200 len: 286 microversion: 2.1 time: 0.100456 Jul 21 21:58:53.679544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 18/28] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 21:58:53 2022] GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:54.510797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4b14ad9c-a6ce-4d48-a879-49400750597a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:54.512071 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4b14ad9c-a6ce-4d48-a879-49400750597a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:58:54.546892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b14ad9c-a6ce-4d48-a879-49400750597a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:58:54.547389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b14ad9c-a6ce-4d48-a879-49400750597a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:58:54.548196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b14ad9c-a6ce-4d48-a879-49400750597a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:58:54.553778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b14ad9c-a6ce-4d48-a879-49400750597a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:58:54.692134 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b9f4c4ef-7bec-4a98-88af-29ed8b2e883b tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca44aa9d0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:54.750374 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-b9f4c4ef-7bec-4a98-88af-29ed8b2e883b tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] HTTP exception thrown: Snapshot d0d91872-9d7e-405b-a682-8988ae51ee3c could not be found. Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b9f4c4ef-7bec-4a98-88af-29ed8b2e883b tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Request method failure captured: Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c HTTP/1.1 Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwPAwjOQPX8w8mFEB0mLsk_CkTPJpukDirLr_wFqyqNQ6ny_Zv5qITX_g35tSOyj7TPFtpQRjxVn7TdYbkAwghrDRqeXp2Dw0PbbRUwYUY99J799D8Dj5JBqCWWPXAEvEIsgwxyddYJCQdPkk2G7nN8MXrDhfAhieffzeOE8M906pA Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: d6a2472a620c43989673b41c0c86fcc5 Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1182806971 Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 21:58:54.752613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 21:58:54.753984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d6a2472a620c43989673b41c0c86fcc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d6a2472a620c43989673b41c0c86fcc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d6a2472a620c43989673b41c0c86fcc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d6a2472a620c43989673b41c0c86fcc5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 21:58:54.753984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1182806971 Jul 21 21:58:54.753984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: d6a2472a620c43989673b41c0c86fcc5 Jul 21 21:58:54.753984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1182806971 Jul 21 21:58:54.753984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesSnapshotsTestJSON-1182806971-project Jul 21 21:58:54.753984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 21:58:54.753984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 21:58:54.753984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 1197ad8011e34a8793ebbeaefda9e088 Jul 21 21:58:54.753984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1182806971-project Jul 21 21:58:54.753984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: Jul 21 21:58:54.753984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Snapshot d0d91872-9d7e-405b-a682-8988ae51ee3c could not be found. Jul 21 21:58:54.753984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': 'd0d91872-9d7e-405b-a682-8988ae51ee3c'} Jul 21 21:58:54.753984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d0d91872-9d7e-405b-a682-8988ae51ee3c could not be found. (HTTP 404) (Request-ID: req-35235cda-4a0d-4560-968d-665fdddb4b21) Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:54.754697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:58:54.755611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d0d91872-9d7e-405b-a682-8988ae51ee3c could not be found. Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 21 21:58:54.756518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:58:54.763370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d0d91872-9d7e-405b-a682-8988ae51ee3c could not be found. Jul 21 21:58:54.763370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:54.763370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:54.763370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:54.763370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:54.763370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:58:54.763370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:58:54.763370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:58:54.763370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:58:54.763370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d0d91872-9d7e-405b-a682-8988ae51ee3c could not be found. Jul 21 21:58:54.763370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:54.763370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b9f4c4ef-7bec-4a98-88af-29ed8b2e883b tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Returning 404 to user: Snapshot d0d91872-9d7e-405b-a682-8988ae51ee3c could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:58:54.763370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b9f4c4ef-7bec-4a98-88af-29ed8b2e883b tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c" status: 404 len: 111 microversion: 2.1 time: 0.066397 Jul 21 21:58:54.764194 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 19/29] 10.222.0.44 () {58 vars in 1250 bytes} [Thu Jul 21 21:58:54 2022] GET /compute/v2.1/os-snapshots/d0d91872-9d7e-405b-a682-8988ae51ee3c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 21:58:54.765731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6bed9a46-5d0c-46e0-a04d-7c797899b146 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca44a2a60>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:54.898771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6bed9a46-5d0c-46e0-a04d-7c797899b146 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f" status: 202 len: 0 microversion: 2.1 time: 0.136667 Jul 21 21:58:54.899958 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 20/30] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 21:58:54 2022] DELETE /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 21:58:54.910421 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-425f9305-a44e-4688-ad85-726919f063fd tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca44aaca0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:55.030757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-425f9305-a44e-4688-ad85-726919f063fd tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f" status: 200 len: 345 microversion: 2.1 time: 0.125595 Jul 21 21:58:55.031691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 21/31] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:58:54 2022] GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:55.148568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c85a7d4d-f5ec-457a-9061-54a70695f047 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] Calling method '.version_select at 0x7faca44a2940>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:55.218723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4b14ad9c-a6ce-4d48-a879-49400750597a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:58:55.243422 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4b14ad9c-a6ce-4d48-a879-49400750597a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1274 microversion: 2.1 time: 0.736479 Jul 21 21:58:55.258380 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 11/32] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:58:54 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1274 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:58:55.283802 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c85a7d4d-f5ec-457a-9061-54a70695f047 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/9ce57009-1d73-4362-8864-716c0251b2b0" status: 200 len: 350 microversion: 2.1 time: 0.144253 Jul 21 21:58:55.286444 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 22/33] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:58:55 2022] GET /compute/v2.1/os-volumes/9ce57009-1d73-4362-8864-716c0251b2b0 => generated 350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:58:56.045068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3f9be731-c592-4cca-ba7a-7f012b0bfc90 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca3391b80>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:56.102117 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-3f9be731-c592-4cca-ba7a-7f012b0bfc90 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] HTTP exception thrown: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3f9be731-c592-4cca-ba7a-7f012b0bfc90 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Request method failure captured: Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f HTTP/1.1 Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwPAwjOQPX8w8mFEB0mLsk_CkTPJpukDirLr_wFqyqNQ6ny_Zv5qITX_g35tSOyj7TPFtpQRjxVn7TdYbkAwghrDRqeXp2Dw0PbbRUwYUY99J799D8Dj5JBqCWWPXAEvEIsgwxyddYJCQdPkk2G7nN8MXrDhfAhieffzeOE8M906pA Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: d6a2472a620c43989673b41c0c86fcc5 Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1182806971 Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 21:58:56.118883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 21:58:56.120588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d6a2472a620c43989673b41c0c86fcc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d6a2472a620c43989673b41c0c86fcc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d6a2472a620c43989673b41c0c86fcc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d6a2472a620c43989673b41c0c86fcc5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 21:58:56.120588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1182806971 Jul 21 21:58:56.120588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: d6a2472a620c43989673b41c0c86fcc5 Jul 21 21:58:56.120588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1182806971 Jul 21 21:58:56.120588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-VolumesSnapshotsTestJSON-1182806971-project Jul 21 21:58:56.120588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 21:58:56.120588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 21:58:56.120588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 1197ad8011e34a8793ebbeaefda9e088 Jul 21 21:58:56.120588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1182806971-project Jul 21 21:58:56.120588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: Jul 21 21:58:56.120588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.120588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '3b221798-e6c4-4483-97c1-829df5437b9f'} Jul 21 21:58:56.120588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. (HTTP 404) (Request-ID: req-ec5a82c3-48c8-40df-a45b-9e56fbae24df) Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:56.121853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:58:56.123595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 21:58:56.125206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3f9be731-c592-4cca-ba7a-7f012b0bfc90 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Returning 404 to user: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3f9be731-c592-4cca-ba7a-7f012b0bfc90 tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f" status: 404 len: 109 microversion: 2.1 time: 0.079894 Jul 21 21:58:56.126919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 12/34] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:58:56 2022] GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:58:56.138371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fe821bd1-ac4c-48f4-b5a2-e70ad560953d tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca44ef550>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:56.188454 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-fe821bd1-ac4c-48f4-b5a2-e70ad560953d tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] HTTP exception thrown: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fe821bd1-ac4c-48f4-b5a2-e70ad560953d tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Request method failure captured: Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f HTTP/1.1 Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwPAwjOQPX8w8mFEB0mLsk_CkTPJpukDirLr_wFqyqNQ6ny_Zv5qITX_g35tSOyj7TPFtpQRjxVn7TdYbkAwghrDRqeXp2Dw0PbbRUwYUY99J799D8Dj5JBqCWWPXAEvEIsgwxyddYJCQdPkk2G7nN8MXrDhfAhieffzeOE8M906pA Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: d6a2472a620c43989673b41c0c86fcc5 Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1182806971 Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 21:58:56.190720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 21:58:56.191836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d6a2472a620c43989673b41c0c86fcc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d6a2472a620c43989673b41c0c86fcc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d6a2472a620c43989673b41c0c86fcc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d6a2472a620c43989673b41c0c86fcc5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 21:58:56.191836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1182806971 Jul 21 21:58:56.191836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: d6a2472a620c43989673b41c0c86fcc5 Jul 21 21:58:56.191836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1182806971 Jul 21 21:58:56.191836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesSnapshotsTestJSON-1182806971-project Jul 21 21:58:56.191836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 21:58:56.191836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 21:58:56.191836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 1197ad8011e34a8793ebbeaefda9e088 Jul 21 21:58:56.191836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1182806971-project Jul 21 21:58:56.191836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: Jul 21 21:58:56.191836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.191836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': '3b221798-e6c4-4483-97c1-829df5437b9f'} Jul 21 21:58:56.191836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. (HTTP 404) (Request-ID: req-8fbd3c9a-3385-4c2a-bd5c-5f37e0454c5f) Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:56.192447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 21:58:56.193340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 21:58:56.194200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:58:56.195184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.195184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.195184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:56.195184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.195184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:56.195184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:58:56.195184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:58:56.195184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:58:56.195184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:58:56.195184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.195184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.196588 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fe821bd1-ac4c-48f4-b5a2-e70ad560953d tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Returning 404 to user: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:58:56.197637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fe821bd1-ac4c-48f4-b5a2-e70ad560953d tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f" status: 404 len: 109 microversion: 2.1 time: 0.064668 Jul 21 21:58:56.198747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 23/35] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 21:58:56 2022] DELETE /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:58:56.208233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9477e865-52d5-47b5-a6ab-591bd9befdfc tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Calling method '.version_select at 0x7faca3329ca0>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:56.269904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-9477e865-52d5-47b5-a6ab-591bd9befdfc tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] HTTP exception thrown: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9477e865-52d5-47b5-a6ab-591bd9befdfc tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Request method failure captured: Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f HTTP/1.1 Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwPAwjOQPX8w8mFEB0mLsk_CkTPJpukDirLr_wFqyqNQ6ny_Zv5qITX_g35tSOyj7TPFtpQRjxVn7TdYbkAwghrDRqeXp2Dw0PbbRUwYUY99J799D8Dj5JBqCWWPXAEvEIsgwxyddYJCQdPkk2G7nN8MXrDhfAhieffzeOE8M906pA Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: d6a2472a620c43989673b41c0c86fcc5 Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1182806971 Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 21:58:56.272149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 21:58:56.273219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d6a2472a620c43989673b41c0c86fcc5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d6a2472a620c43989673b41c0c86fcc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d6a2472a620c43989673b41c0c86fcc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d6a2472a620c43989673b41c0c86fcc5", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 21:58:56.273219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1182806971 Jul 21 21:58:56.273219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: d6a2472a620c43989673b41c0c86fcc5 Jul 21 21:58:56.273219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1182806971 Jul 21 21:58:56.273219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-VolumesSnapshotsTestJSON-1182806971-project Jul 21 21:58:56.273219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 21:58:56.273219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 21:58:56.273219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 1197ad8011e34a8793ebbeaefda9e088 Jul 21 21:58:56.273219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1182806971-project Jul 21 21:58:56.273219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: Jul 21 21:58:56.273219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.273219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '3b221798-e6c4-4483-97c1-829df5437b9f'} Jul 21 21:58:56.273219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. (HTTP 404) (Request-ID: req-ccbd1a71-9848-4119-9962-16d9f812d5ec) Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:56.273838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 21:58:56.274710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 21:58:56.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 21:58:56.277649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.277649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.277649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 21:58:56.277649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.277649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 21:58:56.277649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 21:58:56.277649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 21:58:56.277649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 21:58:56.277649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 21:58:56.277649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. Jul 21 21:58:56.277649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 21:58:56.277649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9477e865-52d5-47b5-a6ab-591bd9befdfc tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] Returning 404 to user: Volume 3b221798-e6c4-4483-97c1-829df5437b9f could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 21:58:56.277649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9477e865-52d5-47b5-a6ab-591bd9befdfc tempest-VolumesSnapshotsTestJSON-1182806971 tempest-VolumesSnapshotsTestJSON-1182806971-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f" status: 404 len: 109 microversion: 2.1 time: 0.070257 Jul 21 21:58:56.285043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e9781d00-47da-4e52-9808-4bcb6b6b1455 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:56.291038 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e9781d00-47da-4e52-9808-4bcb6b6b1455 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:58:56.293197 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 13/36] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:58:56 2022] GET /compute/v2.1/os-volumes/3b221798-e6c4-4483-97c1-829df5437b9f => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 21:58:56.329499 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9781d00-47da-4e52-9808-4bcb6b6b1455 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:58:56.342157 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9781d00-47da-4e52-9808-4bcb6b6b1455 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:58:56.344480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9781d00-47da-4e52-9808-4bcb6b6b1455 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:58:56.351155 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9781d00-47da-4e52-9808-4bcb6b6b1455 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:58:57.037176 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9781d00-47da-4e52-9808-4bcb6b6b1455 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:58:57.068221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e9781d00-47da-4e52-9808-4bcb6b6b1455 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1280 microversion: 2.1 time: 0.792827 Jul 21 21:58:57.075151 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 24/37] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:58:56 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1280 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:58:58.092703 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ba83559f-b39e-439b-9f7b-20f362f28101 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:58.093723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ba83559f-b39e-439b-9f7b-20f362f28101 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:58:58.109608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba83559f-b39e-439b-9f7b-20f362f28101 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:58:58.119818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba83559f-b39e-439b-9f7b-20f362f28101 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:58:58.121185 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba83559f-b39e-439b-9f7b-20f362f28101 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:58:58.124131 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba83559f-b39e-439b-9f7b-20f362f28101 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:58:58.636205 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ba83559f-b39e-439b-9f7b-20f362f28101 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:58:58.644047 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ba83559f-b39e-439b-9f7b-20f362f28101 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1280 microversion: 2.1 time: 0.555380 Jul 21 21:58:58.647126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 14/38] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:58:58 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1280 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:58:58.671258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9ae22992-fa7b-4cd9-8b75-95f215c3c55b tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] Calling method '.version_select at 0x7faca3346820>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:58.842354 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9ae22992-fa7b-4cd9-8b75-95f215c3c55b tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/04cceca4-f655-45cf-aaba-df92b1395d9e" status: 200 len: 351 microversion: 2.1 time: 0.183377 Jul 21 21:58:58.845869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 15/39] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:58:58 2022] GET /compute/v2.1/os-volumes/04cceca4-f655-45cf-aaba-df92b1395d9e => generated 351 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:58:59.158431 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-856588db-c159-434c-8fa8-314bfa4f00c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Action: 'create', calling method: .version_select at 0x7faca43d5dc0>, body: {"keypair": {"name": "tempest-keypair-2073268854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4P/IoeKL/Dmbiujq6l3GF8+/dNu5CAMZDc7bdUAxrRrbkcsQV1b26ML0sDC6D5iI0XChoo2umFBBmSqQxzbeoMIqFUBc+DqGmI+FrMn3nfUos/39jO8QCB+ZJ7Zml1Ng=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:58:59.323904 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-856588db-c159-434c-8fa8-314bfa4f00c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Getting quotas for project 36a85f96959d48c5810ea0d38f65f22c. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:58:59.351198 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-856588db-c159-434c-8fa8-314bfa4f00c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Getting quotas for user 1c86ce2899b6485da1517e3b5a1c64de and project 36a85f96959d48c5810ea0d38f65f22c. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:58:59.525437 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-856588db-c159-434c-8fa8-314bfa4f00c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.203026 Jul 21 21:58:59.526051 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 25/40] 10.222.0.44 () {62 vars in 1199 bytes} [Thu Jul 21 21:58:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1205 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 21:58:59.672545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-940bbe3f-ca78-4d6b-ab95-99930520f763 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:58:59.673164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-940bbe3f-ca78-4d6b-ab95-99930520f763 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:58:59.694659 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-940bbe3f-ca78-4d6b-ab95-99930520f763 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:58:59.695145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-940bbe3f-ca78-4d6b-ab95-99930520f763 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:58:59.696734 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-940bbe3f-ca78-4d6b-ab95-99930520f763 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:58:59.703337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-940bbe3f-ca78-4d6b-ab95-99930520f763 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:58:59.999496 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-940bbe3f-ca78-4d6b-ab95-99930520f763 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:00.013265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-940bbe3f-ca78-4d6b-ab95-99930520f763 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1280 microversion: 2.1 time: 0.344568 Jul 21 21:59:00.013869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 16/41] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:58:59 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1280 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:00.782550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bec1cf23-0503-4d5a-b452-a626d90cb398 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] Calling method '.version_select at 0x7faca43c59d0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:00.902775 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bec1cf23-0503-4d5a-b452-a626d90cb398 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/49627974-493b-414e-8716-a77a0ed3a3b1" status: 200 len: 351 microversion: 2.1 time: 0.124877 Jul 21 21:59:00.903681 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 26/42] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 21:59:00 2022] GET /compute/v2.1/os-volumes/49627974-493b-414e-8716-a77a0ed3a3b1 => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:59:00.940292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-05804e56-b630-40e7-936d-57695b165506 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] Calling method '.version_select at 0x7faca33461f0>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:01.031872 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ba28653c-7475-49bf-894f-c35c3287d6b8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:01.032576 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ba28653c-7475-49bf-894f-c35c3287d6b8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:01.053619 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ba28653c-7475-49bf-894f-c35c3287d6b8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:01.062399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ba28653c-7475-49bf-894f-c35c3287d6b8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:01.066392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ba28653c-7475-49bf-894f-c35c3287d6b8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:01.073284 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ba28653c-7475-49bf-894f-c35c3287d6b8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:01.243538 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-05804e56-b630-40e7-936d-57695b165506 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.330684 Jul 21 21:59:01.244850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 17/43] 10.222.0.44 () {58 vars in 1133 bytes} [Thu Jul 21 21:59:00 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:01.266581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-31fac47d-70dd-4c10-a3da-6e8e8239a344 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] Calling method '.version_select at 0x7faca32e2ca0>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:01.421303 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=4 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:01.529022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=12 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:01.718073 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-31fac47d-70dd-4c10-a3da-6e8e8239a344 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.455815 Jul 21 21:59:01.721948 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 18/44] 10.222.0.44 () {58 vars in 1148 bytes} [Thu Jul 21 21:59:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:01.739325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e9e6bbba-15d8-4c21-b2d4-771d9084e158 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] Calling method '.version_select at 0x7faca3329ee0>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:02.036949 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e9e6bbba-15d8-4c21-b2d4-771d9084e158 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.305185 Jul 21 21:59:02.038031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 19/45] 10.222.0.44 () {58 vars in 1133 bytes} [Thu Jul 21 21:59:01 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:02.202565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ba28653c-7475-49bf-894f-c35c3287d6b8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:02.211085 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ba28653c-7475-49bf-894f-c35c3287d6b8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1280 microversion: 2.1 time: 1.183761 Jul 21 21:59:02.218146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 27/46] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:01 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1280 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:02.227258 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-24fc55aa-df5b-4f67-bbca-6de989eea407 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] Calling method '.version_select at 0x7faca43c5b80>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:02.492250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-740365069", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "networks": [{"uuid": "669789a0-1cfa-4d45-8740-7ef961123e32"}]}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:02.537822 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-24fc55aa-df5b-4f67-bbca-6de989eea407 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.314291 Jul 21 21:59:02.538875 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 28/47] 10.222.0.44 () {58 vars in 1166 bytes} [Thu Jul 21 21:59:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:02.551987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-68d389e6-4919-41f2-8d3e-a081e3fadba5 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] Calling method '.version_select at 0x7faca4378820>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:02.651504 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.network.neutron [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] validate_networks() for [('669789a0-1cfa-4d45-8740-7ef961123e32', None, None, None, None, None)] {{(pid=117979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:59:02.804367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-68d389e6-4919-41f2-8d3e-a081e3fadba5 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.257411 Jul 21 21:59:02.805741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 29/48] 10.222.0.44 () {58 vars in 1169 bytes} [Thu Jul 21 21:59:02 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:02.818584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5d1ee8d8-60e1-460d-8ff4-065ec9130ca1 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] Calling method '.version_select at 0x7faca3b0c820>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:03.057458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5d1ee8d8-60e1-460d-8ff4-065ec9130ca1 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.243019 Jul 21 21:59:03.058118 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 30/49] 10.222.0.44 () {58 vars in 1154 bytes} [Thu Jul 21 21:59:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:03.076380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e3e45c8d-cd8e-4ac3-9918-941069b11a34 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] Calling method '.version_select at 0x7faca3b0c1f0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:03.327244 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e3e45c8d-cd8e-4ac3-9918-941069b11a34 tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.260109 Jul 21 21:59:03.336273 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 31/50] 10.222.0.44 () {58 vars in 1187 bytes} [Thu Jul 21 21:59:03 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:03.360687 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5cc7c83a-0dce-4c9a-8a66-7aa6887c7c4d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:03.364416 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5cc7c83a-0dce-4c9a-8a66-7aa6887c7c4d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:03.386974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5cc7c83a-0dce-4c9a-8a66-7aa6887c7c4d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:03.387579 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5cc7c83a-0dce-4c9a-8a66-7aa6887c7c4d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:03.389914 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5cc7c83a-0dce-4c9a-8a66-7aa6887c7c4d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:03.391762 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5cc7c83a-0dce-4c9a-8a66-7aa6887c7c4d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:06.507893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5cc7c83a-0dce-4c9a-8a66-7aa6887c7c4d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:06.532803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5cc7c83a-0dce-4c9a-8a66-7aa6887c7c4d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 3.203329 Jul 21 21:59:06.535503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 32/51] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:03 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 3207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:06.551143 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b831cea3-8a6f-42e0-a5e9-1e48d9a859be tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] Calling method '.version_select at 0x7faca43c5e50>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:06.760599 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b831cea3-8a6f-42e0-a5e9-1e48d9a859be tempest-VolumesTestJSON-1480118537 tempest-VolumesTestJSON-1480118537-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.221532 Jul 21 21:59:06.764784 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 33/52] 10.222.0.44 () {58 vars in 1154 bytes} [Thu Jul 21 21:59:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:07.168072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dec5b525-c16e-45c5-9bd1-381ea267a7dd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Action: 'create', calling method: .version_select at 0x7faca43d5e50>, body: {"keypair": {"name": "tempest-keypair-1283027389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNcMgAvQh2rZlfL7aLH5sXUh5X2ZyUL6vu6n06iAIdtAnJTiIPspX/zy/PgzhLJxpHodCqVf7z/zWt2Bg4fuQ79HUa3YGkJJUhJKGQ6yo87hf31TZGgQ3XCI8JCe5Untg=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:07.281102 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-dec5b525-c16e-45c5-9bd1-381ea267a7dd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:59:07.312865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-dec5b525-c16e-45c5-9bd1-381ea267a7dd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for user 73f068abea75404fb2829065a674aee4 and project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:59:07.416564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dec5b525-c16e-45c5-9bd1-381ea267a7dd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.648875 Jul 21 21:59:07.421622 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 34/53] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 21:59:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:07.557503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6970c9e3-cfe4-4b96-ba2c-7e659acea8ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:07.558469 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6970c9e3-cfe4-4b96-ba2c-7e659acea8ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:07.588940 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6970c9e3-cfe4-4b96-ba2c-7e659acea8ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:07.591360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6970c9e3-cfe4-4b96-ba2c-7e659acea8ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:07.593254 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6970c9e3-cfe4-4b96-ba2c-7e659acea8ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:07.598431 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6970c9e3-cfe4-4b96-ba2c-7e659acea8ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:09.056580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6970c9e3-cfe4-4b96-ba2c-7e659acea8ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:09.090169 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6970c9e3-cfe4-4b96-ba2c-7e659acea8ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 1.540868 Jul 21 21:59:09.099078 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 35/54] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:07 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:10.007856 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=22 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:10.281263 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-623f718e-b0ce-4d1c-a508-85d48b47f7a5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Action: 'create', calling method: .version_select at 0x7faca43780d0>, body: {"keypair": {"name": "tempest-keypair-1782920728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDWBgsqsIIkzwY9uASdP8Wc45X0BuBobSQhcKZKR9b/LU8V3vMTZmc0d3cIgdnFXKfhPKKW48ZUYSDU952tmUQPWOLLDCNWpEJKQa978ijFaezCQQ3+FhJzBlW//ls8HVA=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:10.291281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:10.367456 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-623f718e-b0ce-4d1c-a508-85d48b47f7a5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Getting quotas for project 64e8fc83edda464e8ec9f7c2ee9c142c. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:59:10.387745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-623f718e-b0ce-4d1c-a508-85d48b47f7a5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Getting quotas for user 9f6537f0b9d44ba58cb5a5552f2c5b4e and project 64e8fc83edda464e8ec9f7c2ee9c142c. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:59:10.473241 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-623f718e-b0ce-4d1c-a508-85d48b47f7a5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.369972 Jul 21 21:59:10.480137 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 36/55] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 21:59:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:10.510324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Flavor limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:59:10.512587 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Image limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:59:10.514051 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Flavor pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:59:10.514731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Image pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:59:10.515485 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:59:10.519200 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=6 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:10.548060 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:10.550794 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:10.553409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:10.556098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:10.616449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Getting quotas for project b119bfb06f994b23b28c3d7002535d3c. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:59:10.640446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Getting quotas for user 7c8fcfca20c648fc941538445c84e795 and project b119bfb06f994b23b28c3d7002535d3c. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:59:10.724732 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Going to run 1 instances... {{(pid=117979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:59:10.734132 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:59:10.846147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-5c27b054-71e8-41af-9761-a75845c881bf req-57fb705d-15b7-47a9-bebb-d876acafe56a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "996ecad7-3e17-4fda-ba01-cc79e9573422", "tag": "04c59949-5420-433b-87b4-a24c499eb2ef"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:10.884331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-5c27b054-71e8-41af-9761-a75845c881bf req-57fb705d-15b7-47a9-bebb-d876acafe56a service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:10.885099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-5c27b054-71e8-41af-9761-a75845c881bf req-57fb705d-15b7-47a9-bebb-d876acafe56a service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:10.979865 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7a2f3f19-1827-4d3d-9cf9-b9f3d960ac14 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.940701 Jul 21 21:59:10.991999 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 20/56] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 21:59:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 8953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 21:59:10.995137 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-5c27b054-71e8-41af-9761-a75845c881bf req-57fb705d-15b7-47a9-bebb-d876acafe56a service nova] Creating event network-changed:04c59949-5420-433b-87b4-a24c499eb2ef for instance 996ecad7-3e17-4fda-ba01-cc79e9573422 on hv-cinder-82002 Jul 21 21:59:10.996000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-5c27b054-71e8-41af-9761-a75845c881bf req-57fb705d-15b7-47a9-bebb-d876acafe56a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117978) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 21:59:10.999713 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96c53e59-11e2-4c50-bfcf-4918e771a208 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:11.003616 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96c53e59-11e2-4c50-bfcf-4918e771a208 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:11.006612 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96c53e59-11e2-4c50-bfcf-4918e771a208 None None] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:11.018376 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0157d473-2554-46e7-aa82-634d8e965a44 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:11.021493 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0157d473-2554-46e7-aa82-634d8e965a44 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:11.029295 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96c53e59-11e2-4c50-bfcf-4918e771a208 None None] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:11.053950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0157d473-2554-46e7-aa82-634d8e965a44 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:11.055985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0157d473-2554-46e7-aa82-634d8e965a44 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:11.057166 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0157d473-2554-46e7-aa82-634d8e965a44 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:11.059697 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0157d473-2554-46e7-aa82-634d8e965a44 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:11.101281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.compute.rpcapi [None req-96c53e59-11e2-4c50-bfcf-4918e771a208 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 21:59:11.103751 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96c53e59-11e2-4c50-bfcf-4918e771a208 None None] Releasing lock "compute-rpcapi-router" {{(pid=117978) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 21:59:11.176303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-96c53e59-11e2-4c50-bfcf-4918e771a208 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.694829 Jul 21 21:59:11.177197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 37/57] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:11.617151 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-b3abdad3-34be-4034-9dcd-60df4e5afeb8 req-c1df06b7-3a93-4657-876b-6e9a4d392989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed6c5da-065f-40bc-9f21-154eda67c27a", "tag": "b79b076d-b273-4ae6-94d4-f7a4aad57e4f"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:11.640121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-b3abdad3-34be-4034-9dcd-60df4e5afeb8 req-c1df06b7-3a93-4657-876b-6e9a4d392989 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:11.649100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-b3abdad3-34be-4034-9dcd-60df4e5afeb8 req-c1df06b7-3a93-4657-876b-6e9a4d392989 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:11.695479 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-b3abdad3-34be-4034-9dcd-60df4e5afeb8 req-c1df06b7-3a93-4657-876b-6e9a4d392989 service nova] Creating event network-changed:b79b076d-b273-4ae6-94d4-f7a4aad57e4f for instance bed6c5da-065f-40bc-9f21-154eda67c27a on hv-cinder-82002 Jul 21 21:59:11.708200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-b3abdad3-34be-4034-9dcd-60df4e5afeb8 req-c1df06b7-3a93-4657-876b-6e9a4d392989 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.527543 Jul 21 21:59:11.715142 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 38/58] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:11.736342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c4fffdf5-9571-4cdb-8897-8130fc21d84e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:11.743411 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c4fffdf5-9571-4cdb-8897-8130fc21d84e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:12.845405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c4fffdf5-9571-4cdb-8897-8130fc21d84e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:12.855905 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c4fffdf5-9571-4cdb-8897-8130fc21d84e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1214 microversion: 2.1 time: 1.137753 Jul 21 21:59:12.861589 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 39/59] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:11 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1214 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:13.314500 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0157d473-2554-46e7-aa82-634d8e965a44 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:13.331281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0157d473-2554-46e7-aa82-634d8e965a44 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 2.338038 Jul 21 21:59:13.334344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 21/60] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:10 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 2342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:13.881617 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5ea3517f-d0d3-4322-9958-485d42664164 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:13.888388 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5ea3517f-d0d3-4322-9958-485d42664164 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:13.896634 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ea3517f-d0d3-4322-9958-485d42664164 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:13.897409 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ea3517f-d0d3-4322-9958-485d42664164 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:13.898425 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ea3517f-d0d3-4322-9958-485d42664164 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:13.899146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ea3517f-d0d3-4322-9958-485d42664164 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:14.147317 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5ea3517f-d0d3-4322-9958-485d42664164 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:14.172386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5ea3517f-d0d3-4322-9958-485d42664164 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1210 microversion: 2.1 time: 0.295119 Jul 21 21:59:14.179154 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 40/61] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:13 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1210 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:14.351942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dc4553e0-2a6d-4872-98e5-5df3b9df5ff4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:14.353204 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dc4553e0-2a6d-4872-98e5-5df3b9df5ff4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:14.363847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc4553e0-2a6d-4872-98e5-5df3b9df5ff4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:14.367561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc4553e0-2a6d-4872-98e5-5df3b9df5ff4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:14.369052 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc4553e0-2a6d-4872-98e5-5df3b9df5ff4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:14.369735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc4553e0-2a6d-4872-98e5-5df3b9df5ff4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:14.534748 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-947487654", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0ec8e99-05f4-42b9-a66c-01f8a5517d33"}], "security_groups": [{"name": "tempest-securitygroup--198858535"}], "key_name": "tempest-keypair-2073268854", "user_data": "}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:14.832295 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dc4553e0-2a6d-4872-98e5-5df3b9df5ff4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:14.849033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dc4553e0-2a6d-4872-98e5-5df3b9df5ff4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 0.499594 Jul 21 21:59:14.854692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 22/62] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:14 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:15.050232 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] validate_networks() for [('b0ec8e99-05f4-42b9-a66c-01f8a5517d33', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:59:15.201226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-efe5a154-4fd8-4acb-900d-3ef47023a699 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:15.201863 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-efe5a154-4fd8-4acb-900d-3ef47023a699 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:15.219869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-efe5a154-4fd8-4acb-900d-3ef47023a699 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:15.222033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-efe5a154-4fd8-4acb-900d-3ef47023a699 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:15.228499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-efe5a154-4fd8-4acb-900d-3ef47023a699 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:15.229373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-efe5a154-4fd8-4acb-900d-3ef47023a699 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:15.592352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-efe5a154-4fd8-4acb-900d-3ef47023a699 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:15.605367 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-efe5a154-4fd8-4acb-900d-3ef47023a699 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1266 microversion: 2.1 time: 0.412338 Jul 21 21:59:15.610205 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 23/63] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:15 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1266 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:15.871154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2688ed29-3817-4cb4-9aa3-0c0c9aaa6e3d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:15.871928 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2688ed29-3817-4cb4-9aa3-0c0c9aaa6e3d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:15.882833 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2688ed29-3817-4cb4-9aa3-0c0c9aaa6e3d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:15.885777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2688ed29-3817-4cb4-9aa3-0c0c9aaa6e3d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:15.888708 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2688ed29-3817-4cb4-9aa3-0c0c9aaa6e3d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:15.889342 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2688ed29-3817-4cb4-9aa3-0c0c9aaa6e3d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:16.867768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2688ed29-3817-4cb4-9aa3-0c0c9aaa6e3d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:16.879215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2688ed29-3817-4cb4-9aa3-0c0c9aaa6e3d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 1.011047 Jul 21 21:59:16.879822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 24/64] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:15 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:16.899596 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dc365c6f-b251-49e5-85af-d8d92459c5b4 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:16.900153 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dc365c6f-b251-49e5-85af-d8d92459c5b4 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:16.927148 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc365c6f-b251-49e5-85af-d8d92459c5b4 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:16.928221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc365c6f-b251-49e5-85af-d8d92459c5b4 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:16.929187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc365c6f-b251-49e5-85af-d8d92459c5b4 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:16.930197 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc365c6f-b251-49e5-85af-d8d92459c5b4 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:17.045341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dc365c6f-b251-49e5-85af-d8d92459c5b4 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:17.058738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dc365c6f-b251-49e5-85af-d8d92459c5b4 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1266 microversion: 2.1 time: 0.174098 Jul 21 21:59:17.060311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 25/65] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:16 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:17.070653 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1540201759", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc67d31e-e173-4f41-bc3f-7c414a4954bb"}], "security_groups": [{"name": "tempest-securitygroup--278308189"}], "key_name": "tempest-keypair-1782920728", "user_data": "}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:17.557696 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.network.neutron [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] validate_networks() for [('cc67d31e-e173-4f41-bc3f-7c414a4954bb', None, None, None, None, None)] {{(pid=117979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:59:18.089530 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:59:18.090097 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:59:18.090705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:59:18.091220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:59:18.091760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:59:18.110564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:18.112377 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:18.116471 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:18.118154 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:18.224836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Getting quotas for project 36a85f96959d48c5810ea0d38f65f22c. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:59:18.247762 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Getting quotas for user 1c86ce2899b6485da1517e3b5a1c64de and project 36a85f96959d48c5810ea0d38f65f22c. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:59:18.294012 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:59:18.307729 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:59:18.522995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d4ab7a0a-e544-45b9-91bb-2e0571916824 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.995345 Jul 21 21:59:18.523912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 41/66] 10.222.0.44 () {62 vars in 1187 bytes} [Thu Jul 21 21:59:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 3998 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 21 21:59:18.536525 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2072895160", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31aaafc3-d737-47df-987b-f83f4d3a2678"}], "security_groups": [{"name": "tempest-securitygroup--827155627"}], "key_name": "tempest-keypair-1283027389", "user_data": "}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:18.695568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Flavor limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:59:18.696044 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Image limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:59:18.696447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Flavor pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:59:18.697118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Image pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:59:18.697715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:59:18.722652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:18.725534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:18.726701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:18.728305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:18.793904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Getting quotas for project 64e8fc83edda464e8ec9f7c2ee9c142c. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:59:18.816550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Getting quotas for user 9f6537f0b9d44ba58cb5a5552f2c5b4e and project 64e8fc83edda464e8ec9f7c2ee9c142c. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:59:18.859913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Going to run 1 instances... {{(pid=117979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:59:18.860086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] validate_networks() for [('31aaafc3-d737-47df-987b-f83f4d3a2678', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 21:59:18.865899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:59:19.070586 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ae9c1f02-c8e3-4754-be3f-495422fa02bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.008978 Jul 21 21:59:19.076753 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 26/67] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 21:59:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 2016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 21:59:19.082567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f8cb2241-353a-4a37-aa80-a438619b0251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:19.086618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f8cb2241-353a-4a37-aa80-a438619b0251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:19.102322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f8cb2241-353a-4a37-aa80-a438619b0251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:19.117956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f8cb2241-353a-4a37-aa80-a438619b0251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:19.118906 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f8cb2241-353a-4a37-aa80-a438619b0251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:19.119400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f8cb2241-353a-4a37-aa80-a438619b0251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:19.676774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f8cb2241-353a-4a37-aa80-a438619b0251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:19.688748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f8cb2241-353a-4a37-aa80-a438619b0251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 0.609228 Jul 21 21:59:19.691424 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 27/68] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:19 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:19.705690 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9e5bf13b-e5fc-4ff3-a2c1-4e5e6a5edde0 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:19.706931 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9e5bf13b-e5fc-4ff3-a2c1-4e5e6a5edde0 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:19.726469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e5bf13b-e5fc-4ff3-a2c1-4e5e6a5edde0 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:19.727601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e5bf13b-e5fc-4ff3-a2c1-4e5e6a5edde0 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:19.730775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e5bf13b-e5fc-4ff3-a2c1-4e5e6a5edde0 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:19.731860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e5bf13b-e5fc-4ff3-a2c1-4e5e6a5edde0 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:20.077902 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 21:59:20.078360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 21:59:20.078836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 21:59:20.079235 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 21:59:20.079933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 21:59:20.105848 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=27 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:20.120890 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:20.121942 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:20.123234 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:20.123834 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:20.148604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9e5bf13b-e5fc-4ff3-a2c1-4e5e6a5edde0 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:20.156055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9e5bf13b-e5fc-4ff3-a2c1-4e5e6a5edde0 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.462546 Jul 21 21:59:20.172933 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 28/69] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:19 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:20.178405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=39 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:20.181189 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7f6b3eed-84e4-4fff-b481-8133cd49aeda tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:20.185993 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7f6b3eed-84e4-4fff-b481-8133cd49aeda tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:20.204457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f6b3eed-84e4-4fff-b481-8133cd49aeda tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:20.204457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f6b3eed-84e4-4fff-b481-8133cd49aeda tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:20.204457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f6b3eed-84e4-4fff-b481-8133cd49aeda tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:20.204457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f6b3eed-84e4-4fff-b481-8133cd49aeda tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:20.212921 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 21:59:20.221598 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for user 73f068abea75404fb2829065a674aee4 and project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 21:59:20.244514 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 21:59:20.248261 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 21:59:20.334745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-40fc62d5-dc58-47bd-b51d-46e0a13ed164 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.808511 Jul 21 21:59:20.343141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 42/70] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 21:59:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 21:59:20.361841 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-32b6a8d0-52da-4ae0-939e-eeef262895f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:20.362655 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-32b6a8d0-52da-4ae0-939e-eeef262895f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:20.380434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32b6a8d0-52da-4ae0-939e-eeef262895f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:20.383169 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32b6a8d0-52da-4ae0-939e-eeef262895f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:20.384161 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32b6a8d0-52da-4ae0-939e-eeef262895f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:20.386239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32b6a8d0-52da-4ae0-939e-eeef262895f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:20.578424 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7f6b3eed-84e4-4fff-b481-8133cd49aeda tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:20.610125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7f6b3eed-84e4-4fff-b481-8133cd49aeda tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:20.614848 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7f6b3eed-84e4-4fff-b481-8133cd49aeda tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:20.618401 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7f6b3eed-84e4-4fff-b481-8133cd49aeda tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1285 microversion: 2.20 time: 0.443487 Jul 21 21:59:20.620443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 29/71] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:20 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1285 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:20.628489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-50ddd024-a3b2-45a2-8be0-38311c02d95a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:20.631619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-50ddd024-a3b2-45a2-8be0-38311c02d95a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:20.732931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-32b6a8d0-52da-4ae0-939e-eeef262895f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:20.743302 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-32b6a8d0-52da-4ae0-939e-eeef262895f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1234 microversion: 2.1 time: 0.398366 Jul 21 21:59:20.768704 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 43/72] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:20 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1234 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:20.774727 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-390f1d16-2154-47d0-ab25-9731400a5fd7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:20.777481 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-390f1d16-2154-47d0-ab25-9731400a5fd7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:20.793810 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-390f1d16-2154-47d0-ab25-9731400a5fd7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:20.794658 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-390f1d16-2154-47d0-ab25-9731400a5fd7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:20.795843 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-390f1d16-2154-47d0-ab25-9731400a5fd7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:20.796531 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-390f1d16-2154-47d0-ab25-9731400a5fd7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:20.855046 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-50ddd024-a3b2-45a2-8be0-38311c02d95a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:20.880026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-50ddd024-a3b2-45a2-8be0-38311c02d95a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1242 microversion: 2.1 time: 0.257952 Jul 21 21:59:20.881318 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 30/73] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:20 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1242 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:21.154707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-390f1d16-2154-47d0-ab25-9731400a5fd7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:21.169808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-390f1d16-2154-47d0-ab25-9731400a5fd7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 0.393332 Jul 21 21:59:21.169808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 44/74] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:20 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:21.177259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f70477d8-c38c-4b4e-8fda-4a72fdc4e69b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:21.178061 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f70477d8-c38c-4b4e-8fda-4a72fdc4e69b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:21.194357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f70477d8-c38c-4b4e-8fda-4a72fdc4e69b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:21.196385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f70477d8-c38c-4b4e-8fda-4a72fdc4e69b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:21.200820 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f70477d8-c38c-4b4e-8fda-4a72fdc4e69b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:21.203575 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f70477d8-c38c-4b4e-8fda-4a72fdc4e69b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:21.637864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-527e1f32-4fc3-413c-9c3f-0e26e11dc591 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:21.638737 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-527e1f32-4fc3-413c-9c3f-0e26e11dc591 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:21.648686 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-527e1f32-4fc3-413c-9c3f-0e26e11dc591 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:21.649229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-527e1f32-4fc3-413c-9c3f-0e26e11dc591 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:21.650251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-527e1f32-4fc3-413c-9c3f-0e26e11dc591 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:21.651859 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-527e1f32-4fc3-413c-9c3f-0e26e11dc591 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:22.050898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-527e1f32-4fc3-413c-9c3f-0e26e11dc591 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:22.065934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-527e1f32-4fc3-413c-9c3f-0e26e11dc591 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:22.082574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-527e1f32-4fc3-413c-9c3f-0e26e11dc591 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:22.090646 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-527e1f32-4fc3-413c-9c3f-0e26e11dc591 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1341 microversion: 2.20 time: 0.456655 Jul 21 21:59:22.101085 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 45/75] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:21 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1341 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:22.117369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-773c870b-89f9-41a7-be29-1718a7e18a20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:22.122315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-773c870b-89f9-41a7-be29-1718a7e18a20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:22.144214 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-773c870b-89f9-41a7-be29-1718a7e18a20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:22.149561 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-773c870b-89f9-41a7-be29-1718a7e18a20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:22.155449 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-773c870b-89f9-41a7-be29-1718a7e18a20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:22.156061 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-773c870b-89f9-41a7-be29-1718a7e18a20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:22.350412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f70477d8-c38c-4b4e-8fda-4a72fdc4e69b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:22.361040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f70477d8-c38c-4b4e-8fda-4a72fdc4e69b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 1.187562 Jul 21 21:59:22.362234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 31/76] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:21 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:22.368033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f6135627-9125-45a8-a799-0cf9750f76e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:22.368980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f6135627-9125-45a8-a799-0cf9750f76e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:22.376446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f6135627-9125-45a8-a799-0cf9750f76e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:22.377103 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f6135627-9125-45a8-a799-0cf9750f76e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:22.378123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f6135627-9125-45a8-a799-0cf9750f76e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:22.378885 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f6135627-9125-45a8-a799-0cf9750f76e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:22.446565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-773c870b-89f9-41a7-be29-1718a7e18a20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:22.461789 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-773c870b-89f9-41a7-be29-1718a7e18a20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1296 microversion: 2.1 time: 0.359323 Jul 21 21:59:22.468177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 46/77] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:22 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1296 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:22.477779 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-c22b1881-c3aa-45a5-b350-76bff4c5d9c9 req-7b63edb3-a35f-410b-b35e-6ae4296f1553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2483e851-683c-4f95-9d9f-ade500d0ed0b", "tag": "cb3c7a1b-b5c2-4104-abc2-9f28d71afdfb"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:22.493214 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-c22b1881-c3aa-45a5-b350-76bff4c5d9c9 req-7b63edb3-a35f-410b-b35e-6ae4296f1553 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:22.493983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-c22b1881-c3aa-45a5-b350-76bff4c5d9c9 req-7b63edb3-a35f-410b-b35e-6ae4296f1553 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:22.511036 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-c22b1881-c3aa-45a5-b350-76bff4c5d9c9 req-7b63edb3-a35f-410b-b35e-6ae4296f1553 service nova] Creating event network-changed:cb3c7a1b-b5c2-4104-abc2-9f28d71afdfb for instance 2483e851-683c-4f95-9d9f-ade500d0ed0b on hv-cinder-82002 Jul 21 21:59:22.525015 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-c22b1881-c3aa-45a5-b350-76bff4c5d9c9 req-7b63edb3-a35f-410b-b35e-6ae4296f1553 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055256 Jul 21 21:59:22.525955 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 47/78] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:22.533167 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-02d6c5bd-f40d-43c7-9e49-11be279cead3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:22.541410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-02d6c5bd-f40d-43c7-9e49-11be279cead3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:22.559803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02d6c5bd-f40d-43c7-9e49-11be279cead3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:22.560311 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02d6c5bd-f40d-43c7-9e49-11be279cead3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:22.561146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02d6c5bd-f40d-43c7-9e49-11be279cead3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:22.564759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02d6c5bd-f40d-43c7-9e49-11be279cead3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:22.853564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f6135627-9125-45a8-a799-0cf9750f76e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:22.873517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f6135627-9125-45a8-a799-0cf9750f76e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1238 microversion: 2.1 time: 0.507974 Jul 21 21:59:22.877959 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 32/79] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:22 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1238 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:23.026385 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-02d6c5bd-f40d-43c7-9e49-11be279cead3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:23.050460 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-02d6c5bd-f40d-43c7-9e49-11be279cead3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 0.520883 Jul 21 21:59:23.060473 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 48/80] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:22 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:23.113106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-13fd18be-070e-46f9-9afb-1f9897ac70f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:23.113722 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-13fd18be-070e-46f9-9afb-1f9897ac70f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:23.130883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-13fd18be-070e-46f9-9afb-1f9897ac70f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:23.131717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-13fd18be-070e-46f9-9afb-1f9897ac70f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:23.132907 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-13fd18be-070e-46f9-9afb-1f9897ac70f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:23.133587 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-13fd18be-070e-46f9-9afb-1f9897ac70f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:23.379389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1b03a26d-04d1-4816-90c7-7d5c12ff3d09 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:23.379960 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-13fd18be-070e-46f9-9afb-1f9897ac70f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:23.381008 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1b03a26d-04d1-4816-90c7-7d5c12ff3d09 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:23.393056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-13fd18be-070e-46f9-9afb-1f9897ac70f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:23.394743 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-13fd18be-070e-46f9-9afb-1f9897ac70f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:23.396018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-13fd18be-070e-46f9-9afb-1f9897ac70f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1339 microversion: 2.20 time: 0.288022 Jul 21 21:59:23.410326 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b03a26d-04d1-4816-90c7-7d5c12ff3d09 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:23.416603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 33/81] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:23 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1339 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:23.426201 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b03a26d-04d1-4816-90c7-7d5c12ff3d09 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:23.427256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b03a26d-04d1-4816-90c7-7d5c12ff3d09 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:23.427727 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b03a26d-04d1-4816-90c7-7d5c12ff3d09 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:23.487555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e794a5b3-56f2-4ae8-9273-c49c681a7740 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:23.488419 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e794a5b3-56f2-4ae8-9273-c49c681a7740 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:23.497540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e794a5b3-56f2-4ae8-9273-c49c681a7740 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:23.499347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e794a5b3-56f2-4ae8-9273-c49c681a7740 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:23.502243 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e794a5b3-56f2-4ae8-9273-c49c681a7740 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:23.503543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e794a5b3-56f2-4ae8-9273-c49c681a7740 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:23.679988 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e794a5b3-56f2-4ae8-9273-c49c681a7740 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:23.700501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e794a5b3-56f2-4ae8-9273-c49c681a7740 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1296 microversion: 2.1 time: 0.218900 Jul 21 21:59:23.711723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 34/82] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:23 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1296 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:23.816914 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1b03a26d-04d1-4816-90c7-7d5c12ff3d09 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:23.833719 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1b03a26d-04d1-4816-90c7-7d5c12ff3d09 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.459032 Jul 21 21:59:23.836982 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 49/83] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:23 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:23.906724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-13814d02-01ca-42f9-a955-5dd7e1b14405 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:23.913270 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-13814d02-01ca-42f9-a955-5dd7e1b14405 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:23.933173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-13814d02-01ca-42f9-a955-5dd7e1b14405 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:23.933650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-13814d02-01ca-42f9-a955-5dd7e1b14405 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:23.938258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-13814d02-01ca-42f9-a955-5dd7e1b14405 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:23.938728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-13814d02-01ca-42f9-a955-5dd7e1b14405 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:24.030483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-13814d02-01ca-42f9-a955-5dd7e1b14405 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:24.040864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-13814d02-01ca-42f9-a955-5dd7e1b14405 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1300 microversion: 2.1 time: 0.149553 Jul 21 21:59:24.041937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 35/84] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:23 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1300 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:24.069601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b0f0ab78-1f44-4145-89f1-8d71782f66e7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:24.070529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b0f0ab78-1f44-4145-89f1-8d71782f66e7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:24.077265 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0f0ab78-1f44-4145-89f1-8d71782f66e7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:24.078147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0f0ab78-1f44-4145-89f1-8d71782f66e7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:24.079366 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0f0ab78-1f44-4145-89f1-8d71782f66e7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:24.080448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0f0ab78-1f44-4145-89f1-8d71782f66e7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:24.307320 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b0f0ab78-1f44-4145-89f1-8d71782f66e7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:24.334321 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b0f0ab78-1f44-4145-89f1-8d71782f66e7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 0.268887 Jul 21 21:59:24.336216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 50/85] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:24 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:24.417903 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9e8f4e71-6d99-4f9c-acbc-1929747e4bfa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:24.419505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9e8f4e71-6d99-4f9c-acbc-1929747e4bfa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:24.442604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e8f4e71-6d99-4f9c-acbc-1929747e4bfa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:24.445557 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e8f4e71-6d99-4f9c-acbc-1929747e4bfa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:24.449292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e8f4e71-6d99-4f9c-acbc-1929747e4bfa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:24.449775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e8f4e71-6d99-4f9c-acbc-1929747e4bfa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:24.780933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-e20ef0f4-4dcc-4a12-a759-78db6e43b229 req-97727dc6-9487-4f12-838a-472f91b86aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "996ecad7-3e17-4fda-ba01-cc79e9573422", "name": "network-vif-plugged", "status": "completed", "tag": "04c59949-5420-433b-87b4-a24c499eb2ef"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:24.797627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-e20ef0f4-4dcc-4a12-a759-78db6e43b229 req-97727dc6-9487-4f12-838a-472f91b86aa8 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:24.801243 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-e20ef0f4-4dcc-4a12-a759-78db6e43b229 req-97727dc6-9487-4f12-838a-472f91b86aa8 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:24.843380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-e20ef0f4-4dcc-4a12-a759-78db6e43b229 req-97727dc6-9487-4f12-838a-472f91b86aa8 service nova] Creating event network-vif-plugged:04c59949-5420-433b-87b4-a24c499eb2ef for instance 996ecad7-3e17-4fda-ba01-cc79e9573422 on hv-cinder-82002 Jul 21 21:59:24.854310 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-e20ef0f4-4dcc-4a12-a759-78db6e43b229 req-97727dc6-9487-4f12-838a-472f91b86aa8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276185 Jul 21 21:59:24.857681 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 51/86] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:24.869773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-802a69aa-c9ea-4797-be75-53f98aba8371 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:24.870811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-802a69aa-c9ea-4797-be75-53f98aba8371 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:24.892372 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-802a69aa-c9ea-4797-be75-53f98aba8371 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:24.893916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-802a69aa-c9ea-4797-be75-53f98aba8371 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:24.895315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-802a69aa-c9ea-4797-be75-53f98aba8371 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:24.896111 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-802a69aa-c9ea-4797-be75-53f98aba8371 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:25.124705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9e8f4e71-6d99-4f9c-acbc-1929747e4bfa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:25.138831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9e8f4e71-6d99-4f9c-acbc-1929747e4bfa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:25.143515 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9e8f4e71-6d99-4f9c-acbc-1929747e4bfa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:25.147883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9e8f4e71-6d99-4f9c-acbc-1929747e4bfa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.731784 Jul 21 21:59:25.150180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 36/87] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:24 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:25.175319 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-06a3482a-d16b-4c42-a8f2-764aed43b5f2 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:25.180973 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-06a3482a-d16b-4c42-a8f2-764aed43b5f2 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:25.217647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-06a3482a-d16b-4c42-a8f2-764aed43b5f2 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:25.222458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-06a3482a-d16b-4c42-a8f2-764aed43b5f2 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:25.226437 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-06a3482a-d16b-4c42-a8f2-764aed43b5f2 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:25.230982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-06a3482a-d16b-4c42-a8f2-764aed43b5f2 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:25.679747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-802a69aa-c9ea-4797-be75-53f98aba8371 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:25.706729 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-802a69aa-c9ea-4797-be75-53f98aba8371 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.840011 Jul 21 21:59:25.715526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 52/88] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:24 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:25.728984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-47ff1b73-8926-429c-8fbe-da8906c657e1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:25.731362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-47ff1b73-8926-429c-8fbe-da8906c657e1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:25.741684 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47ff1b73-8926-429c-8fbe-da8906c657e1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:25.743437 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47ff1b73-8926-429c-8fbe-da8906c657e1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:25.748460 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47ff1b73-8926-429c-8fbe-da8906c657e1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:25.751730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47ff1b73-8926-429c-8fbe-da8906c657e1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:25.798440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-06a3482a-d16b-4c42-a8f2-764aed43b5f2 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:25.813459 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-06a3482a-d16b-4c42-a8f2-764aed43b5f2 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.658638 Jul 21 21:59:25.815287 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 37/89] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:25 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:25.823940 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e0899241-8de6-4439-9e9f-07b29dd5c6b2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:25.825330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e0899241-8de6-4439-9e9f-07b29dd5c6b2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:25.840020 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0899241-8de6-4439-9e9f-07b29dd5c6b2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:25.840730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0899241-8de6-4439-9e9f-07b29dd5c6b2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:25.841716 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0899241-8de6-4439-9e9f-07b29dd5c6b2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:25.842306 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0899241-8de6-4439-9e9f-07b29dd5c6b2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:25.883802 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-47ff1b73-8926-429c-8fbe-da8906c657e1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:25.903392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-47ff1b73-8926-429c-8fbe-da8906c657e1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1300 microversion: 2.1 time: 0.181442 Jul 21 21:59:25.907592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 53/90] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:25 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:26.175750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-eb80e883-3b62-4add-b114-78952faf0ce4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:26.176485 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-eb80e883-3b62-4add-b114-78952faf0ce4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:26.189770 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eb80e883-3b62-4add-b114-78952faf0ce4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:26.193029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eb80e883-3b62-4add-b114-78952faf0ce4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:26.194055 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eb80e883-3b62-4add-b114-78952faf0ce4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:26.194514 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eb80e883-3b62-4add-b114-78952faf0ce4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:26.317584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e0899241-8de6-4439-9e9f-07b29dd5c6b2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:26.322662 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:26.337791 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e0899241-8de6-4439-9e9f-07b29dd5c6b2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 0.519250 Jul 21 21:59:26.348189 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 38/91] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:25 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:26.599215 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-eb80e883-3b62-4add-b114-78952faf0ce4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:26.611733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-eb80e883-3b62-4add-b114-78952faf0ce4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:26.614275 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-eb80e883-3b62-4add-b114-78952faf0ce4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:26.617378 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-eb80e883-3b62-4add-b114-78952faf0ce4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.451400 Jul 21 21:59:26.620890 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 54/92] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:26 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:26.743743 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-097a1809-db13-472c-aa99-2983dced51d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:26.744370 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-097a1809-db13-472c-aa99-2983dced51d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:26.751993 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-097a1809-db13-472c-aa99-2983dced51d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:26.752593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-097a1809-db13-472c-aa99-2983dced51d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:26.753387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-097a1809-db13-472c-aa99-2983dced51d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:26.753842 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-097a1809-db13-472c-aa99-2983dced51d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:26.804871 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-d84331c0-8562-4364-9c62-5f46763fbf5c req-9e8a5316-8a84-43ca-92e1-0b1c92492fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f", "tag": "ee06169e-43fc-48f5-a5bb-ad6632cb1500"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:26.841564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d84331c0-8562-4364-9c62-5f46763fbf5c req-9e8a5316-8a84-43ca-92e1-0b1c92492fc0 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:26.847314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d84331c0-8562-4364-9c62-5f46763fbf5c req-9e8a5316-8a84-43ca-92e1-0b1c92492fc0 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:26.885676 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-d84331c0-8562-4364-9c62-5f46763fbf5c req-9e8a5316-8a84-43ca-92e1-0b1c92492fc0 service nova] Creating event network-changed:ee06169e-43fc-48f5-a5bb-ad6632cb1500 for instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f on hv-cinder-82002 Jul 21 21:59:26.894829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-d84331c0-8562-4364-9c62-5f46763fbf5c req-9e8a5316-8a84-43ca-92e1-0b1c92492fc0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097618 Jul 21 21:59:26.896648 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 55/93] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:59:26.903173 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7c42dd28-dff2-45df-84c5-da5869a3fc8d tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:26.904814 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7c42dd28-dff2-45df-84c5-da5869a3fc8d tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:26.914355 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c42dd28-dff2-45df-84c5-da5869a3fc8d tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:26.915427 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c42dd28-dff2-45df-84c5-da5869a3fc8d tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:26.916709 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c42dd28-dff2-45df-84c5-da5869a3fc8d tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:26.917513 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c42dd28-dff2-45df-84c5-da5869a3fc8d tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:27.616981 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7c42dd28-dff2-45df-84c5-da5869a3fc8d tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:27.637120 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-097a1809-db13-472c-aa99-2983dced51d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:27.642631 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7c42dd28-dff2-45df-84c5-da5869a3fc8d tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.742544 Jul 21 21:59:27.644730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 56/94] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:26 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:27.646033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-097a1809-db13-472c-aa99-2983dced51d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.917566 Jul 21 21:59:27.652274 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 39/95] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:26 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:27.657490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ea10e716-773c-41a7-a9d6-7cfcb56d69e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:27.659726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ea10e716-773c-41a7-a9d6-7cfcb56d69e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:27.674218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-6dcb8ef3-54df-424c-aba6-01edf6e6cc7c req-d5e6d98e-b90b-4ea0-bfd5-ec260c6c573f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed6c5da-065f-40bc-9f21-154eda67c27a", "name": "network-vif-plugged", "status": "completed", "tag": "b79b076d-b273-4ae6-94d4-f7a4aad57e4f"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:27.675506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea10e716-773c-41a7-a9d6-7cfcb56d69e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:27.676035 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea10e716-773c-41a7-a9d6-7cfcb56d69e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:27.676920 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea10e716-773c-41a7-a9d6-7cfcb56d69e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:27.678619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea10e716-773c-41a7-a9d6-7cfcb56d69e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:27.694821 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-6dcb8ef3-54df-424c-aba6-01edf6e6cc7c req-d5e6d98e-b90b-4ea0-bfd5-ec260c6c573f service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:27.695590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-6dcb8ef3-54df-424c-aba6-01edf6e6cc7c req-d5e6d98e-b90b-4ea0-bfd5-ec260c6c573f service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:27.713236 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-6dcb8ef3-54df-424c-aba6-01edf6e6cc7c req-d5e6d98e-b90b-4ea0-bfd5-ec260c6c573f service nova] Creating event network-vif-plugged:b79b076d-b273-4ae6-94d4-f7a4aad57e4f for instance bed6c5da-065f-40bc-9f21-154eda67c27a on hv-cinder-82002 Jul 21 21:59:27.719113 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-6dcb8ef3-54df-424c-aba6-01edf6e6cc7c req-d5e6d98e-b90b-4ea0-bfd5-ec260c6c573f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072732 Jul 21 21:59:27.720778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 57/96] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:27.727990 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-56108cee-c27f-4064-9005-41d2d5733f5d req-003f2a2a-53f1-450d-89d4-b4a122ebaaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e2efbe-11d4-4ecc-8825-11f420d36f03", "tag": "978d1e0a-28ef-408b-a540-0a23b3da9c0b"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:27.738300 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-56108cee-c27f-4064-9005-41d2d5733f5d req-003f2a2a-53f1-450d-89d4-b4a122ebaaf8 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:27.739027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-56108cee-c27f-4064-9005-41d2d5733f5d req-003f2a2a-53f1-450d-89d4-b4a122ebaaf8 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:27.751970 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-56108cee-c27f-4064-9005-41d2d5733f5d req-003f2a2a-53f1-450d-89d4-b4a122ebaaf8 service nova] Creating event network-changed:978d1e0a-28ef-408b-a540-0a23b3da9c0b for instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 on hv-cinder-82002 Jul 21 21:59:27.770576 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-56108cee-c27f-4064-9005-41d2d5733f5d req-003f2a2a-53f1-450d-89d4-b4a122ebaaf8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048107 Jul 21 21:59:27.789261 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 58/97] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:27.796834 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-21ab460c-ecc6-43ed-b50d-c48f44d8e808 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:27.799061 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-21ab460c-ecc6-43ed-b50d-c48f44d8e808 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:27.823947 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-21ab460c-ecc6-43ed-b50d-c48f44d8e808 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:27.825462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-21ab460c-ecc6-43ed-b50d-c48f44d8e808 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:27.828696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-21ab460c-ecc6-43ed-b50d-c48f44d8e808 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:27.829442 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-21ab460c-ecc6-43ed-b50d-c48f44d8e808 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:28.458189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-21ab460c-ecc6-43ed-b50d-c48f44d8e808 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:28.474422 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-21ab460c-ecc6-43ed-b50d-c48f44d8e808 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 0.683617 Jul 21 21:59:28.476285 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 59/98] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:27 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:28.482165 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2f4b0420-333d-46d6-bfe9-6cfb06e9d34f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:28.483353 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2f4b0420-333d-46d6-bfe9-6cfb06e9d34f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:28.492664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2f4b0420-333d-46d6-bfe9-6cfb06e9d34f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:28.494270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2f4b0420-333d-46d6-bfe9-6cfb06e9d34f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:28.495379 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2f4b0420-333d-46d6-bfe9-6cfb06e9d34f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:28.496998 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2f4b0420-333d-46d6-bfe9-6cfb06e9d34f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:28.535325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ea10e716-773c-41a7-a9d6-7cfcb56d69e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:28.546823 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ea10e716-773c-41a7-a9d6-7cfcb56d69e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.893088 Jul 21 21:59:28.559534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 40/99] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:27 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:28.663420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6e6f49a8-2499-4fac-af2b-589df9ecab02 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:28.663420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6e6f49a8-2499-4fac-af2b-589df9ecab02 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:28.679314 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e6f49a8-2499-4fac-af2b-589df9ecab02 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:28.680003 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e6f49a8-2499-4fac-af2b-589df9ecab02 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:28.681008 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e6f49a8-2499-4fac-af2b-589df9ecab02 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:28.681910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e6f49a8-2499-4fac-af2b-589df9ecab02 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:28.764533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=4 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:28.910563 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2f4b0420-333d-46d6-bfe9-6cfb06e9d34f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:28.928292 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2f4b0420-333d-46d6-bfe9-6cfb06e9d34f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:28.929874 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2f4b0420-333d-46d6-bfe9-6cfb06e9d34f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:28.931070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2f4b0420-333d-46d6-bfe9-6cfb06e9d34f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.453528 Jul 21 21:59:28.931623 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 60/100] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:28 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:28.946102 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6e96e15c-6a6a-41c5-bfa8-8b52f3e01625 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:28.947221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6e96e15c-6a6a-41c5-bfa8-8b52f3e01625 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:28.963057 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e96e15c-6a6a-41c5-bfa8-8b52f3e01625 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:28.963747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e96e15c-6a6a-41c5-bfa8-8b52f3e01625 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:28.964695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e96e15c-6a6a-41c5-bfa8-8b52f3e01625 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:28.965164 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e96e15c-6a6a-41c5-bfa8-8b52f3e01625 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:29.072407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6e6f49a8-2499-4fac-af2b-589df9ecab02 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:29.104978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6e6f49a8-2499-4fac-af2b-589df9ecab02 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.444578 Jul 21 21:59:29.106080 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 41/101] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:28 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:29.280965 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6e96e15c-6a6a-41c5-bfa8-8b52f3e01625 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:29.299707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6e96e15c-6a6a-41c5-bfa8-8b52f3e01625 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.366626 Jul 21 21:59:29.301796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 61/102] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:28 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:29.492257 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e6b5f4ab-65bd-44b3-8cdf-243f1d56f46b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:29.492991 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e6b5f4ab-65bd-44b3-8cdf-243f1d56f46b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:29.504360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e6b5f4ab-65bd-44b3-8cdf-243f1d56f46b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:29.504913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e6b5f4ab-65bd-44b3-8cdf-243f1d56f46b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:29.506033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e6b5f4ab-65bd-44b3-8cdf-243f1d56f46b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:29.507130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e6b5f4ab-65bd-44b3-8cdf-243f1d56f46b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:29.569501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cbd177d2-657f-4aee-bc0e-36ccebfc7b39 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:29.570773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cbd177d2-657f-4aee-bc0e-36ccebfc7b39 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:29.583095 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cbd177d2-657f-4aee-bc0e-36ccebfc7b39 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:29.584008 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cbd177d2-657f-4aee-bc0e-36ccebfc7b39 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:29.587690 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cbd177d2-657f-4aee-bc0e-36ccebfc7b39 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:29.589135 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cbd177d2-657f-4aee-bc0e-36ccebfc7b39 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:29.886410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cbd177d2-657f-4aee-bc0e-36ccebfc7b39 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:29.889864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e6b5f4ab-65bd-44b3-8cdf-243f1d56f46b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:29.894188 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:29.902307 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e6b5f4ab-65bd-44b3-8cdf-243f1d56f46b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 0.414218 Jul 21 21:59:29.903732 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 42/103] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:29 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:29.908716 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cbd177d2-657f-4aee-bc0e-36ccebfc7b39 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.343070 Jul 21 21:59:29.909632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 62/104] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:29 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:29.913489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-0c74fd00-f7f5-415d-9e15-e83819d580e4 req-73ab761c-ab28-4fc3-824f-f3a4d5b26d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7365f289-299d-4d2d-ba74-1ca18cf88e06", "tag": "eed67bc7-6a60-4e49-80a2-4868db4a2cb0"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:29.930770 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-0c74fd00-f7f5-415d-9e15-e83819d580e4 req-73ab761c-ab28-4fc3-824f-f3a4d5b26d75 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:29.931440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-0c74fd00-f7f5-415d-9e15-e83819d580e4 req-73ab761c-ab28-4fc3-824f-f3a4d5b26d75 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:29.948065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dc0e03d1-8951-4404-a397-8bafcb349ee4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:29.948698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dc0e03d1-8951-4404-a397-8bafcb349ee4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:29.956314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dc0e03d1-8951-4404-a397-8bafcb349ee4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:29.959921 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dc0e03d1-8951-4404-a397-8bafcb349ee4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:29.960785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dc0e03d1-8951-4404-a397-8bafcb349ee4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:29.963210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dc0e03d1-8951-4404-a397-8bafcb349ee4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:29.971200 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-0c74fd00-f7f5-415d-9e15-e83819d580e4 req-73ab761c-ab28-4fc3-824f-f3a4d5b26d75 service nova] Creating event network-changed:eed67bc7-6a60-4e49-80a2-4868db4a2cb0 for instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 on hv-cinder-82002 Jul 21 21:59:29.972029 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-0c74fd00-f7f5-415d-9e15-e83819d580e4 req-73ab761c-ab28-4fc3-824f-f3a4d5b26d75 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117979) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 21 21:59:29.974886 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-12b8cf16-06f8-48c3-a810-61ff8003173e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:29.975677 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-12b8cf16-06f8-48c3-a810-61ff8003173e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:29.978039 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-12b8cf16-06f8-48c3-a810-61ff8003173e None None] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:29.979052 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-12b8cf16-06f8-48c3-a810-61ff8003173e None None] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:29.995095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.compute.rpcapi [None req-12b8cf16-06f8-48c3-a810-61ff8003173e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 21 21:59:29.998208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-12b8cf16-06f8-48c3-a810-61ff8003173e None None] Releasing lock "compute-rpcapi-router" {{(pid=117979) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 21 21:59:30.021123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-12b8cf16-06f8-48c3-a810-61ff8003173e None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115673 Jul 21 21:59:30.022385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 43/105] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:30.122858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e1b52bf5-e772-409a-9775-1ff3c76dbe99 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:30.123761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e1b52bf5-e772-409a-9775-1ff3c76dbe99 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:30.136491 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1b52bf5-e772-409a-9775-1ff3c76dbe99 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:30.137353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1b52bf5-e772-409a-9775-1ff3c76dbe99 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:30.139438 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1b52bf5-e772-409a-9775-1ff3c76dbe99 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:30.141224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1b52bf5-e772-409a-9775-1ff3c76dbe99 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:30.177585 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dc0e03d1-8951-4404-a397-8bafcb349ee4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:30.180524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:30.202415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dc0e03d1-8951-4404-a397-8bafcb349ee4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:30.204773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dc0e03d1-8951-4404-a397-8bafcb349ee4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:30.206781 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dc0e03d1-8951-4404-a397-8bafcb349ee4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.262176 Jul 21 21:59:30.220451 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 63/106] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:29 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:30.228242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-30a092cc-cb62-4cb1-a162-d4fb5172cc9c req-3f45efd0-490d-46ee-b814-1f22edbec4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2483e851-683c-4f95-9d9f-ade500d0ed0b", "name": "network-vif-plugged", "status": "completed", "tag": "cb3c7a1b-b5c2-4104-abc2-9f28d71afdfb"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:30.240753 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:30.245143 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=5 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:30.248590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-30a092cc-cb62-4cb1-a162-d4fb5172cc9c req-3f45efd0-490d-46ee-b814-1f22edbec4c9 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:30.249578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-30a092cc-cb62-4cb1-a162-d4fb5172cc9c req-3f45efd0-490d-46ee-b814-1f22edbec4c9 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:30.289138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-30a092cc-cb62-4cb1-a162-d4fb5172cc9c req-3f45efd0-490d-46ee-b814-1f22edbec4c9 service nova] Creating event network-vif-plugged:cb3c7a1b-b5c2-4104-abc2-9f28d71afdfb for instance 2483e851-683c-4f95-9d9f-ade500d0ed0b on hv-cinder-82002 Jul 21 21:59:30.295782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-30a092cc-cb62-4cb1-a162-d4fb5172cc9c req-3f45efd0-490d-46ee-b814-1f22edbec4c9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073275 Jul 21 21:59:30.296952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 64/107] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:30.330273 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3a6f13e9-b8a2-40df-b5b8-ec9180ae0c93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:30.331667 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3a6f13e9-b8a2-40df-b5b8-ec9180ae0c93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:30.340564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a6f13e9-b8a2-40df-b5b8-ec9180ae0c93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:30.341428 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a6f13e9-b8a2-40df-b5b8-ec9180ae0c93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:30.343733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a6f13e9-b8a2-40df-b5b8-ec9180ae0c93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:30.344822 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a6f13e9-b8a2-40df-b5b8-ec9180ae0c93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:30.593488 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e1b52bf5-e772-409a-9775-1ff3c76dbe99 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:30.604156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e1b52bf5-e772-409a-9775-1ff3c76dbe99 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.485368 Jul 21 21:59:30.605396 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 44/108] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:30 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:30.656938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3a6f13e9-b8a2-40df-b5b8-ec9180ae0c93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:30.665441 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3a6f13e9-b8a2-40df-b5b8-ec9180ae0c93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.344076 Jul 21 21:59:30.677684 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 65/109] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:30 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:30.930843 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a83a9a5a-4dfc-4335-8b5f-e46a1f013319 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:30.932769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a83a9a5a-4dfc-4335-8b5f-e46a1f013319 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:30.933215 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bda10750-ceb1-4e94-997f-ce69e5bf4553 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:30.935879 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bda10750-ceb1-4e94-997f-ce69e5bf4553 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:30.943992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=14 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:30.949769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a83a9a5a-4dfc-4335-8b5f-e46a1f013319 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:30.950221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a83a9a5a-4dfc-4335-8b5f-e46a1f013319 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:30.950984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bda10750-ceb1-4e94-997f-ce69e5bf4553 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:30.951984 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a83a9a5a-4dfc-4335-8b5f-e46a1f013319 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:30.952458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a83a9a5a-4dfc-4335-8b5f-e46a1f013319 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:30.953754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bda10750-ceb1-4e94-997f-ce69e5bf4553 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:30.954610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bda10750-ceb1-4e94-997f-ce69e5bf4553 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:30.955086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bda10750-ceb1-4e94-997f-ce69e5bf4553 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:31.233556 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a83a9a5a-4dfc-4335-8b5f-e46a1f013319 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:31.246808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bda10750-ceb1-4e94-997f-ce69e5bf4553 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:31.253314 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a83a9a5a-4dfc-4335-8b5f-e46a1f013319 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 0.335390 Jul 21 21:59:31.254594 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 45/110] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:30 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:31.255459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bda10750-ceb1-4e94-997f-ce69e5bf4553 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.333991 Jul 21 21:59:31.256205 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 66/111] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:30 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:31.262403 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e2d352eb-e1b4-416c-8af5-3a6afba3372f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:31.263640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e2d352eb-e1b4-416c-8af5-3a6afba3372f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:31.272349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2d352eb-e1b4-416c-8af5-3a6afba3372f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:31.272802 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2d352eb-e1b4-416c-8af5-3a6afba3372f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:31.273765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2d352eb-e1b4-416c-8af5-3a6afba3372f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:31.274417 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2d352eb-e1b4-416c-8af5-3a6afba3372f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:31.507579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e2d352eb-e1b4-416c-8af5-3a6afba3372f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:31.518904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e2d352eb-e1b4-416c-8af5-3a6afba3372f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:31.520663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e2d352eb-e1b4-416c-8af5-3a6afba3372f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:31.521986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e2d352eb-e1b4-416c-8af5-3a6afba3372f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.265779 Jul 21 21:59:31.522747 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 46/112] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:31 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:31.621822 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-886d5497-aae5-4f90-ad5a-d5fc0d0e42d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:31.622443 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-886d5497-aae5-4f90-ad5a-d5fc0d0e42d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:31.629905 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-886d5497-aae5-4f90-ad5a-d5fc0d0e42d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:31.631132 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-886d5497-aae5-4f90-ad5a-d5fc0d0e42d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:31.632098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-886d5497-aae5-4f90-ad5a-d5fc0d0e42d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:31.632696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-886d5497-aae5-4f90-ad5a-d5fc0d0e42d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:31.685401 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-025a35ac-9ad6-4885-91c4-c9e91f67f004 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:31.686048 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-025a35ac-9ad6-4885-91c4-c9e91f67f004 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:31.694144 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-025a35ac-9ad6-4885-91c4-c9e91f67f004 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:31.694611 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-025a35ac-9ad6-4885-91c4-c9e91f67f004 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:31.695501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-025a35ac-9ad6-4885-91c4-c9e91f67f004 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:31.696093 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-025a35ac-9ad6-4885-91c4-c9e91f67f004 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:31.911229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-886d5497-aae5-4f90-ad5a-d5fc0d0e42d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:31.939345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-886d5497-aae5-4f90-ad5a-d5fc0d0e42d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.317124 Jul 21 21:59:31.939345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 67/113] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:31 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:31.960216 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-025a35ac-9ad6-4885-91c4-c9e91f67f004 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:31.967937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-025a35ac-9ad6-4885-91c4-c9e91f67f004 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.286637 Jul 21 21:59:31.968852 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 47/114] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:31 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:32.272426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e550750e-fa2c-427e-94db-844ae0290ace tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:32.272908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e550750e-fa2c-427e-94db-844ae0290ace tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:32.273291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d1101d5b-7369-4435-a180-811a09dd13ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:32.273984 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d1101d5b-7369-4435-a180-811a09dd13ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:32.281012 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e550750e-fa2c-427e-94db-844ae0290ace tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:32.281473 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e550750e-fa2c-427e-94db-844ae0290ace tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:32.282610 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d1101d5b-7369-4435-a180-811a09dd13ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:32.282804 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e550750e-fa2c-427e-94db-844ae0290ace tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:32.283249 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e550750e-fa2c-427e-94db-844ae0290ace tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:32.283749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d1101d5b-7369-4435-a180-811a09dd13ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:32.284748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d1101d5b-7369-4435-a180-811a09dd13ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:32.285381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d1101d5b-7369-4435-a180-811a09dd13ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:32.522420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e550750e-fa2c-427e-94db-844ae0290ace tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:32.526598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d1101d5b-7369-4435-a180-811a09dd13ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:32.530476 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e550750e-fa2c-427e-94db-844ae0290ace tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 0.262341 Jul 21 21:59:32.531491 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 68/115] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:32 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:32.543031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d1101d5b-7369-4435-a180-811a09dd13ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.268735 Jul 21 21:59:32.544043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 48/116] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:32 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:32.553285 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7a8f0580-6893-4d40-90e7-71f4cce8789d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:32.553911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7a8f0580-6893-4d40-90e7-71f4cce8789d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:32.563433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7a8f0580-6893-4d40-90e7-71f4cce8789d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:32.563890 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7a8f0580-6893-4d40-90e7-71f4cce8789d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:32.564680 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7a8f0580-6893-4d40-90e7-71f4cce8789d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:32.565161 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7a8f0580-6893-4d40-90e7-71f4cce8789d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:32.746108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7a8f0580-6893-4d40-90e7-71f4cce8789d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:32.762955 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7a8f0580-6893-4d40-90e7-71f4cce8789d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:32.767457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7a8f0580-6893-4d40-90e7-71f4cce8789d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:32.769389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7a8f0580-6893-4d40-90e7-71f4cce8789d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.222301 Jul 21 21:59:32.770529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 69/117] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:32 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:32.962909 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4c96ff3e-ebdc-400f-b20f-623b97a37fc5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:32.964595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4c96ff3e-ebdc-400f-b20f-623b97a37fc5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:32.975770 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c96ff3e-ebdc-400f-b20f-623b97a37fc5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:32.977035 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c96ff3e-ebdc-400f-b20f-623b97a37fc5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:32.978182 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c96ff3e-ebdc-400f-b20f-623b97a37fc5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:32.978858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c96ff3e-ebdc-400f-b20f-623b97a37fc5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:32.989487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-61c00d0a-f537-43b3-a9e6-72aa86f60467 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:32.990105 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-61c00d0a-f537-43b3-a9e6-72aa86f60467 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:32.997160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-61c00d0a-f537-43b3-a9e6-72aa86f60467 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:32.997624 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-61c00d0a-f537-43b3-a9e6-72aa86f60467 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:32.998414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-61c00d0a-f537-43b3-a9e6-72aa86f60467 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:32.998858 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-61c00d0a-f537-43b3-a9e6-72aa86f60467 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:33.182184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4c96ff3e-ebdc-400f-b20f-623b97a37fc5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:33.191359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4c96ff3e-ebdc-400f-b20f-623b97a37fc5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.232986 Jul 21 21:59:33.192288 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 49/118] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:32 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:33.210475 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-61c00d0a-f537-43b3-a9e6-72aa86f60467 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:33.218139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-61c00d0a-f537-43b3-a9e6-72aa86f60467 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.232944 Jul 21 21:59:33.218725 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 70/119] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:32 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:33.556650 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-407fc07b-c2df-4f95-9d6d-4f70c2bababf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:33.556745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f0ea660b-7902-4052-8957-12adf8c039da tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:33.556859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f0ea660b-7902-4052-8957-12adf8c039da tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:33.557284 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-407fc07b-c2df-4f95-9d6d-4f70c2bababf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:33.573684 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0ea660b-7902-4052-8957-12adf8c039da tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:33.574145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0ea660b-7902-4052-8957-12adf8c039da tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:33.574935 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0ea660b-7902-4052-8957-12adf8c039da tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:33.576807 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-407fc07b-c2df-4f95-9d6d-4f70c2bababf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:33.577267 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-407fc07b-c2df-4f95-9d6d-4f70c2bababf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:33.578059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-407fc07b-c2df-4f95-9d6d-4f70c2bababf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:33.578507 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-407fc07b-c2df-4f95-9d6d-4f70c2bababf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:33.591911 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0ea660b-7902-4052-8957-12adf8c039da tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:33.813363 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f0ea660b-7902-4052-8957-12adf8c039da tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:33.817952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-407fc07b-c2df-4f95-9d6d-4f70c2bababf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:33.846150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f0ea660b-7902-4052-8957-12adf8c039da tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 0.295194 Jul 21 21:59:33.847423 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 50/120] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:33 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:33.849458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-407fc07b-c2df-4f95-9d6d-4f70c2bababf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.298451 Jul 21 21:59:33.850459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 71/121] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:33 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:33.853011 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f7f417f7-62fd-4fce-9554-262ffbb5bd60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:33.853699 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f7f417f7-62fd-4fce-9554-262ffbb5bd60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:33.861318 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f7f417f7-62fd-4fce-9554-262ffbb5bd60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:33.861889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f7f417f7-62fd-4fce-9554-262ffbb5bd60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:33.862681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f7f417f7-62fd-4fce-9554-262ffbb5bd60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:33.863199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f7f417f7-62fd-4fce-9554-262ffbb5bd60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:34.013963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f7f417f7-62fd-4fce-9554-262ffbb5bd60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:34.022119 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f7f417f7-62fd-4fce-9554-262ffbb5bd60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:34.023739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f7f417f7-62fd-4fce-9554-262ffbb5bd60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:34.024885 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f7f417f7-62fd-4fce-9554-262ffbb5bd60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.176297 Jul 21 21:59:34.025765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 51/122] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:33 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:34.209636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ba93ea92-f6cb-406a-9164-9df46b2a8968 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:34.210542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ba93ea92-f6cb-406a-9164-9df46b2a8968 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:34.217046 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ba93ea92-f6cb-406a-9164-9df46b2a8968 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:34.217816 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ba93ea92-f6cb-406a-9164-9df46b2a8968 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:34.218527 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ba93ea92-f6cb-406a-9164-9df46b2a8968 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:34.218980 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ba93ea92-f6cb-406a-9164-9df46b2a8968 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:34.234971 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0904e24f-0b8e-494d-95a4-0cb3b05af6f1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:34.235709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0904e24f-0b8e-494d-95a4-0cb3b05af6f1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:34.242072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0904e24f-0b8e-494d-95a4-0cb3b05af6f1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:34.242555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0904e24f-0b8e-494d-95a4-0cb3b05af6f1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:34.243368 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0904e24f-0b8e-494d-95a4-0cb3b05af6f1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:34.243807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0904e24f-0b8e-494d-95a4-0cb3b05af6f1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:34.416545 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ba93ea92-f6cb-406a-9164-9df46b2a8968 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:34.424693 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ba93ea92-f6cb-406a-9164-9df46b2a8968 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.219701 Jul 21 21:59:34.425289 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 72/123] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:34 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:34.441021 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0904e24f-0b8e-494d-95a4-0cb3b05af6f1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:34.448847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0904e24f-0b8e-494d-95a4-0cb3b05af6f1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.218146 Jul 21 21:59:34.449483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 52/124] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:34 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:34.868614 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8ba7fb14-d971-4188-b9b6-1b95835b11ca tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:34.869086 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-78abf455-055b-46a0-a9da-c5cdf61ab770 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:34.869301 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8ba7fb14-d971-4188-b9b6-1b95835b11ca tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:34.870431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-78abf455-055b-46a0-a9da-c5cdf61ab770 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:34.878408 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ba7fb14-d971-4188-b9b6-1b95835b11ca tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:34.879099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ba7fb14-d971-4188-b9b6-1b95835b11ca tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:34.879989 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ba7fb14-d971-4188-b9b6-1b95835b11ca tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:34.880677 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ba7fb14-d971-4188-b9b6-1b95835b11ca tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:34.884577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-78abf455-055b-46a0-a9da-c5cdf61ab770 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:34.885268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-78abf455-055b-46a0-a9da-c5cdf61ab770 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:34.886183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-78abf455-055b-46a0-a9da-c5cdf61ab770 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:34.886691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-78abf455-055b-46a0-a9da-c5cdf61ab770 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:35.113106 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8ba7fb14-d971-4188-b9b6-1b95835b11ca tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:35.131944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8ba7fb14-d971-4188-b9b6-1b95835b11ca tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 0.272017 Jul 21 21:59:35.136957 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 73/125] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:34 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:35.141835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-78abf455-055b-46a0-a9da-c5cdf61ab770 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:35.142340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5e222d5a-95db-4bc4-bbeb-0587719a20b2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:35.142954 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5e222d5a-95db-4bc4-bbeb-0587719a20b2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:35.149408 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e222d5a-95db-4bc4-bbeb-0587719a20b2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:35.150146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e222d5a-95db-4bc4-bbeb-0587719a20b2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:35.150297 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-78abf455-055b-46a0-a9da-c5cdf61ab770 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.287547 Jul 21 21:59:35.150886 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 53/126] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:34 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:35.161267 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e222d5a-95db-4bc4-bbeb-0587719a20b2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:35.161267 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e222d5a-95db-4bc4-bbeb-0587719a20b2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:35.332611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5e222d5a-95db-4bc4-bbeb-0587719a20b2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:35.350631 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5e222d5a-95db-4bc4-bbeb-0587719a20b2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:35.355360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5e222d5a-95db-4bc4-bbeb-0587719a20b2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:35.364396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5e222d5a-95db-4bc4-bbeb-0587719a20b2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.223980 Jul 21 21:59:35.365242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 74/127] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:35 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:35.440470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c1607e35-8121-4cc8-9b55-f7d51a6d18b6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:35.441074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c1607e35-8121-4cc8-9b55-f7d51a6d18b6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:35.447343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1607e35-8121-4cc8-9b55-f7d51a6d18b6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:35.447800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1607e35-8121-4cc8-9b55-f7d51a6d18b6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:35.448604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1607e35-8121-4cc8-9b55-f7d51a6d18b6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:35.449027 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1607e35-8121-4cc8-9b55-f7d51a6d18b6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:35.466347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-336cc4aa-1a1b-47ba-9b6b-617bd2615d68 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:35.467469 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-336cc4aa-1a1b-47ba-9b6b-617bd2615d68 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:35.479377 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-336cc4aa-1a1b-47ba-9b6b-617bd2615d68 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:35.479706 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-336cc4aa-1a1b-47ba-9b6b-617bd2615d68 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:35.480503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-336cc4aa-1a1b-47ba-9b6b-617bd2615d68 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:35.480944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-336cc4aa-1a1b-47ba-9b6b-617bd2615d68 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:35.685234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c1607e35-8121-4cc8-9b55-f7d51a6d18b6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:35.689544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-336cc4aa-1a1b-47ba-9b6b-617bd2615d68 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:35.694431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c1607e35-8121-4cc8-9b55-f7d51a6d18b6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.257746 Jul 21 21:59:35.695112 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 54/128] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:35 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:35.704867 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-336cc4aa-1a1b-47ba-9b6b-617bd2615d68 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.242289 Jul 21 21:59:35.705454 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 75/129] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:35 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:36.152638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5a705de8-8deb-4df7-b0d1-bc12055c2b0d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:36.153244 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5a705de8-8deb-4df7-b0d1-bc12055c2b0d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:36.155321 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:36.160916 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a705de8-8deb-4df7-b0d1-bc12055c2b0d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:36.161468 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a705de8-8deb-4df7-b0d1-bc12055c2b0d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:36.162245 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a705de8-8deb-4df7-b0d1-bc12055c2b0d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:36.162910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a705de8-8deb-4df7-b0d1-bc12055c2b0d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:36.168964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-652df3fb-380b-440c-980a-6cd01dd66499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:36.169814 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-652df3fb-380b-440c-980a-6cd01dd66499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:36.191809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-652df3fb-380b-440c-980a-6cd01dd66499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:36.195747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-652df3fb-380b-440c-980a-6cd01dd66499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:36.195747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-652df3fb-380b-440c-980a-6cd01dd66499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:36.195747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-652df3fb-380b-440c-980a-6cd01dd66499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:36.503542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5a705de8-8deb-4df7-b0d1-bc12055c2b0d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:36.512871 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:36.522606 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5a705de8-8deb-4df7-b0d1-bc12055c2b0d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1322 microversion: 2.1 time: 0.372183 Jul 21 21:59:36.523806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 55/130] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:36 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:36.532406 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-652df3fb-380b-440c-980a-6cd01dd66499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:36.538791 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-59b5bf51-5c6b-4190-be28-e8dbdbfc7f21 req-cd6bcfc5-b341-40aa-95bc-c103248b923b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e2efbe-11d4-4ecc-8825-11f420d36f03", "name": "network-vif-plugged", "status": "completed", "tag": "978d1e0a-28ef-408b-a540-0a23b3da9c0b"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:36.545153 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-652df3fb-380b-440c-980a-6cd01dd66499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.379763 Jul 21 21:59:36.545733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 76/131] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:36 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:36.550990 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-59b5bf51-5c6b-4190-be28-e8dbdbfc7f21 req-cd6bcfc5-b341-40aa-95bc-c103248b923b service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:36.551818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-59b5bf51-5c6b-4190-be28-e8dbdbfc7f21 req-cd6bcfc5-b341-40aa-95bc-c103248b923b service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:36.562960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c8a1284a-1bab-4f5e-836c-48874efbdb5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:36.564946 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c8a1284a-1bab-4f5e-836c-48874efbdb5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:36.566955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-59b5bf51-5c6b-4190-be28-e8dbdbfc7f21 req-cd6bcfc5-b341-40aa-95bc-c103248b923b service nova] Creating event network-vif-plugged:978d1e0a-28ef-408b-a540-0a23b3da9c0b for instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 on hv-cinder-82002 Jul 21 21:59:36.573911 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-59b5bf51-5c6b-4190-be28-e8dbdbfc7f21 req-cd6bcfc5-b341-40aa-95bc-c103248b923b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048111 Jul 21 21:59:36.575806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 56/132] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:36.582863 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c8a1284a-1bab-4f5e-836c-48874efbdb5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:36.583369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c8a1284a-1bab-4f5e-836c-48874efbdb5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:36.584824 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c8a1284a-1bab-4f5e-836c-48874efbdb5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:36.585429 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c8a1284a-1bab-4f5e-836c-48874efbdb5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:36.712630 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8940a4c6-e448-4ea6-a1d1-289dc6995af8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:36.713427 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8940a4c6-e448-4ea6-a1d1-289dc6995af8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:36.722598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8940a4c6-e448-4ea6-a1d1-289dc6995af8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:36.723243 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8940a4c6-e448-4ea6-a1d1-289dc6995af8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:36.724159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8940a4c6-e448-4ea6-a1d1-289dc6995af8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:36.724817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8940a4c6-e448-4ea6-a1d1-289dc6995af8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:36.749815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c8a1284a-1bab-4f5e-836c-48874efbdb5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:36.758725 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c8a1284a-1bab-4f5e-836c-48874efbdb5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:36.760590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c8a1284a-1bab-4f5e-836c-48874efbdb5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:36.761927 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c8a1284a-1bab-4f5e-836c-48874efbdb5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.212409 Jul 21 21:59:36.762820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 77/133] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:36 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:36.770146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d532c491-6bd4-4969-b2d7-d207da812ae0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:36.771175 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d532c491-6bd4-4969-b2d7-d207da812ae0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:36.781602 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d532c491-6bd4-4969-b2d7-d207da812ae0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:36.782900 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d532c491-6bd4-4969-b2d7-d207da812ae0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:36.783733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d532c491-6bd4-4969-b2d7-d207da812ae0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:36.784186 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d532c491-6bd4-4969-b2d7-d207da812ae0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:36.984057 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8940a4c6-e448-4ea6-a1d1-289dc6995af8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:37.005095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8940a4c6-e448-4ea6-a1d1-289dc6995af8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.296767 Jul 21 21:59:37.018480 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 57/134] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:36 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:37.515170 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d532c491-6bd4-4969-b2d7-d207da812ae0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:37.525960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d532c491-6bd4-4969-b2d7-d207da812ae0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.761798 Jul 21 21:59:37.526451 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 78/135] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:36 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:37.540324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-791d53a9-5317-405b-a50c-078512cc0abd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:37.541081 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-791d53a9-5317-405b-a50c-078512cc0abd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:37.548389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-791d53a9-5317-405b-a50c-078512cc0abd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:37.548841 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-791d53a9-5317-405b-a50c-078512cc0abd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:37.549812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-791d53a9-5317-405b-a50c-078512cc0abd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:37.550252 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-791d53a9-5317-405b-a50c-078512cc0abd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:37.571171 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9239b2ad-3ef2-48c6-9392-85202705c627 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:37.571977 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9239b2ad-3ef2-48c6-9392-85202705c627 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:37.583451 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9239b2ad-3ef2-48c6-9392-85202705c627 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:37.583900 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9239b2ad-3ef2-48c6-9392-85202705c627 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:37.584678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9239b2ad-3ef2-48c6-9392-85202705c627 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:37.588765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9239b2ad-3ef2-48c6-9392-85202705c627 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:37.924590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-791d53a9-5317-405b-a50c-078512cc0abd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:37.934086 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-791d53a9-5317-405b-a50c-078512cc0abd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1516 microversion: 2.1 time: 0.397562 Jul 21 21:59:37.945726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 58/136] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:37 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1516 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:37.945726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-321574f6-99b3-4b32-8c89-878c36f2433e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:37.945726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-321574f6-99b3-4b32-8c89-878c36f2433e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:37.946480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9239b2ad-3ef2-48c6-9392-85202705c627 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:37.947468 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-321574f6-99b3-4b32-8c89-878c36f2433e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:37.948245 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-321574f6-99b3-4b32-8c89-878c36f2433e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:37.951179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-321574f6-99b3-4b32-8c89-878c36f2433e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:37.951179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-321574f6-99b3-4b32-8c89-878c36f2433e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:37.963053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9239b2ad-3ef2-48c6-9392-85202705c627 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.403058 Jul 21 21:59:37.970033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 79/137] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:37 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:37.970379 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f4c8f3f1-39ec-4c25-9bba-ccc7265c814c tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:37.971666 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f4c8f3f1-39ec-4c25-9bba-ccc7265c814c tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:37.980238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f4c8f3f1-39ec-4c25-9bba-ccc7265c814c tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:37.981092 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f4c8f3f1-39ec-4c25-9bba-ccc7265c814c tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:37.982390 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f4c8f3f1-39ec-4c25-9bba-ccc7265c814c tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:37.983059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f4c8f3f1-39ec-4c25-9bba-ccc7265c814c tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:38.012984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:38.050267 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-f4c8f3f1-39ec-4c25-9bba-ccc7265c814c tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lazy-loading 'flavor' on Instance uuid 996ecad7-3e17-4fda-ba01-cc79e9573422 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 21:59:38.188215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-321574f6-99b3-4b32-8c89-878c36f2433e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:38.193074 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f4c8f3f1-39ec-4c25-9bba-ccc7265c814c tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "POST /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422/action" status: 200 len: 32 microversion: 2.1 time: 0.227843 Jul 21 21:59:38.193899 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 80/138] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 21:59:37 2022] POST /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422/action => generated 32 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 21:59:38.200901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ed75e4f9-216b-4b9f-b417-69757ee7d549 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:38.201687 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ed75e4f9-216b-4b9f-b417-69757ee7d549 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:38.209722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed75e4f9-216b-4b9f-b417-69757ee7d549 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:38.210183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed75e4f9-216b-4b9f-b417-69757ee7d549 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:38.213292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-321574f6-99b3-4b32-8c89-878c36f2433e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:38.215294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-321574f6-99b3-4b32-8c89-878c36f2433e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:38.216720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-321574f6-99b3-4b32-8c89-878c36f2433e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.280672 Jul 21 21:59:38.223833 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed75e4f9-216b-4b9f-b417-69757ee7d549 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:38.224289 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed75e4f9-216b-4b9f-b417-69757ee7d549 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:38.229999 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 59/139] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:37 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:38.238681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-33389f92-59af-43b8-a6ec-17e299631821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:38.239431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-33389f92-59af-43b8-a6ec-17e299631821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:38.247659 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-33389f92-59af-43b8-a6ec-17e299631821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:38.248194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-33389f92-59af-43b8-a6ec-17e299631821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:38.249044 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-33389f92-59af-43b8-a6ec-17e299631821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:38.249553 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-33389f92-59af-43b8-a6ec-17e299631821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:38.560721 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ed75e4f9-216b-4b9f-b417-69757ee7d549 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:38.574095 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ed75e4f9-216b-4b9f-b417-69757ee7d549 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.377254 Jul 21 21:59:38.574713 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 81/140] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:38 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:38.587206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-db083073-efc7-4010-a41e-0a0a34b2b418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:38.591259 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-db083073-efc7-4010-a41e-0a0a34b2b418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:38.604252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db083073-efc7-4010-a41e-0a0a34b2b418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:38.616198 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db083073-efc7-4010-a41e-0a0a34b2b418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:38.618210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db083073-efc7-4010-a41e-0a0a34b2b418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:38.619874 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db083073-efc7-4010-a41e-0a0a34b2b418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:38.621545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-33389f92-59af-43b8-a6ec-17e299631821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:38.632699 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-33389f92-59af-43b8-a6ec-17e299631821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.400506 Jul 21 21:59:38.633272 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 60/141] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:38 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:38.648609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-abd8e5ac-62e2-4022-822e-529561526864 req-da0ea771-8350-48e3-807a-78dc9d3e77fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f", "name": "network-vif-plugged", "status": "completed", "tag": "ee06169e-43fc-48f5-a5bb-ad6632cb1500"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:38.658620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-abd8e5ac-62e2-4022-822e-529561526864 req-da0ea771-8350-48e3-807a-78dc9d3e77fa service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:38.659478 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-abd8e5ac-62e2-4022-822e-529561526864 req-da0ea771-8350-48e3-807a-78dc9d3e77fa service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:38.674786 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-abd8e5ac-62e2-4022-822e-529561526864 req-da0ea771-8350-48e3-807a-78dc9d3e77fa service nova] Creating event network-vif-plugged:ee06169e-43fc-48f5-a5bb-ad6632cb1500 for instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f on hv-cinder-82002 Jul 21 21:59:38.681414 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-abd8e5ac-62e2-4022-822e-529561526864 req-da0ea771-8350-48e3-807a-78dc9d3e77fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036578 Jul 21 21:59:38.682690 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 61/142] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:38.843795 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-db083073-efc7-4010-a41e-0a0a34b2b418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:38.853078 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-db083073-efc7-4010-a41e-0a0a34b2b418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.276896 Jul 21 21:59:38.853675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 82/143] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:38 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:38.984041 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-519dd214-c886-4231-995f-d68ee61e1131 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:38.985114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-519dd214-c886-4231-995f-d68ee61e1131 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:38.992720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-519dd214-c886-4231-995f-d68ee61e1131 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:38.993748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-519dd214-c886-4231-995f-d68ee61e1131 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:38.994839 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-519dd214-c886-4231-995f-d68ee61e1131 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:38.997615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-519dd214-c886-4231-995f-d68ee61e1131 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:39.239220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-30c8b512-5b96-4b58-b86d-72a4e90f87db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:39.240252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-30c8b512-5b96-4b58-b86d-72a4e90f87db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:39.255596 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-519dd214-c886-4231-995f-d68ee61e1131 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:39.258536 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30c8b512-5b96-4b58-b86d-72a4e90f87db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:39.258956 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30c8b512-5b96-4b58-b86d-72a4e90f87db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:39.260202 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30c8b512-5b96-4b58-b86d-72a4e90f87db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:39.260632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30c8b512-5b96-4b58-b86d-72a4e90f87db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:39.273705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-519dd214-c886-4231-995f-d68ee61e1131 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.293700 Jul 21 21:59:39.275752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 62/144] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:38 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:39.447546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-30c8b512-5b96-4b58-b86d-72a4e90f87db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:39.457019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-30c8b512-5b96-4b58-b86d-72a4e90f87db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:39.458786 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-30c8b512-5b96-4b58-b86d-72a4e90f87db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:39.460031 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-30c8b512-5b96-4b58-b86d-72a4e90f87db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.227884 Jul 21 21:59:39.461267 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 83/145] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:39 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:39.592636 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f34d8d76-d295-4bbb-9fa3-21cd3fce21d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:39.593534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f34d8d76-d295-4bbb-9fa3-21cd3fce21d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:39.600093 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f34d8d76-d295-4bbb-9fa3-21cd3fce21d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:39.600528 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f34d8d76-d295-4bbb-9fa3-21cd3fce21d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:39.601333 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f34d8d76-d295-4bbb-9fa3-21cd3fce21d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:39.601778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f34d8d76-d295-4bbb-9fa3-21cd3fce21d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:39.650612 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4f4de5ee-ac59-4f58-8890-34d8f7958e6e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:39.651523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4f4de5ee-ac59-4f58-8890-34d8f7958e6e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:39.658922 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f4de5ee-ac59-4f58-8890-34d8f7958e6e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:39.659408 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f4de5ee-ac59-4f58-8890-34d8f7958e6e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:39.660182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f4de5ee-ac59-4f58-8890-34d8f7958e6e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:39.660619 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f4de5ee-ac59-4f58-8890-34d8f7958e6e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:39.811500 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f34d8d76-d295-4bbb-9fa3-21cd3fce21d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:39.820897 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f34d8d76-d295-4bbb-9fa3-21cd3fce21d5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.232516 Jul 21 21:59:39.821797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 63/146] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:39 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:39.837034 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4f4de5ee-ac59-4f58-8890-34d8f7958e6e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:39.845137 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4f4de5ee-ac59-4f58-8890-34d8f7958e6e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.199229 Jul 21 21:59:39.845744 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 84/147] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:39 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:39.883317 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-555c0d26-2a7e-4b6f-8f84-4494202c05d5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:39.884133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-555c0d26-2a7e-4b6f-8f84-4494202c05d5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:39.890184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-555c0d26-2a7e-4b6f-8f84-4494202c05d5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:39.890629 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-555c0d26-2a7e-4b6f-8f84-4494202c05d5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:39.892047 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-555c0d26-2a7e-4b6f-8f84-4494202c05d5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:39.895248 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-555c0d26-2a7e-4b6f-8f84-4494202c05d5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:39.993310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:40.032298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-555c0d26-2a7e-4b6f-8f84-4494202c05d5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:40.041175 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-555c0d26-2a7e-4b6f-8f84-4494202c05d5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.162644 Jul 21 21:59:40.042098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 64/148] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:39 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:40.295330 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-09592594-91dc-4e0e-a3db-954ce62cce1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:40.295978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-09592594-91dc-4e0e-a3db-954ce62cce1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:40.306793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09592594-91dc-4e0e-a3db-954ce62cce1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:40.307283 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09592594-91dc-4e0e-a3db-954ce62cce1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:40.308142 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09592594-91dc-4e0e-a3db-954ce62cce1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:40.308854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09592594-91dc-4e0e-a3db-954ce62cce1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:40.457618 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-09592594-91dc-4e0e-a3db-954ce62cce1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:40.468221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-09592594-91dc-4e0e-a3db-954ce62cce1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.178939 Jul 21 21:59:40.468893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 85/149] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:40 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:40.487916 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d92686a1-cf19-4908-bca9-da1800846f5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:40.488598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d92686a1-cf19-4908-bca9-da1800846f5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:40.495267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d92686a1-cf19-4908-bca9-da1800846f5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:40.495870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d92686a1-cf19-4908-bca9-da1800846f5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:40.496635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d92686a1-cf19-4908-bca9-da1800846f5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:40.497403 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d92686a1-cf19-4908-bca9-da1800846f5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:40.639375 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d92686a1-cf19-4908-bca9-da1800846f5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:40.648110 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d92686a1-cf19-4908-bca9-da1800846f5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:40.649641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d92686a1-cf19-4908-bca9-da1800846f5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:40.650757 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d92686a1-cf19-4908-bca9-da1800846f5c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.167872 Jul 21 21:59:40.651869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 65/150] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:40 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:40.837652 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-96a06ff9-b87f-4630-8e56-9d97540a1d85 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:40.838260 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-96a06ff9-b87f-4630-8e56-9d97540a1d85 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:40.844663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96a06ff9-b87f-4630-8e56-9d97540a1d85 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:40.845127 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96a06ff9-b87f-4630-8e56-9d97540a1d85 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:40.845901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96a06ff9-b87f-4630-8e56-9d97540a1d85 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:40.846342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96a06ff9-b87f-4630-8e56-9d97540a1d85 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:40.862725 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fe8bd57a-e989-425a-a3ea-eb842b68bbb6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:40.864240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fe8bd57a-e989-425a-a3ea-eb842b68bbb6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:40.872064 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe8bd57a-e989-425a-a3ea-eb842b68bbb6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:40.872527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe8bd57a-e989-425a-a3ea-eb842b68bbb6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:40.873313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe8bd57a-e989-425a-a3ea-eb842b68bbb6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:40.873758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe8bd57a-e989-425a-a3ea-eb842b68bbb6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:41.067469 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-96a06ff9-b87f-4630-8e56-9d97540a1d85 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:41.074514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fe8bd57a-e989-425a-a3ea-eb842b68bbb6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:41.076039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-96a06ff9-b87f-4630-8e56-9d97540a1d85 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.242174 Jul 21 21:59:41.076995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 86/151] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:40 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:41.082360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fe8bd57a-e989-425a-a3ea-eb842b68bbb6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.224252 Jul 21 21:59:41.082930 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 66/152] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:40 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:41.087736 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3aaf8994-3bd8-4ea5-ae5a-a6ecc6e89552 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:41.088464 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3aaf8994-3bd8-4ea5-ae5a-a6ecc6e89552 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:41.094781 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3aaf8994-3bd8-4ea5-ae5a-a6ecc6e89552 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:41.095454 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3aaf8994-3bd8-4ea5-ae5a-a6ecc6e89552 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:41.096239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3aaf8994-3bd8-4ea5-ae5a-a6ecc6e89552 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:41.096679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3aaf8994-3bd8-4ea5-ae5a-a6ecc6e89552 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:41.240703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3aaf8994-3bd8-4ea5-ae5a-a6ecc6e89552 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:41.248611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3aaf8994-3bd8-4ea5-ae5a-a6ecc6e89552 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.164786 Jul 21 21:59:41.249319 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 87/153] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:41 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:41.485567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-83424e17-c981-48b6-a3b3-b9a054fe397d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:41.488031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-83424e17-c981-48b6-a3b3-b9a054fe397d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:41.496567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-83424e17-c981-48b6-a3b3-b9a054fe397d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:41.499959 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-83424e17-c981-48b6-a3b3-b9a054fe397d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:41.502675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-83424e17-c981-48b6-a3b3-b9a054fe397d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:41.507521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-83424e17-c981-48b6-a3b3-b9a054fe397d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:41.665731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-83424e17-c981-48b6-a3b3-b9a054fe397d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:41.671718 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-834781eb-a7a0-421e-a6e9-187cf23a0306 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:41.673712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-834781eb-a7a0-421e-a6e9-187cf23a0306 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:41.674161 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-83424e17-c981-48b6-a3b3-b9a054fe397d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.192970 Jul 21 21:59:41.675324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 67/154] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:41 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:41.683996 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-834781eb-a7a0-421e-a6e9-187cf23a0306 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:41.684895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-834781eb-a7a0-421e-a6e9-187cf23a0306 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:41.685785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-834781eb-a7a0-421e-a6e9-187cf23a0306 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:41.686275 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-834781eb-a7a0-421e-a6e9-187cf23a0306 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:41.822252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-834781eb-a7a0-421e-a6e9-187cf23a0306 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:41.831248 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-834781eb-a7a0-421e-a6e9-187cf23a0306 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:41.833045 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-834781eb-a7a0-421e-a6e9-187cf23a0306 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:41.834171 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-834781eb-a7a0-421e-a6e9-187cf23a0306 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.168752 Jul 21 21:59:41.834744 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 88/155] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:41 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:59:42.096876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a8d1b4b9-dea2-494b-90e9-b826e4bc9aed tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:42.099815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7869b746-3281-4d39-8378-be21e11756a9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:42.100515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7869b746-3281-4d39-8378-be21e11756a9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:42.102459 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a8d1b4b9-dea2-494b-90e9-b826e4bc9aed tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:42.108842 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a8d1b4b9-dea2-494b-90e9-b826e4bc9aed tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:42.109292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a8d1b4b9-dea2-494b-90e9-b826e4bc9aed tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:42.110767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7869b746-3281-4d39-8378-be21e11756a9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:42.111372 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a8d1b4b9-dea2-494b-90e9-b826e4bc9aed tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:42.111645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7869b746-3281-4d39-8378-be21e11756a9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:42.111870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a8d1b4b9-dea2-494b-90e9-b826e4bc9aed tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:42.112902 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7869b746-3281-4d39-8378-be21e11756a9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:42.113730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7869b746-3281-4d39-8378-be21e11756a9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:42.326659 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a8d1b4b9-dea2-494b-90e9-b826e4bc9aed tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:42.331076 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7869b746-3281-4d39-8378-be21e11756a9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:42.334727 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a8d1b4b9-dea2-494b-90e9-b826e4bc9aed tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1314 microversion: 2.1 time: 0.245639 Jul 21 21:59:42.335361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 68/156] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:42 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:42.339934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7869b746-3281-4d39-8378-be21e11756a9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.244230 Jul 21 21:59:42.340420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-178be429-14f5-46a6-8fac-15743dc42693 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:42.341163 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-178be429-14f5-46a6-8fac-15743dc42693 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:42.348737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-178be429-14f5-46a6-8fac-15743dc42693 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:42.349223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-178be429-14f5-46a6-8fac-15743dc42693 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:42.350150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-178be429-14f5-46a6-8fac-15743dc42693 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:42.350591 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-178be429-14f5-46a6-8fac-15743dc42693 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:42.351422 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 89/157] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:42 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:42.499118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-178be429-14f5-46a6-8fac-15743dc42693 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:42.508005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-178be429-14f5-46a6-8fac-15743dc42693 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.171474 Jul 21 21:59:42.508602 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 69/158] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:42 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:42.690938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9d1c07c5-066c-429a-bf88-55b4d52a58af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:42.691571 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9d1c07c5-066c-429a-bf88-55b4d52a58af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:42.698669 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9d1c07c5-066c-429a-bf88-55b4d52a58af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:42.699269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9d1c07c5-066c-429a-bf88-55b4d52a58af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:42.708663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9d1c07c5-066c-429a-bf88-55b4d52a58af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:42.708663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9d1c07c5-066c-429a-bf88-55b4d52a58af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:42.853527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-593c9db9-5f84-4c16-8dd7-d32431675524 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:42.854465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-593c9db9-5f84-4c16-8dd7-d32431675524 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:42.861400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-593c9db9-5f84-4c16-8dd7-d32431675524 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:42.862180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-593c9db9-5f84-4c16-8dd7-d32431675524 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:42.863616 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-593c9db9-5f84-4c16-8dd7-d32431675524 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:42.864254 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-593c9db9-5f84-4c16-8dd7-d32431675524 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:42.882697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9d1c07c5-066c-429a-bf88-55b4d52a58af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:42.892128 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9d1c07c5-066c-429a-bf88-55b4d52a58af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.205154 Jul 21 21:59:42.892886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 90/159] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:42 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:43.024729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-593c9db9-5f84-4c16-8dd7-d32431675524 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:43.033081 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-593c9db9-5f84-4c16-8dd7-d32431675524 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:43.034586 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-593c9db9-5f84-4c16-8dd7-d32431675524 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:43.035713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-593c9db9-5f84-4c16-8dd7-d32431675524 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1406 microversion: 2.20 time: 0.187563 Jul 21 21:59:43.036267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 70/160] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:42 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 21:59:43.352290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f91339ee-1513-4879-b61f-f1528c554224 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:43.357322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9c9e9e8d-02d7-49f0-8688-3e33064e9bbb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:43.357936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9c9e9e8d-02d7-49f0-8688-3e33064e9bbb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:43.358922 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f91339ee-1513-4879-b61f-f1528c554224 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:43.369963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9c9e9e8d-02d7-49f0-8688-3e33064e9bbb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:43.370418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9c9e9e8d-02d7-49f0-8688-3e33064e9bbb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:43.371244 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9c9e9e8d-02d7-49f0-8688-3e33064e9bbb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:43.371680 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9c9e9e8d-02d7-49f0-8688-3e33064e9bbb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:43.374590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f91339ee-1513-4879-b61f-f1528c554224 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:43.375100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f91339ee-1513-4879-b61f-f1528c554224 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:43.376413 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f91339ee-1513-4879-b61f-f1528c554224 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:43.376864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f91339ee-1513-4879-b61f-f1528c554224 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:43.591034 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f91339ee-1513-4879-b61f-f1528c554224 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:43.596451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9c9e9e8d-02d7-49f0-8688-3e33064e9bbb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:43.599950 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f91339ee-1513-4879-b61f-f1528c554224 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1500 microversion: 2.1 time: 0.251389 Jul 21 21:59:43.607084 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9c9e9e8d-02d7-49f0-8688-3e33064e9bbb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.251858 Jul 21 21:59:43.608225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 71/161] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:43 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:43.613882 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 91/162] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:43 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1500 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:43.615184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c3426901-0bdc-4e43-aa65-a8d863e58bcf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:43.616139 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c3426901-0bdc-4e43-aa65-a8d863e58bcf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:43.624846 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3426901-0bdc-4e43-aa65-a8d863e58bcf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:43.625533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3426901-0bdc-4e43-aa65-a8d863e58bcf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:43.628465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3426901-0bdc-4e43-aa65-a8d863e58bcf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:43.629148 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3426901-0bdc-4e43-aa65-a8d863e58bcf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:43.838896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c3426901-0bdc-4e43-aa65-a8d863e58bcf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:43.848959 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c3426901-0bdc-4e43-aa65-a8d863e58bcf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.239210 Jul 21 21:59:43.849554 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 72/163] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:43 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:43.909826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-60e30786-7fab-4ecd-a358-66fca9a0789d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:43.910866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-60e30786-7fab-4ecd-a358-66fca9a0789d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:43.917238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-60e30786-7fab-4ecd-a358-66fca9a0789d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:43.918096 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-60e30786-7fab-4ecd-a358-66fca9a0789d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:43.919117 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-60e30786-7fab-4ecd-a358-66fca9a0789d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:43.919568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-60e30786-7fab-4ecd-a358-66fca9a0789d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:44.054921 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f0fcd577-ca81-4390-9023-f20d5844d24a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:44.055860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f0fcd577-ca81-4390-9023-f20d5844d24a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:44.088689 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0fcd577-ca81-4390-9023-f20d5844d24a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:44.090662 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0fcd577-ca81-4390-9023-f20d5844d24a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:44.097138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0fcd577-ca81-4390-9023-f20d5844d24a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:44.099174 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0fcd577-ca81-4390-9023-f20d5844d24a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:44.399351 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-60e30786-7fab-4ecd-a358-66fca9a0789d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:44.409461 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-60e30786-7fab-4ecd-a358-66fca9a0789d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.504045 Jul 21 21:59:44.410182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 92/164] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:43 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:44.441102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f0fcd577-ca81-4390-9023-f20d5844d24a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:44.444798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:44.450744 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f0fcd577-ca81-4390-9023-f20d5844d24a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:44.452356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f0fcd577-ca81-4390-9023-f20d5844d24a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:44.454164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f0fcd577-ca81-4390-9023-f20d5844d24a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1597 microversion: 2.20 time: 0.404112 Jul 21 21:59:44.454804 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 73/165] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 21:59:44 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1597 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 21:59:44.472633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-567594d3-e0b4-453e-89b6-759d12079c0a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:44.473134 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-567594d3-e0b4-453e-89b6-759d12079c0a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:44.479643 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-567594d3-e0b4-453e-89b6-759d12079c0a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:44.480099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-567594d3-e0b4-453e-89b6-759d12079c0a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:44.481170 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-567594d3-e0b4-453e-89b6-759d12079c0a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:44.481828 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-567594d3-e0b4-453e-89b6-759d12079c0a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:44.603978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-567594d3-e0b4-453e-89b6-759d12079c0a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.135110 Jul 21 21:59:44.604581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 93/166] 10.222.0.44 () {60 vars in 1315 bytes} [Thu Jul 21 21:59:44 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 21:59:44.632719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6c3dc6ab-fcf2-42b3-9772-4634f849b6b3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:44.634254 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6c3dc6ab-fcf2-42b3-9772-4634f849b6b3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:44.646665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c3dc6ab-fcf2-42b3-9772-4634f849b6b3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:44.648038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c3dc6ab-fcf2-42b3-9772-4634f849b6b3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:44.649419 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c3dc6ab-fcf2-42b3-9772-4634f849b6b3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:44.649980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c3dc6ab-fcf2-42b3-9772-4634f849b6b3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:44.867677 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-12504eeb-b39f-4964-ba06-87a8b9f7394b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:44.868199 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-12504eeb-b39f-4964-ba06-87a8b9f7394b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:44.878480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-12504eeb-b39f-4964-ba06-87a8b9f7394b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:44.878925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-12504eeb-b39f-4964-ba06-87a8b9f7394b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:44.881082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-12504eeb-b39f-4964-ba06-87a8b9f7394b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:44.881382 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-12504eeb-b39f-4964-ba06-87a8b9f7394b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:44.961426 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6c3dc6ab-fcf2-42b3-9772-4634f849b6b3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:44.984124 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6c3dc6ab-fcf2-42b3-9772-4634f849b6b3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.361976 Jul 21 21:59:44.989529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 74/167] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:44 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:45.129882 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-70264ba0-c0df-481d-baf0-9e0e1fe94e50 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48b6978b-4a52-4312-9ce6-007ef73dcf32"}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:45.131688 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-70264ba0-c0df-481d-baf0-9e0e1fe94e50 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:45.142253 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-70264ba0-c0df-481d-baf0-9e0e1fe94e50 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:45.142827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-70264ba0-c0df-481d-baf0-9e0e1fe94e50 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:45.144806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-70264ba0-c0df-481d-baf0-9e0e1fe94e50 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:45.145382 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-70264ba0-c0df-481d-baf0-9e0e1fe94e50 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:45.310219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-12504eeb-b39f-4964-ba06-87a8b9f7394b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:45.319148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-12504eeb-b39f-4964-ba06-87a8b9f7394b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.455464 Jul 21 21:59:45.323637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 94/168] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:44 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:45.429408 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a272f169-2cd6-49c5-a7ab-124400ca34f0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:45.430741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a272f169-2cd6-49c5-a7ab-124400ca34f0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:45.439100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a272f169-2cd6-49c5-a7ab-124400ca34f0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:45.440378 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a272f169-2cd6-49c5-a7ab-124400ca34f0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:45.441535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a272f169-2cd6-49c5-a7ab-124400ca34f0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:45.442492 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a272f169-2cd6-49c5-a7ab-124400ca34f0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:45.448057 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 21:59:45.616632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a272f169-2cd6-49c5-a7ab-124400ca34f0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:45.627549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a272f169-2cd6-49c5-a7ab-124400ca34f0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.203255 Jul 21 21:59:45.629944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 95/169] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:45 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:46.007761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e2907628-d378-48ac-ae1e-b93e32f40e41 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:46.008670 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e2907628-d378-48ac-ae1e-b93e32f40e41 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:46.019061 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e2907628-d378-48ac-ae1e-b93e32f40e41 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:46.020182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e2907628-d378-48ac-ae1e-b93e32f40e41 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:46.021729 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e2907628-d378-48ac-ae1e-b93e32f40e41 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:46.031731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e2907628-d378-48ac-ae1e-b93e32f40e41 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:46.074492 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-70264ba0-c0df-481d-baf0-9e0e1fe94e50 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "POST /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.951754 Jul 21 21:59:46.075530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 75/170] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 21:59:45 2022] POST /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b/os-volume_attachments => generated 194 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:46.349204 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-72a230c1-4b63-4687-9836-77bb3c5dec73 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:46.349204 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-72a230c1-4b63-4687-9836-77bb3c5dec73 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:46.349464 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e2907628-d378-48ac-ae1e-b93e32f40e41 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:46.359611 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72a230c1-4b63-4687-9836-77bb3c5dec73 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:46.360440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72a230c1-4b63-4687-9836-77bb3c5dec73 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:46.361408 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72a230c1-4b63-4687-9836-77bb3c5dec73 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:46.361971 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72a230c1-4b63-4687-9836-77bb3c5dec73 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:46.362087 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e2907628-d378-48ac-ae1e-b93e32f40e41 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.359941 Jul 21 21:59:46.365575 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 96/171] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:46 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:46.644333 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-72a230c1-4b63-4687-9836-77bb3c5dec73 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:46.648350 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e85aa596-fb82-420b-810a-a6c60d2f256b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:46.649301 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e85aa596-fb82-420b-810a-a6c60d2f256b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:46.657180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-72a230c1-4b63-4687-9836-77bb3c5dec73 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1363 microversion: 2.1 time: 0.318784 Jul 21 21:59:46.657349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e85aa596-fb82-420b-810a-a6c60d2f256b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:46.657668 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e85aa596-fb82-420b-810a-a6c60d2f256b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:46.658339 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 76/172] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:46 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:46.659180 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e85aa596-fb82-420b-810a-a6c60d2f256b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:46.659836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e85aa596-fb82-420b-810a-a6c60d2f256b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:46.947369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-817ff021-0ab2-4079-baea-9964d74d4c68 req-c660a1ce-055b-46ed-894b-c0ba6edb9e73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84e2efbe-11d4-4ecc-8825-11f420d36f03", "tag": "978d1e0a-28ef-408b-a540-0a23b3da9c0b"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:46.970797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-817ff021-0ab2-4079-baea-9964d74d4c68 req-c660a1ce-055b-46ed-894b-c0ba6edb9e73 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:46.972481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-817ff021-0ab2-4079-baea-9964d74d4c68 req-c660a1ce-055b-46ed-894b-c0ba6edb9e73 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:46.996703 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-817ff021-0ab2-4079-baea-9964d74d4c68 req-c660a1ce-055b-46ed-894b-c0ba6edb9e73 service nova] Creating event network-changed:978d1e0a-28ef-408b-a540-0a23b3da9c0b for instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 on hv-cinder-82002 Jul 21 21:59:46.997733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e85aa596-fb82-420b-810a-a6c60d2f256b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:47.006392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-817ff021-0ab2-4079-baea-9964d74d4c68 req-c660a1ce-055b-46ed-894b-c0ba6edb9e73 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063915 Jul 21 21:59:47.008171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 77/173] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:47.014814 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e85aa596-fb82-420b-810a-a6c60d2f256b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.371940 Jul 21 21:59:47.018143 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 97/174] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:46 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 21:59:47.383335 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0cbad7b7-36d9-4599-bc30-ae665203ddbd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:47.384803 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0cbad7b7-36d9-4599-bc30-ae665203ddbd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:47.392118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0cbad7b7-36d9-4599-bc30-ae665203ddbd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:47.392975 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0cbad7b7-36d9-4599-bc30-ae665203ddbd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:47.394379 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0cbad7b7-36d9-4599-bc30-ae665203ddbd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:47.395862 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0cbad7b7-36d9-4599-bc30-ae665203ddbd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:47.675542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0cbad7b7-36d9-4599-bc30-ae665203ddbd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:47.676847 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-99cd8bfd-a16c-4b2f-98e9-71acf8edc11a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:47.678034 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-99cd8bfd-a16c-4b2f-98e9-71acf8edc11a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:47.686361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99cd8bfd-a16c-4b2f-98e9-71acf8edc11a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:47.686814 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0cbad7b7-36d9-4599-bc30-ae665203ddbd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.311027 Jul 21 21:59:47.687283 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99cd8bfd-a16c-4b2f-98e9-71acf8edc11a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:47.688958 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99cd8bfd-a16c-4b2f-98e9-71acf8edc11a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:47.698162 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 78/175] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:47 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:47.699344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99cd8bfd-a16c-4b2f-98e9-71acf8edc11a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:47.746022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-59628f3e-4dfb-419f-bcee-0df52a3531ed req-51a08e3f-bfd2-4457-b413-b1aa55679992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7365f289-299d-4d2d-ba74-1ca18cf88e06", "name": "network-vif-plugged", "status": "completed", "tag": "eed67bc7-6a60-4e49-80a2-4868db4a2cb0"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:47.776915 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-59628f3e-4dfb-419f-bcee-0df52a3531ed req-51a08e3f-bfd2-4457-b413-b1aa55679992 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:47.777621 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-59628f3e-4dfb-419f-bcee-0df52a3531ed req-51a08e3f-bfd2-4457-b413-b1aa55679992 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:47.810305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-59628f3e-4dfb-419f-bcee-0df52a3531ed req-51a08e3f-bfd2-4457-b413-b1aa55679992 service nova] Creating event network-vif-plugged:eed67bc7-6a60-4e49-80a2-4868db4a2cb0 for instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 on hv-cinder-82002 Jul 21 21:59:47.822305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-59628f3e-4dfb-419f-bcee-0df52a3531ed req-51a08e3f-bfd2-4457-b413-b1aa55679992 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079645 Jul 21 21:59:47.824439 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 79/176] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:47.944097 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-99cd8bfd-a16c-4b2f-98e9-71acf8edc11a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:47.951943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-99cd8bfd-a16c-4b2f-98e9-71acf8edc11a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1548 microversion: 2.1 time: 0.280597 Jul 21 21:59:47.966595 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 98/177] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:47 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1548 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:47.972644 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1c08b46e-fb42-4eac-8998-5009050f6606 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:47.973505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1c08b46e-fb42-4eac-8998-5009050f6606 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:47.981309 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1c08b46e-fb42-4eac-8998-5009050f6606 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:47.981955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1c08b46e-fb42-4eac-8998-5009050f6606 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:47.983080 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1c08b46e-fb42-4eac-8998-5009050f6606 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:47.983670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1c08b46e-fb42-4eac-8998-5009050f6606 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:48.038438 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-97105353-991d-4d75-bf0a-5a97de6f6c1d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:48.039327 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-97105353-991d-4d75-bf0a-5a97de6f6c1d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:48.049534 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-97105353-991d-4d75-bf0a-5a97de6f6c1d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:48.050624 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-97105353-991d-4d75-bf0a-5a97de6f6c1d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:48.051576 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-97105353-991d-4d75-bf0a-5a97de6f6c1d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:48.052177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-97105353-991d-4d75-bf0a-5a97de6f6c1d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:48.170207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1c08b46e-fb42-4eac-8998-5009050f6606 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.202927 Jul 21 21:59:48.171820 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 80/178] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 21:59:47 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 21:59:48.590358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-97105353-991d-4d75-bf0a-5a97de6f6c1d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:48.598520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-97105353-991d-4d75-bf0a-5a97de6f6c1d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.567986 Jul 21 21:59:48.599059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 99/179] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:48 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:48.706354 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f778ac8c-b53b-45b6-89bc-e1804e7c31fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:48.706971 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f778ac8c-b53b-45b6-89bc-e1804e7c31fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:48.713891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f778ac8c-b53b-45b6-89bc-e1804e7c31fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:48.714273 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f778ac8c-b53b-45b6-89bc-e1804e7c31fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:48.715101 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f778ac8c-b53b-45b6-89bc-e1804e7c31fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:48.715544 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f778ac8c-b53b-45b6-89bc-e1804e7c31fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:49.226119 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f778ac8c-b53b-45b6-89bc-e1804e7c31fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:49.237565 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f778ac8c-b53b-45b6-89bc-e1804e7c31fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.535942 Jul 21 21:59:49.238278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 81/180] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:48 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:49.616721 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-39c427b1-6a2e-4752-8e36-fdd1eb1b37b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:49.617341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-39c427b1-6a2e-4752-8e36-fdd1eb1b37b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:49.623710 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39c427b1-6a2e-4752-8e36-fdd1eb1b37b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:49.628321 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39c427b1-6a2e-4752-8e36-fdd1eb1b37b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:49.629772 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39c427b1-6a2e-4752-8e36-fdd1eb1b37b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:49.630758 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39c427b1-6a2e-4752-8e36-fdd1eb1b37b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:49.934014 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-39c427b1-6a2e-4752-8e36-fdd1eb1b37b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:49.942455 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-39c427b1-6a2e-4752-8e36-fdd1eb1b37b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.330376 Jul 21 21:59:49.943068 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 100/181] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:49 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:50.264846 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-d1a0245e-5045-4786-ab25-2f8328fd207c req-ae20b2b6-96dd-4430-9fe9-5aa0ddf78a53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f", "tag": "ee06169e-43fc-48f5-a5bb-ad6632cb1500"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:50.266895 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f5db38a7-e510-417c-a07b-86e6003f3795 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:50.272585 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f5db38a7-e510-417c-a07b-86e6003f3795 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:50.288069 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d1a0245e-5045-4786-ab25-2f8328fd207c req-ae20b2b6-96dd-4430-9fe9-5aa0ddf78a53 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:50.288627 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5db38a7-e510-417c-a07b-86e6003f3795 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:50.289087 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5db38a7-e510-417c-a07b-86e6003f3795 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:50.289443 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d1a0245e-5045-4786-ab25-2f8328fd207c req-ae20b2b6-96dd-4430-9fe9-5aa0ddf78a53 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:50.294070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5db38a7-e510-417c-a07b-86e6003f3795 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:50.297624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5db38a7-e510-417c-a07b-86e6003f3795 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:50.304269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-d1a0245e-5045-4786-ab25-2f8328fd207c req-ae20b2b6-96dd-4430-9fe9-5aa0ddf78a53 service nova] Creating event network-changed:ee06169e-43fc-48f5-a5bb-ad6632cb1500 for instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f on hv-cinder-82002 Jul 21 21:59:50.311500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-d1a0245e-5045-4786-ab25-2f8328fd207c req-ae20b2b6-96dd-4430-9fe9-5aa0ddf78a53 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052270 Jul 21 21:59:50.313412 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 101/182] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:50.529133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f5db38a7-e510-417c-a07b-86e6003f3795 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:50.542580 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f5db38a7-e510-417c-a07b-86e6003f3795 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.290224 Jul 21 21:59:50.544116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 82/183] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:50 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:50.959790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7085b763-6843-4d7e-96b8-adc9005b1c90 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:50.960639 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7085b763-6843-4d7e-96b8-adc9005b1c90 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:50.967398 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7085b763-6843-4d7e-96b8-adc9005b1c90 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:50.967859 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7085b763-6843-4d7e-96b8-adc9005b1c90 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:50.969260 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7085b763-6843-4d7e-96b8-adc9005b1c90 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:50.969704 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7085b763-6843-4d7e-96b8-adc9005b1c90 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:51.129344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7085b763-6843-4d7e-96b8-adc9005b1c90 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:51.137409 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7085b763-6843-4d7e-96b8-adc9005b1c90 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.181794 Jul 21 21:59:51.138014 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 102/184] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:50 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:51.560382 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fa5cb993-442b-47c5-bbd0-4cc35b89bebc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:51.560981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fa5cb993-442b-47c5-bbd0-4cc35b89bebc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:51.568424 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa5cb993-442b-47c5-bbd0-4cc35b89bebc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:51.568868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa5cb993-442b-47c5-bbd0-4cc35b89bebc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:51.569636 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa5cb993-442b-47c5-bbd0-4cc35b89bebc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:51.570068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa5cb993-442b-47c5-bbd0-4cc35b89bebc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:51.727893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fa5cb993-442b-47c5-bbd0-4cc35b89bebc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:51.736125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fa5cb993-442b-47c5-bbd0-4cc35b89bebc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.179386 Jul 21 21:59:51.736632 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 83/185] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:51 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:52.154853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9286fc39-891f-4211-adf1-b8f60551a3bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:52.155509 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9286fc39-891f-4211-adf1-b8f60551a3bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:52.162265 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9286fc39-891f-4211-adf1-b8f60551a3bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:52.162719 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9286fc39-891f-4211-adf1-b8f60551a3bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:52.163544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9286fc39-891f-4211-adf1-b8f60551a3bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:52.163972 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9286fc39-891f-4211-adf1-b8f60551a3bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:52.306420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9286fc39-891f-4211-adf1-b8f60551a3bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:52.314067 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9286fc39-891f-4211-adf1-b8f60551a3bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1367 microversion: 2.1 time: 0.163139 Jul 21 21:59:52.314639 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 103/186] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:52 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:52.752723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-14bc3e54-7968-4df9-9e78-e423b16cfdec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:52.753330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-14bc3e54-7968-4df9-9e78-e423b16cfdec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:52.760140 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-14bc3e54-7968-4df9-9e78-e423b16cfdec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:52.760589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-14bc3e54-7968-4df9-9e78-e423b16cfdec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:52.761371 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-14bc3e54-7968-4df9-9e78-e423b16cfdec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:52.761813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-14bc3e54-7968-4df9-9e78-e423b16cfdec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:52.929657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-14bc3e54-7968-4df9-9e78-e423b16cfdec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:52.937223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-14bc3e54-7968-4df9-9e78-e423b16cfdec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.188723 Jul 21 21:59:52.938294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 84/187] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:52 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:53.332066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-825d6641-80f2-4fbb-a7e5-a184074ac78d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:53.333226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-825d6641-80f2-4fbb-a7e5-a184074ac78d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:53.340011 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-825d6641-80f2-4fbb-a7e5-a184074ac78d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:53.340808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-825d6641-80f2-4fbb-a7e5-a184074ac78d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:53.341592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-825d6641-80f2-4fbb-a7e5-a184074ac78d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:53.342314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-825d6641-80f2-4fbb-a7e5-a184074ac78d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:53.488952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-825d6641-80f2-4fbb-a7e5-a184074ac78d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:53.496448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-825d6641-80f2-4fbb-a7e5-a184074ac78d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1556 microversion: 2.1 time: 0.169097 Jul 21 21:59:53.497014 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 104/188] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:53 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:53.513913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9c426ee6-faae-4847-9639-444353b71328 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:53.514497 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9c426ee6-faae-4847-9639-444353b71328 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:53.520674 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9c426ee6-faae-4847-9639-444353b71328 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:53.521126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9c426ee6-faae-4847-9639-444353b71328 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:53.521891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9c426ee6-faae-4847-9639-444353b71328 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:53.522331 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9c426ee6-faae-4847-9639-444353b71328 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:53.600109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9c426ee6-faae-4847-9639-444353b71328 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090024 Jul 21 21:59:53.600707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 85/189] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 21:59:53 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:53.954199 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0b287800-23d5-44d7-be05-de583894eef8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:53.954719 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0b287800-23d5-44d7-be05-de583894eef8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:53.960726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b287800-23d5-44d7-be05-de583894eef8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:53.961180 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b287800-23d5-44d7-be05-de583894eef8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:53.961950 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b287800-23d5-44d7-be05-de583894eef8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:53.962392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b287800-23d5-44d7-be05-de583894eef8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:54.179750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0b287800-23d5-44d7-be05-de583894eef8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:54.188570 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0b287800-23d5-44d7-be05-de583894eef8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.238744 Jul 21 21:59:54.189163 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 105/190] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:53 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:54.679849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-5dd1c6cc-165f-4d05-b465-b7497bd5beef req-c8608b24-78cc-471a-bd86-6d8ff8d02b6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7365f289-299d-4d2d-ba74-1ca18cf88e06", "tag": "eed67bc7-6a60-4e49-80a2-4868db4a2cb0"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 21:59:54.689150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-5dd1c6cc-165f-4d05-b465-b7497bd5beef req-c8608b24-78cc-471a-bd86-6d8ff8d02b6f service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:54.689695 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-5dd1c6cc-165f-4d05-b465-b7497bd5beef req-c8608b24-78cc-471a-bd86-6d8ff8d02b6f service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:54.702754 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-5dd1c6cc-165f-4d05-b465-b7497bd5beef req-c8608b24-78cc-471a-bd86-6d8ff8d02b6f service nova] Creating event network-changed:eed67bc7-6a60-4e49-80a2-4868db4a2cb0 for instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 on hv-cinder-82002 Jul 21 21:59:54.708334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-5dd1c6cc-165f-4d05-b465-b7497bd5beef req-c8608b24-78cc-471a-bd86-6d8ff8d02b6f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032774 Jul 21 21:59:54.708939 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 86/191] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 21:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 21:59:55.206390 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1ee32d6d-7647-45c3-8773-c18ba7170aac tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:55.207228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1ee32d6d-7647-45c3-8773-c18ba7170aac tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:55.213537 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ee32d6d-7647-45c3-8773-c18ba7170aac tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:55.214069 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ee32d6d-7647-45c3-8773-c18ba7170aac tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:55.214955 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ee32d6d-7647-45c3-8773-c18ba7170aac tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:55.215510 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ee32d6d-7647-45c3-8773-c18ba7170aac tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:55.350323 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1ee32d6d-7647-45c3-8773-c18ba7170aac tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:55.358124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1ee32d6d-7647-45c3-8773-c18ba7170aac tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.156107 Jul 21 21:59:55.358819 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 106/192] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:55 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:56.376818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-714e57f3-c7bb-47f7-8ffa-fb3b91bffa59 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:56.377503 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-714e57f3-c7bb-47f7-8ffa-fb3b91bffa59 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:56.383710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-714e57f3-c7bb-47f7-8ffa-fb3b91bffa59 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:56.384154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-714e57f3-c7bb-47f7-8ffa-fb3b91bffa59 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:56.384907 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-714e57f3-c7bb-47f7-8ffa-fb3b91bffa59 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:56.385341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-714e57f3-c7bb-47f7-8ffa-fb3b91bffa59 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:56.516978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-714e57f3-c7bb-47f7-8ffa-fb3b91bffa59 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:56.524527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-714e57f3-c7bb-47f7-8ffa-fb3b91bffa59 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.153027 Jul 21 21:59:56.525092 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 87/193] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:56 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:57.541105 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5235e4ab-c073-4632-b47f-c75668d41d61 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:57.541712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5235e4ab-c073-4632-b47f-c75668d41d61 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:57.548269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5235e4ab-c073-4632-b47f-c75668d41d61 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:57.548715 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5235e4ab-c073-4632-b47f-c75668d41d61 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:57.549480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5235e4ab-c073-4632-b47f-c75668d41d61 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:57.549909 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5235e4ab-c073-4632-b47f-c75668d41d61 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:57.681313 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5235e4ab-c073-4632-b47f-c75668d41d61 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:57.689354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5235e4ab-c073-4632-b47f-c75668d41d61 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.152060 Jul 21 21:59:57.689928 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 107/194] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:57 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:58.706098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-de06445a-3e0b-48c4-86c3-21073dd88d6d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:58.706708 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-de06445a-3e0b-48c4-86c3-21073dd88d6d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:58.713395 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de06445a-3e0b-48c4-86c3-21073dd88d6d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:58.713841 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de06445a-3e0b-48c4-86c3-21073dd88d6d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:58.714604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de06445a-3e0b-48c4-86c3-21073dd88d6d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:58.715062 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de06445a-3e0b-48c4-86c3-21073dd88d6d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:58.842601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-de06445a-3e0b-48c4-86c3-21073dd88d6d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 21:59:58.850442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-de06445a-3e0b-48c4-86c3-21073dd88d6d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.148828 Jul 21 21:59:58.851049 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 88/195] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:58 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 21:59:59.868998 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-68f66184-4ef0-4d77-a235-3efee3cabecf tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 21:59:59.869611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-68f66184-4ef0-4d77-a235-3efee3cabecf tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 21:59:59.876690 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68f66184-4ef0-4d77-a235-3efee3cabecf tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:59.877199 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68f66184-4ef0-4d77-a235-3efee3cabecf tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 21:59:59.877975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68f66184-4ef0-4d77-a235-3efee3cabecf tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 21:59:59.878405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68f66184-4ef0-4d77-a235-3efee3cabecf tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:00.093512 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-68f66184-4ef0-4d77-a235-3efee3cabecf tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:00.106061 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-68f66184-4ef0-4d77-a235-3efee3cabecf tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.241220 Jul 21 22:00:00.107079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 108/196] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 21:59:59 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:01.128525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-950157f3-958f-4e04-a20d-a6c19e964333 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:01.130982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-950157f3-958f-4e04-a20d-a6c19e964333 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:01.140360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-950157f3-958f-4e04-a20d-a6c19e964333 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:01.141458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-950157f3-958f-4e04-a20d-a6c19e964333 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:01.142965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-950157f3-958f-4e04-a20d-a6c19e964333 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:01.143899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-950157f3-958f-4e04-a20d-a6c19e964333 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:01.300887 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-950157f3-958f-4e04-a20d-a6c19e964333 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:01.309663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-950157f3-958f-4e04-a20d-a6c19e964333 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.187908 Jul 21 22:00:01.310369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 89/197] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:01 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:02.273255 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f934fb8b-97d7-4b0a-8dea-a624b38dafbb tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:02.273826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f934fb8b-97d7-4b0a-8dea-a624b38dafbb tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:02.280284 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=90 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:00:02.282943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f934fb8b-97d7-4b0a-8dea-a624b38dafbb tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:02.283483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f934fb8b-97d7-4b0a-8dea-a624b38dafbb tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:02.284221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f934fb8b-97d7-4b0a-8dea-a624b38dafbb tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:02.284664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f934fb8b-97d7-4b0a-8dea-a624b38dafbb tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:02.312054 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f934fb8b-97d7-4b0a-8dea-a624b38dafbb tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:00:02.327506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-043b856e-b5e4-42d7-96fb-b103d2c287fc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:02.328301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-043b856e-b5e4-42d7-96fb-b103d2c287fc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:02.335235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-043b856e-b5e4-42d7-96fb-b103d2c287fc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:02.335625 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-043b856e-b5e4-42d7-96fb-b103d2c287fc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:02.336407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-043b856e-b5e4-42d7-96fb-b103d2c287fc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:02.336937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-043b856e-b5e4-42d7-96fb-b103d2c287fc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:02.416001 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f934fb8b-97d7-4b0a-8dea-a624b38dafbb tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 204 len: 0 microversion: 2.1 time: 0.140234 Jul 21 22:00:02.416948 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 109/198] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:00:02 2022] DELETE /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:00:02.426487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-08279502-7150-4bcf-afed-5329285987ab tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:02.427182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-08279502-7150-4bcf-afed-5329285987ab tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:02.433919 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08279502-7150-4bcf-afed-5329285987ab tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:02.434607 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08279502-7150-4bcf-afed-5329285987ab tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:02.435591 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08279502-7150-4bcf-afed-5329285987ab tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:02.436039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08279502-7150-4bcf-afed-5329285987ab tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:02.557973 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-043b856e-b5e4-42d7-96fb-b103d2c287fc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:02.566510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-043b856e-b5e4-42d7-96fb-b103d2c287fc tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.242757 Jul 21 22:00:02.568758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 90/199] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:02 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:00:02.826001 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-08279502-7150-4bcf-afed-5329285987ab tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:02.830538 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:00:02.836544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-08279502-7150-4bcf-afed-5329285987ab tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1552 microversion: 2.1 time: 0.415341 Jul 21 22:00:02.837179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 110/200] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:02 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1552 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:00:03.585331 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a3b64d3b-0b7d-42e5-bec9-522b001f4947 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:03.586064 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a3b64d3b-0b7d-42e5-bec9-522b001f4947 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:03.594043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3b64d3b-0b7d-42e5-bec9-522b001f4947 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:03.594608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3b64d3b-0b7d-42e5-bec9-522b001f4947 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:03.595491 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3b64d3b-0b7d-42e5-bec9-522b001f4947 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:03.595922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3b64d3b-0b7d-42e5-bec9-522b001f4947 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:03.738327 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a3b64d3b-0b7d-42e5-bec9-522b001f4947 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:03.741909 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:00:03.747200 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a3b64d3b-0b7d-42e5-bec9-522b001f4947 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.166053 Jul 21 22:00:03.747790 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 91/201] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:03 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:03.854702 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d240c9ba-e98f-4a95-af51-a0a82da0c26b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:03.855403 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d240c9ba-e98f-4a95-af51-a0a82da0c26b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:03.864383 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d240c9ba-e98f-4a95-af51-a0a82da0c26b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:03.864893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d240c9ba-e98f-4a95-af51-a0a82da0c26b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:03.865728 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d240c9ba-e98f-4a95-af51-a0a82da0c26b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:03.866160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d240c9ba-e98f-4a95-af51-a0a82da0c26b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:04.027347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d240c9ba-e98f-4a95-af51-a0a82da0c26b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:04.036224 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d240c9ba-e98f-4a95-af51-a0a82da0c26b tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1552 microversion: 2.1 time: 0.185258 Jul 21 22:00:04.036812 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 111/202] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:03 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1552 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:00:04.765271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9b8e3591-915c-4d1f-b3f3-8e9b9d628b49 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:04.765901 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9b8e3591-915c-4d1f-b3f3-8e9b9d628b49 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:04.775236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b8e3591-915c-4d1f-b3f3-8e9b9d628b49 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:04.775683 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b8e3591-915c-4d1f-b3f3-8e9b9d628b49 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:04.776460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b8e3591-915c-4d1f-b3f3-8e9b9d628b49 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:04.776907 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b8e3591-915c-4d1f-b3f3-8e9b9d628b49 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:04.910888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9b8e3591-915c-4d1f-b3f3-8e9b9d628b49 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:04.918797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9b8e3591-915c-4d1f-b3f3-8e9b9d628b49 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.157844 Jul 21 22:00:04.919640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 92/203] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:04 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:05.052986 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-81a87744-d7bc-47df-a0a9-f18ebc482693 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:05.054623 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-81a87744-d7bc-47df-a0a9-f18ebc482693 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:05.060548 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-81a87744-d7bc-47df-a0a9-f18ebc482693 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:05.061119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-81a87744-d7bc-47df-a0a9-f18ebc482693 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:05.062515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-81a87744-d7bc-47df-a0a9-f18ebc482693 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:05.063172 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-81a87744-d7bc-47df-a0a9-f18ebc482693 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:05.215993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-81a87744-d7bc-47df-a0a9-f18ebc482693 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:05.224543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-81a87744-d7bc-47df-a0a9-f18ebc482693 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1552 microversion: 2.1 time: 0.175252 Jul 21 22:00:05.225133 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 112/204] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:05 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:05.940483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4335704a-79ea-42d3-accf-0448143379a3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:05.941270 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4335704a-79ea-42d3-accf-0448143379a3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:05.948196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4335704a-79ea-42d3-accf-0448143379a3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:05.948749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4335704a-79ea-42d3-accf-0448143379a3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:05.949618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4335704a-79ea-42d3-accf-0448143379a3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:05.950404 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4335704a-79ea-42d3-accf-0448143379a3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:06.177298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4335704a-79ea-42d3-accf-0448143379a3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:06.190329 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4335704a-79ea-42d3-accf-0448143379a3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.254503 Jul 21 22:00:06.191851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 93/205] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:05 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:06.243860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6bb98e97-ab9c-4017-bfac-2aed9e733412 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:06.257438 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6bb98e97-ab9c-4017-bfac-2aed9e733412 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:06.274229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6bb98e97-ab9c-4017-bfac-2aed9e733412 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:06.276798 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6bb98e97-ab9c-4017-bfac-2aed9e733412 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:06.278306 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6bb98e97-ab9c-4017-bfac-2aed9e733412 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:06.278765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6bb98e97-ab9c-4017-bfac-2aed9e733412 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:06.384430 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6bb98e97-ab9c-4017-bfac-2aed9e733412 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:06.395318 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6bb98e97-ab9c-4017-bfac-2aed9e733412 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1510 microversion: 2.1 time: 0.157597 Jul 21 22:00:06.396121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 113/206] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:06 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:06.533289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-b81337b5-8f02-45d8-99e4-ede9b2f91149 req-e5d8b2a1-2e47-4882-8932-851cfd845002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2483e851-683c-4f95-9d9f-ade500d0ed0b", "name": "network-vif-deleted", "tag": "cb3c7a1b-b5c2-4104-abc2-9f28d71afdfb"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:00:06.541796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=78 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:00:06.544545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-b81337b5-8f02-45d8-99e4-ede9b2f91149 req-e5d8b2a1-2e47-4882-8932-851cfd845002 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:06.545213 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-b81337b5-8f02-45d8-99e4-ede9b2f91149 req-e5d8b2a1-2e47-4882-8932-851cfd845002 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:06.584024 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-b81337b5-8f02-45d8-99e4-ede9b2f91149 req-e5d8b2a1-2e47-4882-8932-851cfd845002 service nova] Creating event network-vif-deleted:cb3c7a1b-b5c2-4104-abc2-9f28d71afdfb for instance 2483e851-683c-4f95-9d9f-ade500d0ed0b on hv-cinder-82002 Jul 21 22:00:06.599577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-b81337b5-8f02-45d8-99e4-ede9b2f91149 req-e5d8b2a1-2e47-4882-8932-851cfd845002 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071878 Jul 21 22:00:06.600188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 94/207] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:00:07.209326 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9269b628-bbb1-4b27-bc12-a261743f19eb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:07.209931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9269b628-bbb1-4b27-bc12-a261743f19eb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:07.217395 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9269b628-bbb1-4b27-bc12-a261743f19eb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:07.217904 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9269b628-bbb1-4b27-bc12-a261743f19eb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:07.218673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9269b628-bbb1-4b27-bc12-a261743f19eb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:07.219432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9269b628-bbb1-4b27-bc12-a261743f19eb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:07.369632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9269b628-bbb1-4b27-bc12-a261743f19eb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:07.378420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9269b628-bbb1-4b27-bc12-a261743f19eb tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.172738 Jul 21 22:00:07.379131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 114/208] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:07 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:07.424568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4e2c9ad3-20a7-4a2e-9a00-b1b8353a3a29 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:07.426040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4e2c9ad3-20a7-4a2e-9a00-b1b8353a3a29 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:07.435433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4e2c9ad3-20a7-4a2e-9a00-b1b8353a3a29 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:07.437067 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4e2c9ad3-20a7-4a2e-9a00-b1b8353a3a29 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:07.438761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4e2c9ad3-20a7-4a2e-9a00-b1b8353a3a29 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:07.440025 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4e2c9ad3-20a7-4a2e-9a00-b1b8353a3a29 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:07.511235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4e2c9ad3-20a7-4a2e-9a00-b1b8353a3a29 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:07.523944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4e2c9ad3-20a7-4a2e-9a00-b1b8353a3a29 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1345 microversion: 2.1 time: 0.105540 Jul 21 22:00:07.524551 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 95/209] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:07 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:08.399392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-917a572a-43d3-470e-ab29-9c45eb7fb62f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:08.400041 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-917a572a-43d3-470e-ab29-9c45eb7fb62f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:08.421966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-917a572a-43d3-470e-ab29-9c45eb7fb62f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:08.423755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-917a572a-43d3-470e-ab29-9c45eb7fb62f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:08.424742 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-917a572a-43d3-470e-ab29-9c45eb7fb62f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:08.425373 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-917a572a-43d3-470e-ab29-9c45eb7fb62f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:08.542707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1f7c0115-5e16-4da8-bcd4-c267c004e64f tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:08.543629 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1f7c0115-5e16-4da8-bcd4-c267c004e64f tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:08.551386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f7c0115-5e16-4da8-bcd4-c267c004e64f tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:08.551837 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f7c0115-5e16-4da8-bcd4-c267c004e64f tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:08.552670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f7c0115-5e16-4da8-bcd4-c267c004e64f tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:08.553045 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f7c0115-5e16-4da8-bcd4-c267c004e64f tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:08.603837 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f7c0115-5e16-4da8-bcd4-c267c004e64f tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:08.604549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f7c0115-5e16-4da8-bcd4-c267c004e64f tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:08.605177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.objects.instance [None req-1f7c0115-5e16-4da8-bcd4-c267c004e64f tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lazy-loading 'fault' on Instance uuid 2483e851-683c-4f95-9d9f-ade500d0ed0b {{(pid=117979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:00:08.662098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1f7c0115-5e16-4da8-bcd4-c267c004e64f tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c8fcfca20c648fc941538445c84e795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119bfb06f994b23b28c3d7002535d3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:08.676250 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-917a572a-43d3-470e-ab29-9c45eb7fb62f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:08.677805 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1f7c0115-5e16-4da8-bcd4-c267c004e64f tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 200 len: 1350 microversion: 2.1 time: 0.138663 Jul 21 22:00:08.678418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 96/210] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:08 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:00:08.693489 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-917a572a-43d3-470e-ab29-9c45eb7fb62f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.297790 Jul 21 22:00:08.694393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 115/211] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:08 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:09.695856 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1324f040-121c-4981-8863-6bd3ebac011e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:09.697383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1324f040-121c-4981-8863-6bd3ebac011e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:09.705904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1324f040-121c-4981-8863-6bd3ebac011e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:09.706645 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1324f040-121c-4981-8863-6bd3ebac011e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:09.708129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1324f040-121c-4981-8863-6bd3ebac011e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:09.708795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1324f040-121c-4981-8863-6bd3ebac011e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:09.712141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-49d2f8d8-0b40-43b7-9a58-1df0915a8e5b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:09.712816 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-49d2f8d8-0b40-43b7-9a58-1df0915a8e5b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:09.724516 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-49d2f8d8-0b40-43b7-9a58-1df0915a8e5b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:09.724979 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-49d2f8d8-0b40-43b7-9a58-1df0915a8e5b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:09.726399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-49d2f8d8-0b40-43b7-9a58-1df0915a8e5b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:09.726909 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-49d2f8d8-0b40-43b7-9a58-1df0915a8e5b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:09.728742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-1324f040-121c-4981-8863-6bd3ebac011e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] HTTP exception thrown: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1324f040-121c-4981-8863-6bd3ebac011e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Request method failure captured: Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b HTTP/1.1 Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwlmZIsDwg4Y5UNIEDsgr0dgjZ6YXv183e7Fn6Jo1807PM62q3-vdD50S_2_wuO50LDrOtHOQEU5uhUqrFJ4S4VAlGH0FlWNCJSdBpwDZaTIEpKsUkEnzMpE2Xa_iZWGlOtp4LB6xbmfh-7vvPyOeeuTRdkeSefe6JoMJCFNSE5HNQ Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: b119bfb06f994b23b28c3d7002535d3c Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-DeleteServersTestJSON-422677256 Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:00:09.734796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:00:09.736134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b119bfb06f994b23b28c3d7002535d3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b119bfb06f994b23b28c3d7002535d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b119bfb06f994b23b28c3d7002535d3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b119bfb06f994b23b28c3d7002535d3c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:00:09.736134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-DeleteServersTestJSON-422677256 Jul 21 22:00:09.736134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: b119bfb06f994b23b28c3d7002535d3c Jul 21 22:00:09.736134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-DeleteServersTestJSON-422677256 Jul 21 22:00:09.736134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-DeleteServersTestJSON-422677256-project Jul 21 22:00:09.736134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:00:09.736134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:00:09.736134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 7c8fcfca20c648fc941538445c84e795 Jul 21 22:00:09.736134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-DeleteServersTestJSON-422677256-project Jul 21 22:00:09.736134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:00:09.736134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:09.736134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '2483e851-683c-4f95-9d9f-ade500d0ed0b'} Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:00:09.736870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:09.738017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:09.741919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1324f040-121c-4981-8863-6bd3ebac011e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Returning 404 to user: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:00:09.743080 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1324f040-121c-4981-8863-6bd3ebac011e tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 404 len: 111 microversion: 2.1 time: 0.052051 Jul 21 22:00:09.743871 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 97/212] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:09 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:00:09.931820 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f5406d6a-2fd0-45d4-9c85-d31e00596cb6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:09.933457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f5406d6a-2fd0-45d4-9c85-d31e00596cb6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:09.942770 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5406d6a-2fd0-45d4-9c85-d31e00596cb6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:09.943591 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5406d6a-2fd0-45d4-9c85-d31e00596cb6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:09.944606 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5406d6a-2fd0-45d4-9c85-d31e00596cb6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:09.945311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5406d6a-2fd0-45d4-9c85-d31e00596cb6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:09.974718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-f5406d6a-2fd0-45d4-9c85-d31e00596cb6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] HTTP exception thrown: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f5406d6a-2fd0-45d4-9c85-d31e00596cb6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Request method failure captured: Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b/os-volume_attachments HTTP/1.1 Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwlmZIsDwg4Y5UNIEDsgr0dgjZ6YXv183e7Fn6Jo1807PM62q3-vdD50S_2_wuO50LDrOtHOQEU5uhUqrFJ4S4VAlGH0FlWNCJSdBpwDZaTIEpKsUkEnzMpE2Xa_iZWGlOtp4LB6xbmfh-7vvPyOeeuTRdkeSefe6JoMJCFNSE5HNQ Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: b119bfb06f994b23b28c3d7002535d3c Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-DeleteServersTestJSON-422677256 Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:00:09.978550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:00:09.980541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b119bfb06f994b23b28c3d7002535d3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b119bfb06f994b23b28c3d7002535d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b119bfb06f994b23b28c3d7002535d3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b119bfb06f994b23b28c3d7002535d3c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:00:09.980541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-DeleteServersTestJSON-422677256 Jul 21 22:00:09.980541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: b119bfb06f994b23b28c3d7002535d3c Jul 21 22:00:09.980541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-DeleteServersTestJSON-422677256 Jul 21 22:00:09.980541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-DeleteServersTestJSON-422677256-project Jul 21 22:00:09.980541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:00:09.980541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:00:09.980541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 7c8fcfca20c648fc941538445c84e795 Jul 21 22:00:09.980541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-DeleteServersTestJSON-422677256-project Jul 21 22:00:09.980541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:00:09.980541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:09.980541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'server_id': '2483e851-683c-4f95-9d9f-ade500d0ed0b'} Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:00:09.981663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:09.985038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:09.988347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f5406d6a-2fd0-45d4-9c85-d31e00596cb6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Returning 404 to user: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:00:09.988347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f5406d6a-2fd0-45d4-9c85-d31e00596cb6 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.055521 Jul 21 22:00:09.992613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 98/213] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:00:09 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b/os-volume_attachments => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:00:10.034607 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-49d2f8d8-0b40-43b7-9a58-1df0915a8e5b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:10.057104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-49d2f8d8-0b40-43b7-9a58-1df0915a8e5b tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.349038 Jul 21 22:00:10.057722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 116/214] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:09 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:11.075283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9e50b094-4de4-4a32-838e-b2d5c77a589f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:11.076053 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9e50b094-4de4-4a32-838e-b2d5c77a589f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:11.091685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e50b094-4de4-4a32-838e-b2d5c77a589f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:11.092577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e50b094-4de4-4a32-838e-b2d5c77a589f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:11.093555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e50b094-4de4-4a32-838e-b2d5c77a589f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:11.094010 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e50b094-4de4-4a32-838e-b2d5c77a589f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:11.316988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-50a7feaa-b456-402c-ad6a-09f3a8a99ec5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:11.317602 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-50a7feaa-b456-402c-ad6a-09f3a8a99ec5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:11.324234 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-50a7feaa-b456-402c-ad6a-09f3a8a99ec5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:11.325220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-50a7feaa-b456-402c-ad6a-09f3a8a99ec5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:11.326191 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-50a7feaa-b456-402c-ad6a-09f3a8a99ec5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:11.326845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-50a7feaa-b456-402c-ad6a-09f3a8a99ec5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:11.343907 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-50a7feaa-b456-402c-ad6a-09f3a8a99ec5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] HTTP exception thrown: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-50a7feaa-b456-402c-ad6a-09f3a8a99ec5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Request method failure captured: Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b HTTP/1.1 Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwlmZIsDwg4Y5UNIEDsgr0dgjZ6YXv183e7Fn6Jo1807PM62q3-vdD50S_2_wuO50LDrOtHOQEU5uhUqrFJ4S4VAlGH0FlWNCJSdBpwDZaTIEpKsUkEnzMpE2Xa_iZWGlOtp4LB6xbmfh-7vvPyOeeuTRdkeSefe6JoMJCFNSE5HNQ Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: b119bfb06f994b23b28c3d7002535d3c Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-DeleteServersTestJSON-422677256 Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:00:11.350818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:00:11.352052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b119bfb06f994b23b28c3d7002535d3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b119bfb06f994b23b28c3d7002535d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b119bfb06f994b23b28c3d7002535d3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b119bfb06f994b23b28c3d7002535d3c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:00:11.352052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-DeleteServersTestJSON-422677256 Jul 21 22:00:11.352052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: b119bfb06f994b23b28c3d7002535d3c Jul 21 22:00:11.352052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-DeleteServersTestJSON-422677256 Jul 21 22:00:11.352052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-DeleteServersTestJSON-422677256-project Jul 21 22:00:11.352052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:00:11.352052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:00:11.352052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 7c8fcfca20c648fc941538445c84e795 Jul 21 22:00:11.352052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-DeleteServersTestJSON-422677256-project Jul 21 22:00:11.352052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:00:11.352052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:11.352052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': '2483e851-683c-4f95-9d9f-ade500d0ed0b'} Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:00:11.352695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:11.353722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:11.360362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9e50b094-4de4-4a32-838e-b2d5c77a589f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:11.365509 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-50a7feaa-b456-402c-ad6a-09f3a8a99ec5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Returning 404 to user: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:00:11.366401 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-50a7feaa-b456-402c-ad6a-09f3a8a99ec5 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "DELETE /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 404 len: 111 microversion: 2.1 time: 0.055443 Jul 21 22:00:11.369783 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 117/215] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:00:11 2022] DELETE /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:00:11.369911 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9e50b094-4de4-4a32-838e-b2d5c77a589f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.297843 Jul 21 22:00:11.370160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 99/216] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:11 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:11.375393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8beed0a1-c301-474a-958a-23e1aa5f11c8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:11.376004 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8beed0a1-c301-474a-958a-23e1aa5f11c8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] [instance: 2483e851-683c-4f95-9d9f-ade500d0ed0b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:11.382293 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8beed0a1-c301-474a-958a-23e1aa5f11c8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:11.382677 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8beed0a1-c301-474a-958a-23e1aa5f11c8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:11.383520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8beed0a1-c301-474a-958a-23e1aa5f11c8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:11.383925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8beed0a1-c301-474a-958a-23e1aa5f11c8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:11.397934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-8beed0a1-c301-474a-958a-23e1aa5f11c8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] HTTP exception thrown: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8beed0a1-c301-474a-958a-23e1aa5f11c8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Request method failure captured: Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b HTTP/1.1 Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwlmZIsDwg4Y5UNIEDsgr0dgjZ6YXv183e7Fn6Jo1807PM62q3-vdD50S_2_wuO50LDrOtHOQEU5uhUqrFJ4S4VAlGH0FlWNCJSdBpwDZaTIEpKsUkEnzMpE2Xa_iZWGlOtp4LB6xbmfh-7vvPyOeeuTRdkeSefe6JoMJCFNSE5HNQ Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: b119bfb06f994b23b28c3d7002535d3c Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-DeleteServersTestJSON-422677256 Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:00:11.399868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:00:11.401268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b119bfb06f994b23b28c3d7002535d3c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b119bfb06f994b23b28c3d7002535d3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b119bfb06f994b23b28c3d7002535d3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b119bfb06f994b23b28c3d7002535d3c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:00:11.401268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-DeleteServersTestJSON-422677256 Jul 21 22:00:11.401268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: b119bfb06f994b23b28c3d7002535d3c Jul 21 22:00:11.401268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-DeleteServersTestJSON-422677256 Jul 21 22:00:11.401268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-DeleteServersTestJSON-422677256-project Jul 21 22:00:11.401268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:00:11.401268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:00:11.401268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 7c8fcfca20c648fc941538445c84e795 Jul 21 22:00:11.401268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-DeleteServersTestJSON-422677256-project Jul 21 22:00:11.401268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:00:11.401268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:11.401268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': '2483e851-683c-4f95-9d9f-ade500d0ed0b'} Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:00:11.401988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. Jul 21 22:00:11.402995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:11.403956 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8beed0a1-c301-474a-958a-23e1aa5f11c8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] Returning 404 to user: Instance 2483e851-683c-4f95-9d9f-ade500d0ed0b could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:00:11.403956 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8beed0a1-c301-474a-958a-23e1aa5f11c8 tempest-DeleteServersTestJSON-422677256 tempest-DeleteServersTestJSON-422677256-project] 10.222.0.44 "GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b" status: 404 len: 111 microversion: 2.1 time: 0.029643 Jul 21 22:00:11.403956 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 118/217] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:11 2022] GET /compute/v2.1/servers/2483e851-683c-4f95-9d9f-ade500d0ed0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:00:12.386569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ae020e3d-d553-4981-ba42-4ae30f40e9a1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:12.388461 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ae020e3d-d553-4981-ba42-4ae30f40e9a1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:12.397281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae020e3d-d553-4981-ba42-4ae30f40e9a1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:12.398122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae020e3d-d553-4981-ba42-4ae30f40e9a1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:12.399146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae020e3d-d553-4981-ba42-4ae30f40e9a1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:12.399838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae020e3d-d553-4981-ba42-4ae30f40e9a1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:12.658817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ae020e3d-d553-4981-ba42-4ae30f40e9a1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:12.669759 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ae020e3d-d553-4981-ba42-4ae30f40e9a1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.287452 Jul 21 22:00:12.672394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 100/218] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:12 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:13.690747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1bbad129-9a49-4c65-948d-43deec6bf847 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:13.692023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1bbad129-9a49-4c65-948d-43deec6bf847 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:13.712884 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bbad129-9a49-4c65-948d-43deec6bf847 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:13.713907 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bbad129-9a49-4c65-948d-43deec6bf847 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:13.717122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bbad129-9a49-4c65-948d-43deec6bf847 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:13.719750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bbad129-9a49-4c65-948d-43deec6bf847 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:14.018153 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1bbad129-9a49-4c65-948d-43deec6bf847 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:14.035568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1bbad129-9a49-4c65-948d-43deec6bf847 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.350090 Jul 21 22:00:14.037774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 119/219] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:13 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:15.054422 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ed8ce737-51f2-4ab4-be36-e2f35fe6bba0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:15.055303 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ed8ce737-51f2-4ab4-be36-e2f35fe6bba0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:15.074875 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ed8ce737-51f2-4ab4-be36-e2f35fe6bba0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:15.075432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ed8ce737-51f2-4ab4-be36-e2f35fe6bba0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:15.076284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ed8ce737-51f2-4ab4-be36-e2f35fe6bba0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:15.076976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ed8ce737-51f2-4ab4-be36-e2f35fe6bba0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:15.329941 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ed8ce737-51f2-4ab4-be36-e2f35fe6bba0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:15.344527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ed8ce737-51f2-4ab4-be36-e2f35fe6bba0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.294653 Jul 21 22:00:15.345866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 101/220] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:15 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:16.362706 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-77296697-26f7-431a-b41a-f0d3a2f2ef36 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:16.363583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-77296697-26f7-431a-b41a-f0d3a2f2ef36 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:16.374572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77296697-26f7-431a-b41a-f0d3a2f2ef36 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:16.375044 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77296697-26f7-431a-b41a-f0d3a2f2ef36 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:16.375841 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77296697-26f7-431a-b41a-f0d3a2f2ef36 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:16.380207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77296697-26f7-431a-b41a-f0d3a2f2ef36 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:17.050929 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-77296697-26f7-431a-b41a-f0d3a2f2ef36 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:17.063184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-77296697-26f7-431a-b41a-f0d3a2f2ef36 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.704201 Jul 21 22:00:17.065657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 120/221] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:16 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:18.085579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dc4b3a59-49ad-4169-aa64-611bfab25475 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:18.086913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dc4b3a59-49ad-4169-aa64-611bfab25475 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:18.115137 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc4b3a59-49ad-4169-aa64-611bfab25475 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:18.115907 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc4b3a59-49ad-4169-aa64-611bfab25475 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:18.116951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc4b3a59-49ad-4169-aa64-611bfab25475 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:18.117968 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc4b3a59-49ad-4169-aa64-611bfab25475 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:18.366891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dc4b3a59-49ad-4169-aa64-611bfab25475 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:18.374864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dc4b3a59-49ad-4169-aa64-611bfab25475 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.296376 Jul 21 22:00:18.377407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 102/222] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:18 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:19.305677 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ea14cab9-ef95-4c67-b948-1da62f70ab4d tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Action: 'create', calling method: .version_select at 0x7faca200c160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-855346922", "metadata": {"Type": "work"}}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ea14cab9-ef95-4c67-b948-1da62f70ab4d tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Request method failure captured: Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 121 Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cxznwrRaCBLJl2bIthauK9GZZvRSwAThTRo8LBOjrPvI2B4PjfqU43es6C_F3iSDl01jY8fO1LD2znu1kHn_1W9AXUq4E-55LGOfD3ChUFcujAlpc51lV--SOHEeBZP7zQ58oH4G-WXVVfWhme-WjF77Z8lmDaXefJx3KFmtSuPsl0 Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 90a07d074e154398a15461a2465940bb Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:00:19.341912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:00:19.343532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90a07d074e154398a15461a2465940bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90a07d074e154398a15461a2465940bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/90a07d074e154398a15461a2465940bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_90a07d074e154398a15461a2465940bb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:00:19.343532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.343532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 90a07d074e154398a15461a2465940bb Jul 21 22:00:19.343532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.343532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesNegativeTest-2107674956-project Jul 21 22:00:19.343532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:00:19.343532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:00:19.343532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: e14076d5d2894e608a94d9fc3c7914af Jul 21 22:00:19.343532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesNegativeTest-2107674956-project Jul 21 22:00:19.343532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Jul 21 22:00:19.343532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-855346922", "metadata": {"Type": "work"}}} Jul 21 22:00:19.343532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: Jul 21 22:00:19.343532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-855346922', 'metadata': {'Type': 'work'}}}} Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise error Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi '#$%' Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:00:19.344288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 22:00:19.345521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 22:00:19.346642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 21 22:00:19.346642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.346642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ea14cab9-ef95-4c67-b948-1da62f70ab4d tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:00:19.346642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ea14cab9-ef95-4c67-b948-1da62f70ab4d tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.194405 Jul 21 22:00:19.346642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 121/223] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jul 21 22:00:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:00:19.355792 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3e64e891-7eb8-4085-860b-7394da13ef54 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Action: 'create', calling method: .version_select at 0x7faca3174280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-83252193", "metadata": {"Type": "work"}}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3e64e891-7eb8-4085-860b-7394da13ef54 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Request method failure captured: Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 118 Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cxznwrRaCBLJl2bIthauK9GZZvRSwAThTRo8LBOjrPvI2B4PjfqU43es6C_F3iSDl01jY8fO1LD2znu1kHn_1W9AXUq4E-55LGOfD3ChUFcujAlpc51lV--SOHEeBZP7zQ58oH4G-WXVVfWhme-WjF77Z8lmDaXefJx3KFmtSuPsl0 Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 90a07d074e154398a15461a2465940bb Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:00:19.360090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:00:19.361239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90a07d074e154398a15461a2465940bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90a07d074e154398a15461a2465940bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/90a07d074e154398a15461a2465940bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_90a07d074e154398a15461a2465940bb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:00:19.361239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.361239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 90a07d074e154398a15461a2465940bb Jul 21 22:00:19.361239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.361239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-VolumesNegativeTest-2107674956-project Jul 21 22:00:19.361239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:00:19.361239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:00:19.361239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: e14076d5d2894e608a94d9fc3c7914af Jul 21 22:00:19.361239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-VolumesNegativeTest-2107674956-project Jul 21 22:00:19.361239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Jul 21 22:00:19.361239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-83252193", "metadata": {"Type": "work"}}} Jul 21 22:00:19.361239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: Jul 21 22:00:19.361239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-83252193', 'metadata': {'Type': 'work'}}}} Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise error Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi '0' Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:00:19.361944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 22:00:19.363681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 22:00:19.364698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 21 22:00:19.364698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.364698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3e64e891-7eb8-4085-860b-7394da13ef54 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:00:19.364698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3e64e891-7eb8-4085-860b-7394da13ef54 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010352 Jul 21 22:00:19.364698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 103/224] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jul 21 22:00:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:00:19.371518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-75b58223-9c4f-4401-83ac-c2f243c11da4 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Action: 'create', calling method: .version_select at 0x7faca2143430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-281092488", "metadata": {"Type": "work"}}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-75b58223-9c4f-4401-83ac-c2f243c11da4 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Request method failure captured: Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 118 Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cxznwrRaCBLJl2bIthauK9GZZvRSwAThTRo8LBOjrPvI2B4PjfqU43es6C_F3iSDl01jY8fO1LD2znu1kHn_1W9AXUq4E-55LGOfD3ChUFcujAlpc51lV--SOHEeBZP7zQ58oH4G-WXVVfWhme-WjF77Z8lmDaXefJx3KFmtSuPsl0 Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 90a07d074e154398a15461a2465940bb Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:00:19.374621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:00:19.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90a07d074e154398a15461a2465940bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90a07d074e154398a15461a2465940bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/90a07d074e154398a15461a2465940bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_90a07d074e154398a15461a2465940bb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:00:19.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 90a07d074e154398a15461a2465940bb Jul 21 22:00:19.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesNegativeTest-2107674956-project Jul 21 22:00:19.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:00:19.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:00:19.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: e14076d5d2894e608a94d9fc3c7914af Jul 21 22:00:19.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesNegativeTest-2107674956-project Jul 21 22:00:19.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Jul 21 22:00:19.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-281092488", "metadata": {"Type": "work"}}} Jul 21 22:00:19.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: Jul 21 22:00:19.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-281092488', 'metadata': {'Type': 'work'}}}} Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise error Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi '' Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:00:19.379500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 21 22:00:19.382474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 21 22:00:19.385099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 21 22:00:19.385099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.385099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-75b58223-9c4f-4401-83ac-c2f243c11da4 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:00:19.385099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-75b58223-9c4f-4401-83ac-c2f243c11da4 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008476 Jul 21 22:00:19.385099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 122/225] 10.222.0.44 () {60 vars in 1155 bytes} [Thu Jul 21 22:00:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:00:19.386443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fce7ef75-ab96-4c77-8ca8-19a7e306c876 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Calling method '.version_select at 0x7faca31ba790>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:19.394702 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-99333e18-07e0-4908-ab36-538756758f0e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:19.398472 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-99333e18-07e0-4908-ab36-538756758f0e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:19.401875 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99333e18-07e0-4908-ab36-538756758f0e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:19.402339 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99333e18-07e0-4908-ab36-538756758f0e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:19.403352 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99333e18-07e0-4908-ab36-538756758f0e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:19.403800 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99333e18-07e0-4908-ab36-538756758f0e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:19.442649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-fce7ef75-ab96-4c77-8ca8-19a7e306c876 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] HTTP exception thrown: Volume tempest-invalid-1597599020 could not be found. Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fce7ef75-ab96-4c77-8ca8-19a7e306c876 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Request method failure captured: Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1597599020 HTTP/1.1 Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cxznwrRaCBLJl2bIthauK9GZZvRSwAThTRo8LBOjrPvI2B4PjfqU43es6C_F3iSDl01jY8fO1LD2znu1kHn_1W9AXUq4E-55LGOfD3ChUFcujAlpc51lV--SOHEeBZP7zQ58oH4G-WXVVfWhme-WjF77Z8lmDaXefJx3KFmtSuPsl0 Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 90a07d074e154398a15461a2465940bb Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:00:19.446115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:00:19.447795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90a07d074e154398a15461a2465940bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90a07d074e154398a15461a2465940bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/90a07d074e154398a15461a2465940bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_90a07d074e154398a15461a2465940bb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:00:19.447795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.447795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 90a07d074e154398a15461a2465940bb Jul 21 22:00:19.447795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.447795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-VolumesNegativeTest-2107674956-project Jul 21 22:00:19.447795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:00:19.447795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:00:19.447795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: e14076d5d2894e608a94d9fc3c7914af Jul 21 22:00:19.447795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-VolumesNegativeTest-2107674956-project Jul 21 22:00:19.447795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: Jul 21 22:00:19.447795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Volume tempest-invalid-1597599020 could not be found. Jul 21 22:00:19.447795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': 'tempest-invalid-1597599020'} Jul 21 22:00:19.447795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1597599020 could not be found. (HTTP 404) (Request-ID: req-df1cb5f5-ad1f-46ed-80c5-0248666dbc18) Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.448521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:00:19.449540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1597599020 could not be found. Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:00:19.450525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1597599020 could not be found. Jul 21 22:00:19.455394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.455394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.455394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.455394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.455394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:19.455394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:19.455394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:00:19.455394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:00:19.455394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1597599020 could not be found. Jul 21 22:00:19.455394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.455394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fce7ef75-ab96-4c77-8ca8-19a7e306c876 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Returning 404 to user: Volume tempest-invalid-1597599020 could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:00:19.455394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fce7ef75-ab96-4c77-8ca8-19a7e306c876 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1597599020" status: 404 len: 99 microversion: 2.1 time: 0.066099 Jul 21 22:00:19.455394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 104/226] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jul 21 22:00:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1597599020 => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 21 22:00:19.459944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-afec2e8c-4c76-481b-9b42-b8d74eeafe8e tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003870 Jul 21 22:00:19.460138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 105/227] 10.222.0.44 () {58 vars in 1139 bytes} [Thu Jul 21 22:00:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 22:00:19.470097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-52a094d7-dd39-4b0e-88c2-5a45540c8190 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004524 Jul 21 22:00:19.470793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 106/228] 10.222.0.44 () {58 vars in 1136 bytes} [Thu Jul 21 22:00:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 21 22:00:19.488172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5b8bae72-c391-4ff6-9da0-4e2de57be21c tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Calling method '.version_select at 0x7faca3174940>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:19.521269 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-5b8bae72-c391-4ff6-9da0-4e2de57be21c tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] HTTP exception thrown: Volume 2d3d6171-f15e-45fa-8a90-8eaebdc207d5 could not be found. Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5b8bae72-c391-4ff6-9da0-4e2de57be21c tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Request method failure captured: Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: DELETE /compute/v2.1/os-volumes/2d3d6171-f15e-45fa-8a90-8eaebdc207d5 HTTP/1.1 Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cxznwrRaCBLJl2bIthauK9GZZvRSwAThTRo8LBOjrPvI2B4PjfqU43es6C_F3iSDl01jY8fO1LD2znu1kHn_1W9AXUq4E-55LGOfD3ChUFcujAlpc51lV--SOHEeBZP7zQ58oH4G-WXVVfWhme-WjF77Z8lmDaXefJx3KFmtSuPsl0 Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 90a07d074e154398a15461a2465940bb Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:00:19.523866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:00:19.525305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90a07d074e154398a15461a2465940bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90a07d074e154398a15461a2465940bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/90a07d074e154398a15461a2465940bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_90a07d074e154398a15461a2465940bb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:00:19.525305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.525305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 90a07d074e154398a15461a2465940bb Jul 21 22:00:19.525305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.525305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-VolumesNegativeTest-2107674956-project Jul 21 22:00:19.525305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:00:19.525305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:00:19.525305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: e14076d5d2894e608a94d9fc3c7914af Jul 21 22:00:19.525305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-VolumesNegativeTest-2107674956-project Jul 21 22:00:19.525305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: Jul 21 22:00:19.525305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Volume 2d3d6171-f15e-45fa-8a90-8eaebdc207d5 could not be found. Jul 21 22:00:19.525305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '2d3d6171-f15e-45fa-8a90-8eaebdc207d5'} Jul 21 22:00:19.525305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d3d6171-f15e-45fa-8a90-8eaebdc207d5 could not be found. (HTTP 404) (Request-ID: req-d8cc04dc-342f-446f-8679-29c182617c13) Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.526172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 21 22:00:19.527279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d3d6171-f15e-45fa-8a90-8eaebdc207d5 could not be found. Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 21 22:00:19.528447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:00:19.530194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d3d6171-f15e-45fa-8a90-8eaebdc207d5 could not be found. Jul 21 22:00:19.530194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.530194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.530194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.530194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.530194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:19.530194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:19.530194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:00:19.530194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:00:19.530194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d3d6171-f15e-45fa-8a90-8eaebdc207d5 could not be found. Jul 21 22:00:19.530194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.533138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5b8bae72-c391-4ff6-9da0-4e2de57be21c tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Returning 404 to user: Volume 2d3d6171-f15e-45fa-8a90-8eaebdc207d5 could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:00:19.533138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5b8bae72-c391-4ff6-9da0-4e2de57be21c tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/2d3d6171-f15e-45fa-8a90-8eaebdc207d5" status: 404 len: 109 microversion: 2.1 time: 0.051562 Jul 21 22:00:19.533138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 107/229] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 22:00:19 2022] DELETE /compute/v2.1/os-volumes/2d3d6171-f15e-45fa-8a90-8eaebdc207d5 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:00:19.543093 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d76ff68c-f7cf-4f39-b197-acd5a9fde4e9 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Calling method '.version_select at 0x7faca30b8d30>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:19.571690 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-99333e18-07e0-4908-ab36-538756758f0e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:19.576609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-d76ff68c-f7cf-4f39-b197-acd5a9fde4e9 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] HTTP exception thrown: Volume 6581592c-6f7f-448b-b17f-04d3b085cb39 could not be found. Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d76ff68c-f7cf-4f39-b197-acd5a9fde4e9 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Request method failure captured: Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/os-volumes/6581592c-6f7f-448b-b17f-04d3b085cb39 HTTP/1.1 Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cxznwrRaCBLJl2bIthauK9GZZvRSwAThTRo8LBOjrPvI2B4PjfqU43es6C_F3iSDl01jY8fO1LD2znu1kHn_1W9AXUq4E-55LGOfD3ChUFcujAlpc51lV--SOHEeBZP7zQ58oH4G-WXVVfWhme-WjF77Z8lmDaXefJx3KFmtSuPsl0 Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 90a07d074e154398a15461a2465940bb Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:00:19.579233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:00:19.580835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90a07d074e154398a15461a2465940bb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/90a07d074e154398a15461a2465940bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/90a07d074e154398a15461a2465940bb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_90a07d074e154398a15461a2465940bb", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:00:19.580835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.580835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 90a07d074e154398a15461a2465940bb Jul 21 22:00:19.580835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-VolumesNegativeTest-2107674956 Jul 21 22:00:19.580835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-VolumesNegativeTest-2107674956-project Jul 21 22:00:19.580835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:00:19.580835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:00:19.580835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: e14076d5d2894e608a94d9fc3c7914af Jul 21 22:00:19.580835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-VolumesNegativeTest-2107674956-project Jul 21 22:00:19.580835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: Jul 21 22:00:19.580835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Volume 6581592c-6f7f-448b-b17f-04d3b085cb39 could not be found. Jul 21 22:00:19.580835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '6581592c-6f7f-448b-b17f-04d3b085cb39'} Jul 21 22:00:19.580835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6581592c-6f7f-448b-b17f-04d3b085cb39 could not be found. (HTTP 404) (Request-ID: req-6805aa66-89af-4959-b0c1-d7dda39a7da1) Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.581702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 21 22:00:19.583447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6581592c-6f7f-448b-b17f-04d3b085cb39 could not be found. Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 21 22:00:19.584717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:00:19.585781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6581592c-6f7f-448b-b17f-04d3b085cb39 could not be found. Jul 21 22:00:19.585781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.585781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:19.585781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.585781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:19.585781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:19.585781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:19.585781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:00:19.585781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:00:19.585781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6581592c-6f7f-448b-b17f-04d3b085cb39 could not be found. Jul 21 22:00:19.585781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:00:19.589083 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d76ff68c-f7cf-4f39-b197-acd5a9fde4e9 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] Returning 404 to user: Volume 6581592c-6f7f-448b-b17f-04d3b085cb39 could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:00:19.589083 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d76ff68c-f7cf-4f39-b197-acd5a9fde4e9 tempest-VolumesNegativeTest-2107674956 tempest-VolumesNegativeTest-2107674956-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/6581592c-6f7f-448b-b17f-04d3b085cb39" status: 404 len: 109 microversion: 2.1 time: 0.049985 Jul 21 22:00:19.589083 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 108/230] 10.222.0.44 () {58 vars in 1244 bytes} [Thu Jul 21 22:00:19 2022] GET /compute/v2.1/os-volumes/6581592c-6f7f-448b-b17f-04d3b085cb39 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:00:19.611045 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-99333e18-07e0-4908-ab36-538756758f0e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.220009 Jul 21 22:00:19.611787 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 123/231] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:19 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:00:20.629896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e7c2ab56-beb9-4e3e-8833-a35fece5d842 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:20.631589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e7c2ab56-beb9-4e3e-8833-a35fece5d842 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:20.639878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e7c2ab56-beb9-4e3e-8833-a35fece5d842 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:20.641446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e7c2ab56-beb9-4e3e-8833-a35fece5d842 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:20.642589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e7c2ab56-beb9-4e3e-8833-a35fece5d842 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:20.643263 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e7c2ab56-beb9-4e3e-8833-a35fece5d842 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:20.818207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e7c2ab56-beb9-4e3e-8833-a35fece5d842 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:20.828206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e7c2ab56-beb9-4e3e-8833-a35fece5d842 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.202336 Jul 21 22:00:20.829728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 109/232] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:20 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:21.769288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ad243ce4-e2b2-4ea2-8375-74811a5ae04c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Action: 'create', calling method: .version_select at 0x7faca200cee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2015823344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxv+KBYyxRPnl3JEvJiK/UflK4RHagnFW4uQ/gzptTcL9rOITkuBXeyLR43UuL0ve5Y8PB5frYvU8gtj5ikabwgL9Nl2rXr/ccx8l7v47NXJ0RJQcIncFTQwwZ0t5ivmw=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:00:21.792485 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-ad243ce4-e2b2-4ea2-8375-74811a5ae04c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Getting quotas for project 70b0dd669508462c8302c8107bb0f5f0. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:00:21.798891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-ad243ce4-e2b2-4ea2-8375-74811a5ae04c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Getting quotas for user d019ca1630544a14b0170e2c873012a3 and project 70b0dd669508462c8302c8107bb0f5f0. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:00:21.829582 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ad243ce4-e2b2-4ea2-8375-74811a5ae04c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.424443 Jul 21 22:00:21.830814 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 124/233] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 22:00:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:00:21.850043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-86532af5-3d8f-4e40-bf2e-7b566e27cbc0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:21.850672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-86532af5-3d8f-4e40-bf2e-7b566e27cbc0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:21.859089 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86532af5-3d8f-4e40-bf2e-7b566e27cbc0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:21.859739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86532af5-3d8f-4e40-bf2e-7b566e27cbc0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:21.860553 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86532af5-3d8f-4e40-bf2e-7b566e27cbc0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:21.862892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86532af5-3d8f-4e40-bf2e-7b566e27cbc0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:22.109088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-86532af5-3d8f-4e40-bf2e-7b566e27cbc0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:22.128867 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-86532af5-3d8f-4e40-bf2e-7b566e27cbc0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1522 microversion: 2.1 time: 0.285503 Jul 21 22:00:22.140116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 110/234] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:21 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:23.147187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8addfc39-6ae6-4702-bae1-cd99227111ec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:23.148393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8addfc39-6ae6-4702-bae1-cd99227111ec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:23.156210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8addfc39-6ae6-4702-bae1-cd99227111ec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:23.156664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8addfc39-6ae6-4702-bae1-cd99227111ec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:23.157467 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8addfc39-6ae6-4702-bae1-cd99227111ec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:23.157910 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8addfc39-6ae6-4702-bae1-cd99227111ec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:23.347543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8addfc39-6ae6-4702-bae1-cd99227111ec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:23.358125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8addfc39-6ae6-4702-bae1-cd99227111ec tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1502 microversion: 2.1 time: 0.214486 Jul 21 22:00:23.359773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 125/235] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:23 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1502 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:23.375497 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-77001cf0-e568-4c99-aba0-3a88c6d3f8f6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:23.376514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-77001cf0-e568-4c99-aba0-3a88c6d3f8f6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:23.386344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77001cf0-e568-4c99-aba0-3a88c6d3f8f6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:23.387107 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77001cf0-e568-4c99-aba0-3a88c6d3f8f6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:23.388120 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77001cf0-e568-4c99-aba0-3a88c6d3f8f6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:23.388824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77001cf0-e568-4c99-aba0-3a88c6d3f8f6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:23.646549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-77001cf0-e568-4c99-aba0-3a88c6d3f8f6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:23.663361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-77001cf0-e568-4c99-aba0-3a88c6d3f8f6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1514 microversion: 2.1 time: 0.292167 Jul 21 22:00:23.664253 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 111/236] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:23 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1514 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:25.338964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-df3d6388-1e68-4213-8273-8306d1e2cf74 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:00:25.345860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-df3d6388-1e68-4213-8273-8306d1e2cf74 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:25.357057 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df3d6388-1e68-4213-8273-8306d1e2cf74 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:25.358434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df3d6388-1e68-4213-8273-8306d1e2cf74 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:25.360671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df3d6388-1e68-4213-8273-8306d1e2cf74 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:25.361720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df3d6388-1e68-4213-8273-8306d1e2cf74 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:25.406497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-df3d6388-1e68-4213-8273-8306d1e2cf74 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lazy-loading 'flavor' on Instance uuid bed6c5da-065f-40bc-9f21-154eda67c27a {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:00:25.507418 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-df3d6388-1e68-4213-8273-8306d1e2cf74 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "POST /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a/action" status: 200 len: 32 microversion: 2.1 time: 0.174943 Jul 21 22:00:25.508352 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 126/237] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 22:00:25 2022] POST /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:00:25.525556 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-992789d1-05f8-4089-8220-536228e4811d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:25.527475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-992789d1-05f8-4089-8220-536228e4811d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:25.535861 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-992789d1-05f8-4089-8220-536228e4811d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:25.536828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-992789d1-05f8-4089-8220-536228e4811d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:25.537844 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-992789d1-05f8-4089-8220-536228e4811d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:25.538365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-992789d1-05f8-4089-8220-536228e4811d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:25.770320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-992789d1-05f8-4089-8220-536228e4811d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:25.780022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-992789d1-05f8-4089-8220-536228e4811d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.260000 Jul 21 22:00:25.780707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 112/238] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:25 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:26.808769 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2e3e55b4-89bc-4555-8dc7-ade7bb4f830f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:26.810888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2e3e55b4-89bc-4555-8dc7-ade7bb4f830f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:26.823087 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e3e55b4-89bc-4555-8dc7-ade7bb4f830f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:26.823802 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e3e55b4-89bc-4555-8dc7-ade7bb4f830f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:26.825105 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e3e55b4-89bc-4555-8dc7-ade7bb4f830f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:26.825897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e3e55b4-89bc-4555-8dc7-ade7bb4f830f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:27.028973 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2e3e55b4-89bc-4555-8dc7-ade7bb4f830f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:27.041851 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2e3e55b4-89bc-4555-8dc7-ade7bb4f830f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.244062 Jul 21 22:00:27.042704 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 127/239] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:26 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:00:28.063715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-32090f55-b8ac-4d0d-a2a8-389f7898670d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:28.064286 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-32090f55-b8ac-4d0d-a2a8-389f7898670d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:28.070839 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32090f55-b8ac-4d0d-a2a8-389f7898670d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:28.071353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32090f55-b8ac-4d0d-a2a8-389f7898670d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:28.072164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32090f55-b8ac-4d0d-a2a8-389f7898670d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:28.072643 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32090f55-b8ac-4d0d-a2a8-389f7898670d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:28.239670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-32090f55-b8ac-4d0d-a2a8-389f7898670d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:28.249071 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-32090f55-b8ac-4d0d-a2a8-389f7898670d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.189595 Jul 21 22:00:28.250050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 113/240] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:28 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:29.267424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7aad8717-e4b4-4206-8dda-5c3b166540f5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:29.268054 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7aad8717-e4b4-4206-8dda-5c3b166540f5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:29.275143 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7aad8717-e4b4-4206-8dda-5c3b166540f5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:29.275626 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7aad8717-e4b4-4206-8dda-5c3b166540f5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:29.276649 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7aad8717-e4b4-4206-8dda-5c3b166540f5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:29.277254 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7aad8717-e4b4-4206-8dda-5c3b166540f5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:29.430853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7aad8717-e4b4-4206-8dda-5c3b166540f5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:29.439613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7aad8717-e4b4-4206-8dda-5c3b166540f5 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.176404 Jul 21 22:00:29.451263 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 128/241] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:29 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:30.460246 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5623dd06-49ae-40fa-a96b-23604ed7af13 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:30.461291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5623dd06-49ae-40fa-a96b-23604ed7af13 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:30.468278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5623dd06-49ae-40fa-a96b-23604ed7af13 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:30.468735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5623dd06-49ae-40fa-a96b-23604ed7af13 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:30.469517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5623dd06-49ae-40fa-a96b-23604ed7af13 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:30.469950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5623dd06-49ae-40fa-a96b-23604ed7af13 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:30.620340 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5623dd06-49ae-40fa-a96b-23604ed7af13 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:30.628146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5623dd06-49ae-40fa-a96b-23604ed7af13 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.171614 Jul 21 22:00:30.628731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 114/242] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:30 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:31.645714 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7bc8fb9e-aba0-4625-aaf4-a11a9e34460f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:31.646481 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7bc8fb9e-aba0-4625-aaf4-a11a9e34460f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:31.652638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7bc8fb9e-aba0-4625-aaf4-a11a9e34460f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:31.653086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7bc8fb9e-aba0-4625-aaf4-a11a9e34460f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:31.654527 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7bc8fb9e-aba0-4625-aaf4-a11a9e34460f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:31.655119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7bc8fb9e-aba0-4625-aaf4-a11a9e34460f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:31.804034 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7bc8fb9e-aba0-4625-aaf4-a11a9e34460f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:31.806367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:00:31.808230 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:00:31.813597 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7bc8fb9e-aba0-4625-aaf4-a11a9e34460f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.171625 Jul 21 22:00:31.814195 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 129/243] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:31 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:32.831088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-91a1b50a-096e-4778-b18c-2142268438f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:32.831706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-91a1b50a-096e-4778-b18c-2142268438f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:32.838325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91a1b50a-096e-4778-b18c-2142268438f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:32.838820 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91a1b50a-096e-4778-b18c-2142268438f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:32.839646 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91a1b50a-096e-4778-b18c-2142268438f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:32.840092 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91a1b50a-096e-4778-b18c-2142268438f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:33.043199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-91a1b50a-096e-4778-b18c-2142268438f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:33.052094 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-91a1b50a-096e-4778-b18c-2142268438f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.225447 Jul 21 22:00:33.052676 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 115/244] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:32 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:34.069581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-53b57d41-6737-4597-8d39-ba2612cfc39a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:34.070195 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-53b57d41-6737-4597-8d39-ba2612cfc39a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:34.072252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:00:34.079254 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53b57d41-6737-4597-8d39-ba2612cfc39a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:34.079712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53b57d41-6737-4597-8d39-ba2612cfc39a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:34.080499 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53b57d41-6737-4597-8d39-ba2612cfc39a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:34.080946 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53b57d41-6737-4597-8d39-ba2612cfc39a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:34.228184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-53b57d41-6737-4597-8d39-ba2612cfc39a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:34.237356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-53b57d41-6737-4597-8d39-ba2612cfc39a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.172207 Jul 21 22:00:34.241207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 130/245] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:34 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:35.254900 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-467b62fd-9036-49e9-88dd-02810532ccb3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:35.255718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-467b62fd-9036-49e9-88dd-02810532ccb3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:35.262490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-467b62fd-9036-49e9-88dd-02810532ccb3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:35.262944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-467b62fd-9036-49e9-88dd-02810532ccb3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:35.264545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-467b62fd-9036-49e9-88dd-02810532ccb3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:35.264799 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-467b62fd-9036-49e9-88dd-02810532ccb3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:35.267854 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=99 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:00:35.425579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-467b62fd-9036-49e9-88dd-02810532ccb3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:35.433542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-467b62fd-9036-49e9-88dd-02810532ccb3 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.182440 Jul 21 22:00:35.434131 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 116/246] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:35 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:36.452092 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-435aff73-9ed3-407a-9fdf-98f38fad778d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:36.452701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-435aff73-9ed3-407a-9fdf-98f38fad778d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:36.458826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-435aff73-9ed3-407a-9fdf-98f38fad778d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:36.459337 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-435aff73-9ed3-407a-9fdf-98f38fad778d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:36.460100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-435aff73-9ed3-407a-9fdf-98f38fad778d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:36.460534 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-435aff73-9ed3-407a-9fdf-98f38fad778d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:36.614910 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-435aff73-9ed3-407a-9fdf-98f38fad778d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:36.626680 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-435aff73-9ed3-407a-9fdf-98f38fad778d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.178756 Jul 21 22:00:36.627955 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 131/247] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:36 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:37.644509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4ccd9ec4-88c0-4bc3-a4d2-3308534adc35 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:37.645248 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4ccd9ec4-88c0-4bc3-a4d2-3308534adc35 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:37.648047 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=36 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:00:37.654561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ccd9ec4-88c0-4bc3-a4d2-3308534adc35 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:37.655401 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ccd9ec4-88c0-4bc3-a4d2-3308534adc35 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:37.656751 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ccd9ec4-88c0-4bc3-a4d2-3308534adc35 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:37.657420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ccd9ec4-88c0-4bc3-a4d2-3308534adc35 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:37.814332 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4ccd9ec4-88c0-4bc3-a4d2-3308534adc35 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:37.828814 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4ccd9ec4-88c0-4bc3-a4d2-3308534adc35 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.188096 Jul 21 22:00:37.829414 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 117/248] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:37 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:38.846567 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4019f7fe-cbca-4805-9d74-7c2afabc0bed tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:38.847370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4019f7fe-cbca-4805-9d74-7c2afabc0bed tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:38.857584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4019f7fe-cbca-4805-9d74-7c2afabc0bed tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:38.858436 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4019f7fe-cbca-4805-9d74-7c2afabc0bed tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:38.859204 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4019f7fe-cbca-4805-9d74-7c2afabc0bed tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:38.859666 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4019f7fe-cbca-4805-9d74-7c2afabc0bed tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:39.035356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4019f7fe-cbca-4805-9d74-7c2afabc0bed tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:39.063711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4019f7fe-cbca-4805-9d74-7c2afabc0bed tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.221300 Jul 21 22:00:39.064480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 132/249] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:38 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:40.080774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b08202bc-70e3-411f-8e2e-f58da0374821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:40.081534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b08202bc-70e3-411f-8e2e-f58da0374821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:40.088145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b08202bc-70e3-411f-8e2e-f58da0374821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:40.088762 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b08202bc-70e3-411f-8e2e-f58da0374821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:40.089552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b08202bc-70e3-411f-8e2e-f58da0374821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:40.089988 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b08202bc-70e3-411f-8e2e-f58da0374821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:40.255549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b08202bc-70e3-411f-8e2e-f58da0374821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:40.268145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b08202bc-70e3-411f-8e2e-f58da0374821 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.190917 Jul 21 22:00:40.269106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 118/250] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:40 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:41.294168 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5330e489-a234-4068-a250-7826166043e9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:41.295172 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5330e489-a234-4068-a250-7826166043e9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:41.301251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5330e489-a234-4068-a250-7826166043e9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:41.301701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5330e489-a234-4068-a250-7826166043e9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:41.302464 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5330e489-a234-4068-a250-7826166043e9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:41.302898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5330e489-a234-4068-a250-7826166043e9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:41.441420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5330e489-a234-4068-a250-7826166043e9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:41.449374 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5330e489-a234-4068-a250-7826166043e9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.159719 Jul 21 22:00:41.449994 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 133/251] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:41 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:42.470170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0b0d07b9-21b1-436d-8635-06be095d54fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:42.470826 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0b0d07b9-21b1-436d-8635-06be095d54fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:42.477744 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b0d07b9-21b1-436d-8635-06be095d54fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:42.478236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b0d07b9-21b1-436d-8635-06be095d54fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:42.479051 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b0d07b9-21b1-436d-8635-06be095d54fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:42.479482 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b0d07b9-21b1-436d-8635-06be095d54fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:42.613715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0b0d07b9-21b1-436d-8635-06be095d54fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:42.621476 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0b0d07b9-21b1-436d-8635-06be095d54fa tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.158020 Jul 21 22:00:42.622091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 119/252] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:42 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:43.638084 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ecb817e7-6a42-4d78-945d-9a5b8ff89780 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:43.638780 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ecb817e7-6a42-4d78-945d-9a5b8ff89780 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:43.645393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ecb817e7-6a42-4d78-945d-9a5b8ff89780 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:43.645849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ecb817e7-6a42-4d78-945d-9a5b8ff89780 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:43.646642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ecb817e7-6a42-4d78-945d-9a5b8ff89780 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:43.647186 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ecb817e7-6a42-4d78-945d-9a5b8ff89780 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:43.806377 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ecb817e7-6a42-4d78-945d-9a5b8ff89780 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:43.814643 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ecb817e7-6a42-4d78-945d-9a5b8ff89780 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.180396 Jul 21 22:00:43.815311 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 134/253] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:43 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:44.831634 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c59157e7-bddd-4359-b620-d72e72b9e1ef tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:44.832246 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c59157e7-bddd-4359-b620-d72e72b9e1ef tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:44.838986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c59157e7-bddd-4359-b620-d72e72b9e1ef tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:44.839451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c59157e7-bddd-4359-b620-d72e72b9e1ef tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:44.840230 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c59157e7-bddd-4359-b620-d72e72b9e1ef tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:44.840665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c59157e7-bddd-4359-b620-d72e72b9e1ef tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:44.998261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c59157e7-bddd-4359-b620-d72e72b9e1ef tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:45.006571 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c59157e7-bddd-4359-b620-d72e72b9e1ef tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1500 microversion: 2.1 time: 0.178720 Jul 21 22:00:45.007499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 120/254] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:44 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1500 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:45.023403 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-79a0b42b-be68-4133-bfc2-6ab2514dcb76 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24c997b8-f650-4fe9-9a2f-3b0da1e2bc81"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:00:45.024532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-79a0b42b-be68-4133-bfc2-6ab2514dcb76 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:45.033591 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79a0b42b-be68-4133-bfc2-6ab2514dcb76 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:45.034410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79a0b42b-be68-4133-bfc2-6ab2514dcb76 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:45.035930 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79a0b42b-be68-4133-bfc2-6ab2514dcb76 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:45.036707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79a0b42b-be68-4133-bfc2-6ab2514dcb76 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:45.063657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-79a0b42b-be68-4133-bfc2-6ab2514dcb76 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] HTTP exception thrown: Cannot 'attach_volume' instance bed6c5da-065f-40bc-9f21-154eda67c27a while it is in vm_state rescued Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-79a0b42b-be68-4133-bfc2-6ab2514dcb76 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Request method failure captured: Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: POST /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a/os-volume_attachments HTTP/1.1 Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 74 Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwVKH3x76CuLrQiil_QeqLJlRAYmSLUZHyhOwQk8sbRI-otzlDmTsC_Kctl2BV_e4qPytbOqhX6MbzWcOccb260GCFJXJWi9_H7Q1wUqQIfe0FZjyO5tA1W0EjbS6iilwzkwC6l8IrYXJGCWbBByR_yHau1s1AOt2UBKhdQaZNk9xo Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 3f8010f68f0c4fd4ac77cb9221777078 Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:00:45.065433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:00:45.068282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f8010f68f0c4fd4ac77cb9221777078", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:00:45.068282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:00:45.068282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 3f8010f68f0c4fd4ac77cb9221777078 Jul 21 22:00:45.068282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:00:45.068282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-ServerRescueNegativeTestJSON-900258742-project Jul 21 22:00:45.068282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:00:45.068282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:00:45.068282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 40f128f6095f425eb5b2f7bcce092e5a Jul 21 22:00:45.068282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-ServerRescueNegativeTestJSON-900258742-project Jul 21 22:00:45.068282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Jul 21 22:00:45.068282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {"volumeAttachment": {"volumeId": "24c997b8-f650-4fe9-9a2f-3b0da1e2bc81"}} Jul 21 22:00:45.068282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Cannot 'attach_volume' instance bed6c5da-065f-40bc-9f21-154eda67c27a while it is in vm_state rescued Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'server_id': 'bed6c5da-065f-40bc-9f21-154eda67c27a', 'body': {'volumeAttachment': {'volumeId': '24c997b8-f650-4fe9-9a2f-3b0da1e2bc81'}}} Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bed6c5da-065f-40bc-9f21-154eda67c27a in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:00:45.070682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bed6c5da-065f-40bc-9f21-154eda67c27a while it is in vm_state rescued Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:00:45.074256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:00:45.075625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:00:45.075625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:00:45.075625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bed6c5da-065f-40bc-9f21-154eda67c27a while it is in vm_state rescued Jul 21 22:00:45.075625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:00:45.075625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-79a0b42b-be68-4133-bfc2-6ab2514dcb76 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Returning 409 to user: Cannot 'attach_volume' instance bed6c5da-065f-40bc-9f21-154eda67c27a while it is in vm_state rescued {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:00:45.075625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-79a0b42b-be68-4133-bfc2-6ab2514dcb76 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "POST /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.047516 Jul 21 22:00:45.075625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 135/255] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 22:00:45 2022] POST /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 21 22:00:45.079498 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ddf9813d-9977-4428-b827-844587e7a8d6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:00:45.080130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ddf9813d-9977-4428-b827-844587e7a8d6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:45.086812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddf9813d-9977-4428-b827-844587e7a8d6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:45.087718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddf9813d-9977-4428-b827-844587e7a8d6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:45.088160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddf9813d-9977-4428-b827-844587e7a8d6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:45.088598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddf9813d-9977-4428-b827-844587e7a8d6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:45.171236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ddf9813d-9977-4428-b827-844587e7a8d6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "POST /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a/action" status: 202 len: 0 microversion: 2.1 time: 0.096402 Jul 21 22:00:45.171927 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 121/256] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 22:00:45 2022] POST /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:00:45.181536 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-249c5d40-550c-4ebd-8272-0f6c42593481 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:45.182314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-249c5d40-550c-4ebd-8272-0f6c42593481 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:45.189310 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-249c5d40-550c-4ebd-8272-0f6c42593481 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:45.189842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-249c5d40-550c-4ebd-8272-0f6c42593481 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:45.190744 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-249c5d40-550c-4ebd-8272-0f6c42593481 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:45.191540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-249c5d40-550c-4ebd-8272-0f6c42593481 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:45.338116 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-249c5d40-550c-4ebd-8272-0f6c42593481 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:45.347108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-249c5d40-550c-4ebd-8272-0f6c42593481 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1508 microversion: 2.1 time: 0.169627 Jul 21 22:00:45.347866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 136/257] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:45 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:46.366941 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1d946c42-4390-4f1e-b88f-536fb983e304 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:46.367603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1d946c42-4390-4f1e-b88f-536fb983e304 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:46.375627 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1d946c42-4390-4f1e-b88f-536fb983e304 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:46.376073 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1d946c42-4390-4f1e-b88f-536fb983e304 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:46.376847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1d946c42-4390-4f1e-b88f-536fb983e304 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:46.377286 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1d946c42-4390-4f1e-b88f-536fb983e304 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:46.532646 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1d946c42-4390-4f1e-b88f-536fb983e304 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:46.541782 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1d946c42-4390-4f1e-b88f-536fb983e304 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1508 microversion: 2.1 time: 0.179254 Jul 21 22:00:46.542365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 122/258] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:46 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:47.561975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-02c6e118-6d8e-4c7b-9e7d-4a8eddcee78e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:47.563187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-02c6e118-6d8e-4c7b-9e7d-4a8eddcee78e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:47.569832 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02c6e118-6d8e-4c7b-9e7d-4a8eddcee78e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:47.570287 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02c6e118-6d8e-4c7b-9e7d-4a8eddcee78e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:47.571104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02c6e118-6d8e-4c7b-9e7d-4a8eddcee78e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:47.571590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02c6e118-6d8e-4c7b-9e7d-4a8eddcee78e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:47.706139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-02c6e118-6d8e-4c7b-9e7d-4a8eddcee78e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:47.714087 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-02c6e118-6d8e-4c7b-9e7d-4a8eddcee78e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1508 microversion: 2.1 time: 0.157655 Jul 21 22:00:47.714878 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 137/259] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:47 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:48.738731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-427a030a-c96b-4e82-bedd-c1e5916ca7a2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:48.739373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-427a030a-c96b-4e82-bedd-c1e5916ca7a2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:48.746224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-427a030a-c96b-4e82-bedd-c1e5916ca7a2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:48.747206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-427a030a-c96b-4e82-bedd-c1e5916ca7a2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:48.747990 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-427a030a-c96b-4e82-bedd-c1e5916ca7a2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:48.748462 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-427a030a-c96b-4e82-bedd-c1e5916ca7a2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:48.883895 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-427a030a-c96b-4e82-bedd-c1e5916ca7a2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:48.893092 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-427a030a-c96b-4e82-bedd-c1e5916ca7a2 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1508 microversion: 2.1 time: 0.158133 Jul 21 22:00:48.893927 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 123/260] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:48 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:49.910277 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bbb0086b-7219-4b83-b697-a029051325ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:49.910894 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bbb0086b-7219-4b83-b697-a029051325ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:49.917089 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bbb0086b-7219-4b83-b697-a029051325ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:49.917535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bbb0086b-7219-4b83-b697-a029051325ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:49.918321 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bbb0086b-7219-4b83-b697-a029051325ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:49.918758 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bbb0086b-7219-4b83-b697-a029051325ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:50.055816 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bbb0086b-7219-4b83-b697-a029051325ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:50.063575 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bbb0086b-7219-4b83-b697-a029051325ea tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1508 microversion: 2.1 time: 0.157092 Jul 21 22:00:50.064156 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 138/261] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:49 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:51.080783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f9e50cf1-1bed-4422-bac3-c1a48ad495bd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:51.081479 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f9e50cf1-1bed-4422-bac3-c1a48ad495bd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:51.087942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9e50cf1-1bed-4422-bac3-c1a48ad495bd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:51.088393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9e50cf1-1bed-4422-bac3-c1a48ad495bd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:51.089173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9e50cf1-1bed-4422-bac3-c1a48ad495bd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:51.089611 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9e50cf1-1bed-4422-bac3-c1a48ad495bd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:51.228246 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f9e50cf1-1bed-4422-bac3-c1a48ad495bd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:51.239395 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f9e50cf1-1bed-4422-bac3-c1a48ad495bd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1508 microversion: 2.1 time: 0.162505 Jul 21 22:00:51.239979 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 124/262] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:51 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:52.258026 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a328c0db-838a-42f5-992c-1c182d90e184 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:52.258629 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a328c0db-838a-42f5-992c-1c182d90e184 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:52.264774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a328c0db-838a-42f5-992c-1c182d90e184 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:52.265218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a328c0db-838a-42f5-992c-1c182d90e184 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:52.265983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a328c0db-838a-42f5-992c-1c182d90e184 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:52.266415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a328c0db-838a-42f5-992c-1c182d90e184 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:52.419366 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a328c0db-838a-42f5-992c-1c182d90e184 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:52.427069 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a328c0db-838a-42f5-992c-1c182d90e184 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1508 microversion: 2.1 time: 0.172907 Jul 21 22:00:52.427654 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 139/263] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:52 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:53.444908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fd1a8257-ed5f-4b79-8bcc-5a85f8555999 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:53.445630 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fd1a8257-ed5f-4b79-8bcc-5a85f8555999 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:53.452923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fd1a8257-ed5f-4b79-8bcc-5a85f8555999 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:53.453367 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fd1a8257-ed5f-4b79-8bcc-5a85f8555999 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:53.454145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fd1a8257-ed5f-4b79-8bcc-5a85f8555999 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:53.454577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fd1a8257-ed5f-4b79-8bcc-5a85f8555999 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:53.588923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fd1a8257-ed5f-4b79-8bcc-5a85f8555999 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:53.596816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fd1a8257-ed5f-4b79-8bcc-5a85f8555999 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1508 microversion: 2.1 time: 0.155769 Jul 21 22:00:53.597396 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 125/264] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:53 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:54.614614 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6397ba18-b4a6-4f80-acc7-fe5944a1a7d8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:54.615509 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6397ba18-b4a6-4f80-acc7-fe5944a1a7d8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:54.621524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6397ba18-b4a6-4f80-acc7-fe5944a1a7d8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:54.621970 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6397ba18-b4a6-4f80-acc7-fe5944a1a7d8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:54.622745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6397ba18-b4a6-4f80-acc7-fe5944a1a7d8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:54.623230 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6397ba18-b4a6-4f80-acc7-fe5944a1a7d8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:54.761412 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6397ba18-b4a6-4f80-acc7-fe5944a1a7d8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:54.769842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6397ba18-b4a6-4f80-acc7-fe5944a1a7d8 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1508 microversion: 2.1 time: 0.159157 Jul 21 22:00:54.770435 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 140/265] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:54 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:55.787115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ac8e9e17-b830-4ee2-bf57-105900669769 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:55.787760 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ac8e9e17-b830-4ee2-bf57-105900669769 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:55.795038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ac8e9e17-b830-4ee2-bf57-105900669769 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:55.795493 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ac8e9e17-b830-4ee2-bf57-105900669769 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:55.796276 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ac8e9e17-b830-4ee2-bf57-105900669769 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:55.796712 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ac8e9e17-b830-4ee2-bf57-105900669769 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:55.939360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ac8e9e17-b830-4ee2-bf57-105900669769 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:55.946957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ac8e9e17-b830-4ee2-bf57-105900669769 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1508 microversion: 2.1 time: 0.163628 Jul 21 22:00:55.947561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 126/266] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:55 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:56.965515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e8dbf4d3-efd8-43f6-ac84-6125936a290d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:00:56.966388 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e8dbf4d3-efd8-43f6-ac84-6125936a290d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:00:56.973000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8dbf4d3-efd8-43f6-ac84-6125936a290d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:56.973459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8dbf4d3-efd8-43f6-ac84-6125936a290d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:56.974260 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8dbf4d3-efd8-43f6-ac84-6125936a290d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:00:56.974699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8dbf4d3-efd8-43f6-ac84-6125936a290d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:00:57.124707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e8dbf4d3-efd8-43f6-ac84-6125936a290d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:00:57.132698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e8dbf4d3-efd8-43f6-ac84-6125936a290d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1514 microversion: 2.1 time: 0.171490 Jul 21 22:00:57.133291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 141/267] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:00:56 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:00:59.538388 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ae03324d-9e68-4a7d-aea9-18f6ed304206 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Action: 'create', calling method: .version_select at 0x7faca305cc10>, body: {"keypair": {"name": "tempest-keypair-504316105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZTw4nRb+6Cfar2jCieKzn4es9DBB0Ktn5GrMjVmyqFDKRfOAopdgzNmKB+Tn5SRGWOMJ4uK38EAiB4QF11MT9uZtVUuodN0MRuGM6qB9uROqebyoSGKGHGlFVAFrnm0w=="}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:00:59.558024 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-ae03324d-9e68-4a7d-aea9-18f6ed304206 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Getting quotas for project 3f8010f68f0c4fd4ac77cb9221777078. Resources: {'key_pairs'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:00:59.562555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-ae03324d-9e68-4a7d-aea9-18f6ed304206 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Getting quotas for user 40f128f6095f425eb5b2f7bcce092e5a and project 3f8010f68f0c4fd4ac77cb9221777078. Resources: {'key_pairs'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:00:59.602567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ae03324d-9e68-4a7d-aea9-18f6ed304206 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071424 Jul 21 22:00:59.603429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 127/268] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 22:00:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:01:00.976632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1678630167", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8f19f10-5578-4f0e-b346-f7ab3c1df0d6"}], "security_groups": [{"name": "tempest-securitygroup--1153356996"}], "key_name": "tempest-keypair-504316105", "user_data": "}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:01:01.082540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] validate_networks() for [('d8f19f10-5578-4f0e-b346-f7ab3c1df0d6', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:01:01.698454 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:01:01.698600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:01:01.699155 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:01:01.699575 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:01:01.699982 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:01:01.710067 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:01.710512 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:01.711350 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:01.711782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:01.730418 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Getting quotas for project 3f8010f68f0c4fd4ac77cb9221777078. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:01:01.734922 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Getting quotas for user 40f128f6095f425eb5b2f7bcce092e5a and project 3f8010f68f0c4fd4ac77cb9221777078. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:01:01.746349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:01:01.748686 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:01:01.799717 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7ddf44a4-f764-4a31-b5f4-2f35600629b6 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.829485 Jul 21 22:01:01.800530 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 142/269] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 22:01:00 2022] POST /compute/v2.1/servers => generated 409 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:01:01.810392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3281b62f-d793-48bd-8abc-028832ef8189 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:01.811017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3281b62f-d793-48bd-8abc-028832ef8189 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:01.869424 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3281b62f-d793-48bd-8abc-028832ef8189 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:01.877034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3281b62f-d793-48bd-8abc-028832ef8189 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1245 microversion: 2.1 time: 0.070544 Jul 21 22:01:01.877702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 128/270] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:01 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1245 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:02.894500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5cfee3ac-0315-4cf4-a0a2-49e53175e832 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:02.895150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5cfee3ac-0315-4cf4-a0a2-49e53175e832 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:02.901370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5cfee3ac-0315-4cf4-a0a2-49e53175e832 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:02.901823 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5cfee3ac-0315-4cf4-a0a2-49e53175e832 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:02.902612 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5cfee3ac-0315-4cf4-a0a2-49e53175e832 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:02.903071 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5cfee3ac-0315-4cf4-a0a2-49e53175e832 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:02.965858 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5cfee3ac-0315-4cf4-a0a2-49e53175e832 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:02.977885 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5cfee3ac-0315-4cf4-a0a2-49e53175e832 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1249 microversion: 2.1 time: 0.087413 Jul 21 22:01:02.978476 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 143/271] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:02 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:03.995532 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-024d8d16-d3b3-4b5c-a91d-3f9a13bec360 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:03.996601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-024d8d16-d3b3-4b5c-a91d-3f9a13bec360 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:04.003307 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-024d8d16-d3b3-4b5c-a91d-3f9a13bec360 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:04.003789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-024d8d16-d3b3-4b5c-a91d-3f9a13bec360 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:04.004582 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-024d8d16-d3b3-4b5c-a91d-3f9a13bec360 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:04.005026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-024d8d16-d3b3-4b5c-a91d-3f9a13bec360 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:04.076730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-024d8d16-d3b3-4b5c-a91d-3f9a13bec360 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:04.086504 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-024d8d16-d3b3-4b5c-a91d-3f9a13bec360 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1249 microversion: 2.1 time: 0.094824 Jul 21 22:01:04.087097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 129/272] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:03 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1249 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:05.104267 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b67413fb-3ae3-440b-b664-075036cda310 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:05.104806 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b67413fb-3ae3-440b-b664-075036cda310 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:05.106685 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:05.112483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b67413fb-3ae3-440b-b664-075036cda310 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:05.112933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b67413fb-3ae3-440b-b664-075036cda310 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:05.113717 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b67413fb-3ae3-440b-b664-075036cda310 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:05.114166 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b67413fb-3ae3-440b-b664-075036cda310 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:05.117591 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=80 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:05.179638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b67413fb-3ae3-440b-b664-075036cda310 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:05.187415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b67413fb-3ae3-440b-b664-075036cda310 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1297 microversion: 2.1 time: 0.087073 Jul 21 22:01:05.188007 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 144/273] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:05 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:06.204872 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-210d5c1a-8674-497b-bd41-e60a7b91e92e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:06.205488 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-210d5c1a-8674-497b-bd41-e60a7b91e92e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:06.212500 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-210d5c1a-8674-497b-bd41-e60a7b91e92e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:06.212947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-210d5c1a-8674-497b-bd41-e60a7b91e92e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:06.213788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-210d5c1a-8674-497b-bd41-e60a7b91e92e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:06.214232 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-210d5c1a-8674-497b-bd41-e60a7b91e92e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:06.219498 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:06.281985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-210d5c1a-8674-497b-bd41-e60a7b91e92e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:06.290018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-210d5c1a-8674-497b-bd41-e60a7b91e92e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1303 microversion: 2.1 time: 0.089575 Jul 21 22:01:06.290573 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 130/274] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:06 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:06.717467 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1174035017", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2015823344", "security_groups": [{"name": "tempest-secgroup-smoke-76640484"}], "block_device_mapping_v2": [{"uuid": "b083deeb-37bb-4682-9a2c-40fb2ec2177a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fbccc834-ea3b-4e64-b07c-1be72eb34b7f"}]}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:01:06.850432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] validate_networks() for [('fbccc834-ea3b-4e64-b07c-1be72eb34b7f', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:01:07.308821 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c8fff208-e6a1-4174-9a23-69a8aa50fa2f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:07.310377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c8fff208-e6a1-4174-9a23-69a8aa50fa2f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:07.318445 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8fff208-e6a1-4174-9a23-69a8aa50fa2f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:07.319578 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8fff208-e6a1-4174-9a23-69a8aa50fa2f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:07.320399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8fff208-e6a1-4174-9a23-69a8aa50fa2f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:07.320842 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8fff208-e6a1-4174-9a23-69a8aa50fa2f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:07.493021 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:01:07.494297 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:01:07.495622 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:01:07.497258 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:01:07.497999 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:01:07.513235 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:07.513978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:07.515343 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:07.515711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:07.543326 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Getting quotas for project 70b0dd669508462c8302c8107bb0f5f0. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:01:07.548955 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Getting quotas for user d019ca1630544a14b0170e2c873012a3 and project 70b0dd669508462c8302c8107bb0f5f0. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:01:07.565382 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c8fff208-e6a1-4174-9a23-69a8aa50fa2f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:07.576473 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c8fff208-e6a1-4174-9a23-69a8aa50fa2f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1371 microversion: 2.1 time: 0.271140 Jul 21 22:01:07.577904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 131/275] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:07 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1371 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:01:07.590285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-939cc1d2-3fc2-4302-a67a-5eb6451d8923 req-7349d28f-2f55-460c-867a-50a1e2ebfb40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6534b28d-a96e-4bda-bf05-14b2da7ea0f1", "tag": "1507a60f-758e-4f76-9b6e-6495171e3c21"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:01:07.609392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-939cc1d2-3fc2-4302-a67a-5eb6451d8923 req-7349d28f-2f55-460c-867a-50a1e2ebfb40 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:07.610133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-939cc1d2-3fc2-4302-a67a-5eb6451d8923 req-7349d28f-2f55-460c-867a-50a1e2ebfb40 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:07.664789 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:01:07.667298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b083deeb-37bb-4682-9a2c-40fb2ec2177a',volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:01:07.797881 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-939cc1d2-3fc2-4302-a67a-5eb6451d8923 req-7349d28f-2f55-460c-867a-50a1e2ebfb40 service nova] Creating event network-changed:1507a60f-758e-4f76-9b6e-6495171e3c21 for instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 on hv-cinder-82002 Jul 21 22:01:07.805529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-939cc1d2-3fc2-4302-a67a-5eb6451d8923 req-7349d28f-2f55-460c-867a-50a1e2ebfb40 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221216 Jul 21 22:01:07.806434 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 132/276] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:01:07.866034 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a6ee7f74-4716-4ebb-894d-64e27950db1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.153289 Jul 21 22:01:07.866702 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 145/277] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 22:01:06 2022] POST /compute/v2.1/servers => generated 404 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:01:07.877767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-75964828-6fa2-4334-aec8-51a8efb95bf3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:07.878472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-75964828-6fa2-4334-aec8-51a8efb95bf3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:07.884432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:07.961291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-75964828-6fa2-4334-aec8-51a8efb95bf3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:07.969783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-75964828-6fa2-4334-aec8-51a8efb95bf3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1095 microversion: 2.1 time: 0.096055 Jul 21 22:01:07.970495 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 133/278] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:07 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:08.594038 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c01824f8-8d45-491b-9557-921066e933c9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:08.594702 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c01824f8-8d45-491b-9557-921066e933c9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:08.600836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c01824f8-8d45-491b-9557-921066e933c9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:08.601287 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c01824f8-8d45-491b-9557-921066e933c9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:08.602046 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c01824f8-8d45-491b-9557-921066e933c9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:08.602478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c01824f8-8d45-491b-9557-921066e933c9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:08.735972 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c01824f8-8d45-491b-9557-921066e933c9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:08.743757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c01824f8-8d45-491b-9557-921066e933c9 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1371 microversion: 2.1 time: 0.154307 Jul 21 22:01:08.744359 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 146/279] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:08 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:08.987326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-17d5ed82-27b4-4bfa-9c00-f3275c27d655 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:08.987891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-17d5ed82-27b4-4bfa-9c00-f3275c27d655 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:08.995268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-17d5ed82-27b4-4bfa-9c00-f3275c27d655 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:08.995718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-17d5ed82-27b4-4bfa-9c00-f3275c27d655 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:08.996986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-17d5ed82-27b4-4bfa-9c00-f3275c27d655 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:08.997419 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-17d5ed82-27b4-4bfa-9c00-f3275c27d655 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:09.062739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-17d5ed82-27b4-4bfa-9c00-f3275c27d655 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:09.070288 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-17d5ed82-27b4-4bfa-9c00-f3275c27d655 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1137 microversion: 2.1 time: 0.086993 Jul 21 22:01:09.070857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 134/280] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:08 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:09.761596 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-40a3ffde-1b4d-40af-9f2c-90ddca5b2926 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:09.762384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-40a3ffde-1b4d-40af-9f2c-90ddca5b2926 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:09.768653 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40a3ffde-1b4d-40af-9f2c-90ddca5b2926 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:09.769109 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40a3ffde-1b4d-40af-9f2c-90ddca5b2926 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:09.769934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40a3ffde-1b4d-40af-9f2c-90ddca5b2926 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:09.770380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40a3ffde-1b4d-40af-9f2c-90ddca5b2926 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:09.911326 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-40a3ffde-1b4d-40af-9f2c-90ddca5b2926 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:09.919807 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-40a3ffde-1b4d-40af-9f2c-90ddca5b2926 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1371 microversion: 2.1 time: 0.162278 Jul 21 22:01:09.920391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 147/281] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:09 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:10.087502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fa1d0777-0479-415d-956c-4bdfb4384aa7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:10.088118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fa1d0777-0479-415d-956c-4bdfb4384aa7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:10.094884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa1d0777-0479-415d-956c-4bdfb4384aa7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:10.095376 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa1d0777-0479-415d-956c-4bdfb4384aa7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:10.096152 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa1d0777-0479-415d-956c-4bdfb4384aa7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:10.096590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa1d0777-0479-415d-956c-4bdfb4384aa7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:10.158656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fa1d0777-0479-415d-956c-4bdfb4384aa7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:10.166468 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fa1d0777-0479-415d-956c-4bdfb4384aa7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1137 microversion: 2.1 time: 0.082789 Jul 21 22:01:10.167161 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 135/282] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:10 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:10.936418 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e30012be-df7f-44ed-a218-b96fc3069b83 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:10.937071 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e30012be-df7f-44ed-a218-b96fc3069b83 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:10.943470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e30012be-df7f-44ed-a218-b96fc3069b83 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:10.943922 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e30012be-df7f-44ed-a218-b96fc3069b83 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:10.944704 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e30012be-df7f-44ed-a218-b96fc3069b83 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:10.945196 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e30012be-df7f-44ed-a218-b96fc3069b83 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:11.105740 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e30012be-df7f-44ed-a218-b96fc3069b83 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:11.113319 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e30012be-df7f-44ed-a218-b96fc3069b83 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1371 microversion: 2.1 time: 0.180657 Jul 21 22:01:11.115037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 148/283] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:10 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:11.187304 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-388ac9f5-ad93-4745-8e6b-8ccc251fd48e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:11.187932 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-388ac9f5-ad93-4745-8e6b-8ccc251fd48e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:11.194709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-388ac9f5-ad93-4745-8e6b-8ccc251fd48e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:11.195196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-388ac9f5-ad93-4745-8e6b-8ccc251fd48e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:11.195988 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-388ac9f5-ad93-4745-8e6b-8ccc251fd48e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:11.196427 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-388ac9f5-ad93-4745-8e6b-8ccc251fd48e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:11.260747 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-388ac9f5-ad93-4745-8e6b-8ccc251fd48e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:11.268684 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-388ac9f5-ad93-4745-8e6b-8ccc251fd48e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1137 microversion: 2.1 time: 0.085479 Jul 21 22:01:11.269252 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 136/284] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:11 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:12.130128 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-64144d75-a5d1-46f2-819c-b3963ab7be46 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:12.130771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-64144d75-a5d1-46f2-819c-b3963ab7be46 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:12.138676 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64144d75-a5d1-46f2-819c-b3963ab7be46 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:12.139152 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64144d75-a5d1-46f2-819c-b3963ab7be46 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:12.139936 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64144d75-a5d1-46f2-819c-b3963ab7be46 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:12.140370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64144d75-a5d1-46f2-819c-b3963ab7be46 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:12.285668 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-66dfeeed-28e2-4051-ab11-a94b910a6000 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:12.286812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-66dfeeed-28e2-4051-ab11-a94b910a6000 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:12.293825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66dfeeed-28e2-4051-ab11-a94b910a6000 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:12.294288 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66dfeeed-28e2-4051-ab11-a94b910a6000 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:12.295118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66dfeeed-28e2-4051-ab11-a94b910a6000 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:12.295557 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66dfeeed-28e2-4051-ab11-a94b910a6000 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:12.301173 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-64144d75-a5d1-46f2-819c-b3963ab7be46 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:12.308835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-64144d75-a5d1-46f2-819c-b3963ab7be46 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1371 microversion: 2.1 time: 0.182818 Jul 21 22:01:12.309426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 149/285] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:12 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:12.364883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-66dfeeed-28e2-4051-ab11-a94b910a6000 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:12.375473 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-66dfeeed-28e2-4051-ab11-a94b910a6000 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1137 microversion: 2.1 time: 0.093705 Jul 21 22:01:12.376059 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 137/286] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:12 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1137 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:01:13.325720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9945de28-1ad1-4741-ad35-dd9c95af3fc1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:13.326310 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9945de28-1ad1-4741-ad35-dd9c95af3fc1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:13.332697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9945de28-1ad1-4741-ad35-dd9c95af3fc1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:13.333149 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9945de28-1ad1-4741-ad35-dd9c95af3fc1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:13.333991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9945de28-1ad1-4741-ad35-dd9c95af3fc1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:13.334445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9945de28-1ad1-4741-ad35-dd9c95af3fc1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:13.392001 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7f2ac5e6-402c-4972-9bd4-3717bdecffd2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:13.392650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7f2ac5e6-402c-4972-9bd4-3717bdecffd2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:13.399297 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f2ac5e6-402c-4972-9bd4-3717bdecffd2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:13.399740 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f2ac5e6-402c-4972-9bd4-3717bdecffd2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:13.400524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f2ac5e6-402c-4972-9bd4-3717bdecffd2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:13.400961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f2ac5e6-402c-4972-9bd4-3717bdecffd2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:13.472784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7f2ac5e6-402c-4972-9bd4-3717bdecffd2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:13.482713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7f2ac5e6-402c-4972-9bd4-3717bdecffd2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1137 microversion: 2.1 time: 0.094547 Jul 21 22:01:13.483913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 138/287] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:13 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1137 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:01:13.496142 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9945de28-1ad1-4741-ad35-dd9c95af3fc1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:13.504067 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9945de28-1ad1-4741-ad35-dd9c95af3fc1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1371 microversion: 2.1 time: 0.182075 Jul 21 22:01:13.504651 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 150/288] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:13 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:14.500193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-69a774fc-2972-4bd6-8dcb-e435c7817b21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:14.501035 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-69a774fc-2972-4bd6-8dcb-e435c7817b21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:14.508016 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69a774fc-2972-4bd6-8dcb-e435c7817b21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:14.508479 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69a774fc-2972-4bd6-8dcb-e435c7817b21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:14.509272 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69a774fc-2972-4bd6-8dcb-e435c7817b21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:14.509719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69a774fc-2972-4bd6-8dcb-e435c7817b21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:14.522141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-af40af7e-cfa5-449e-8ffe-b4c20e28cc38 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:14.522857 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-af40af7e-cfa5-449e-8ffe-b4c20e28cc38 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:14.529933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af40af7e-cfa5-449e-8ffe-b4c20e28cc38 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:14.530380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af40af7e-cfa5-449e-8ffe-b4c20e28cc38 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:14.531474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af40af7e-cfa5-449e-8ffe-b4c20e28cc38 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:14.531872 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af40af7e-cfa5-449e-8ffe-b4c20e28cc38 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:14.586531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-69a774fc-2972-4bd6-8dcb-e435c7817b21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:14.594589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-69a774fc-2972-4bd6-8dcb-e435c7817b21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1137 microversion: 2.1 time: 0.098770 Jul 21 22:01:14.595301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 139/289] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:14 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1137 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:14.680280 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-af40af7e-cfa5-449e-8ffe-b4c20e28cc38 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:14.688488 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-af40af7e-cfa5-449e-8ffe-b4c20e28cc38 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1371 microversion: 2.1 time: 0.171001 Jul 21 22:01:14.689066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 151/290] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:14 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:01:15.612219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cb8adf7e-88c5-4afb-8b27-ec6691ace327 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:15.612832 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cb8adf7e-88c5-4afb-8b27-ec6691ace327 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:15.619055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cb8adf7e-88c5-4afb-8b27-ec6691ace327 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:15.619516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cb8adf7e-88c5-4afb-8b27-ec6691ace327 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:15.620300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cb8adf7e-88c5-4afb-8b27-ec6691ace327 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:15.620739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cb8adf7e-88c5-4afb-8b27-ec6691ace327 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:15.683635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-cb8adf7e-88c5-4afb-8b27-ec6691ace327 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:15.693463 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cb8adf7e-88c5-4afb-8b27-ec6691ace327 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1137 microversion: 2.1 time: 0.085098 Jul 21 22:01:15.694043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 140/291] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:15 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:15.704647 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0da9b6c0-3ca1-4bdd-bbc2-741d0dcfe434 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:15.705213 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0da9b6c0-3ca1-4bdd-bbc2-741d0dcfe434 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:15.711505 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0da9b6c0-3ca1-4bdd-bbc2-741d0dcfe434 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:15.711963 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0da9b6c0-3ca1-4bdd-bbc2-741d0dcfe434 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:15.712749 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0da9b6c0-3ca1-4bdd-bbc2-741d0dcfe434 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:15.713199 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0da9b6c0-3ca1-4bdd-bbc2-741d0dcfe434 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:15.850608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0da9b6c0-3ca1-4bdd-bbc2-741d0dcfe434 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:15.859936 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0da9b6c0-3ca1-4bdd-bbc2-741d0dcfe434 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1371 microversion: 2.1 time: 0.158922 Jul 21 22:01:15.860866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 152/292] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:15 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:16.710939 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-22989e05-d3c4-4a0b-af64-ed8ff6f59c7a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:16.711746 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-22989e05-d3c4-4a0b-af64-ed8ff6f59c7a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:16.718739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-22989e05-d3c4-4a0b-af64-ed8ff6f59c7a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:16.719227 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-22989e05-d3c4-4a0b-af64-ed8ff6f59c7a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:16.720014 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-22989e05-d3c4-4a0b-af64-ed8ff6f59c7a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:16.720455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-22989e05-d3c4-4a0b-af64-ed8ff6f59c7a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:16.786136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-22989e05-d3c4-4a0b-af64-ed8ff6f59c7a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:16.794254 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-22989e05-d3c4-4a0b-af64-ed8ff6f59c7a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1193 microversion: 2.1 time: 0.086891 Jul 21 22:01:16.797341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 141/293] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:16 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:16.877937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fd86072e-e7a3-411a-802c-824537ccc202 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:16.878487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fd86072e-e7a3-411a-802c-824537ccc202 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:16.885221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fd86072e-e7a3-411a-802c-824537ccc202 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:16.885683 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fd86072e-e7a3-411a-802c-824537ccc202 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:16.886468 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fd86072e-e7a3-411a-802c-824537ccc202 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:16.886909 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fd86072e-e7a3-411a-802c-824537ccc202 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:17.042313 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fd86072e-e7a3-411a-802c-824537ccc202 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:17.059331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fd86072e-e7a3-411a-802c-824537ccc202 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1371 microversion: 2.1 time: 0.184547 Jul 21 22:01:17.070330 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 153/294] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:16 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:17.808377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-7b385fe7-995a-4ccc-a3d0-fd7bb7f08a01 req-51a20a82-d7fb-4883-8dfb-062a12981eb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6534b28d-a96e-4bda-bf05-14b2da7ea0f1", "name": "network-vif-plugged", "status": "completed", "tag": "1507a60f-758e-4f76-9b6e-6495171e3c21"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:01:17.817978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-7b385fe7-995a-4ccc-a3d0-fd7bb7f08a01 req-51a20a82-d7fb-4883-8dfb-062a12981eb8 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:17.818594 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-7b385fe7-995a-4ccc-a3d0-fd7bb7f08a01 req-51a20a82-d7fb-4883-8dfb-062a12981eb8 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:17.819574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9dd9aaf2-4172-4149-9dce-a9d7d9c2e9ac tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:17.820972 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9dd9aaf2-4172-4149-9dce-a9d7d9c2e9ac tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:17.832743 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:17.834450 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-7b385fe7-995a-4ccc-a3d0-fd7bb7f08a01 req-51a20a82-d7fb-4883-8dfb-062a12981eb8 service nova] Creating event network-vif-plugged:1507a60f-758e-4f76-9b6e-6495171e3c21 for instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 on hv-cinder-82002 Jul 21 22:01:17.835322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=12 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:17.838304 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9dd9aaf2-4172-4149-9dce-a9d7d9c2e9ac tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:17.839617 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9dd9aaf2-4172-4149-9dce-a9d7d9c2e9ac tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:17.842067 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-7b385fe7-995a-4ccc-a3d0-fd7bb7f08a01 req-51a20a82-d7fb-4883-8dfb-062a12981eb8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038880 Jul 21 22:01:17.842387 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9dd9aaf2-4172-4149-9dce-a9d7d9c2e9ac tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:17.843196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 142/295] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:01:17.843681 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9dd9aaf2-4172-4149-9dce-a9d7d9c2e9ac tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:18.079408 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-40e109b1-e0de-4019-bc6e-c1cfb4eb3251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:18.079946 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-40e109b1-e0de-4019-bc6e-c1cfb4eb3251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:18.081951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=8 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:18.091683 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40e109b1-e0de-4019-bc6e-c1cfb4eb3251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:18.092399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40e109b1-e0de-4019-bc6e-c1cfb4eb3251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:18.093535 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40e109b1-e0de-4019-bc6e-c1cfb4eb3251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:18.094152 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40e109b1-e0de-4019-bc6e-c1cfb4eb3251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:18.112461 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9dd9aaf2-4172-4149-9dce-a9d7d9c2e9ac tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:18.120803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9dd9aaf2-4172-4149-9dce-a9d7d9c2e9ac tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1277 microversion: 2.1 time: 0.312255 Jul 21 22:01:18.122086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 154/296] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:17 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1277 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:18.248638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-40e109b1-e0de-4019-bc6e-c1cfb4eb3251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:18.263752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-40e109b1-e0de-4019-bc6e-c1cfb4eb3251 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1371 microversion: 2.1 time: 0.189335 Jul 21 22:01:18.264631 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 143/297] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:18 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:01:18.859773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-e069365f-c36c-4b43-8c93-a324d2070e79 req-52c3b006-5515-4813-97c2-d2dee478cb6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc368e51-a804-44e7-8341-b5a36c3173a5", "tag": "ea05b6f6-1e21-4d99-948d-a0fa000d0aea"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:01:18.868186 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-e069365f-c36c-4b43-8c93-a324d2070e79 req-52c3b006-5515-4813-97c2-d2dee478cb6d service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:18.868635 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-e069365f-c36c-4b43-8c93-a324d2070e79 req-52c3b006-5515-4813-97c2-d2dee478cb6d service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:18.882268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-e069365f-c36c-4b43-8c93-a324d2070e79 req-52c3b006-5515-4813-97c2-d2dee478cb6d service nova] Creating event network-changed:ea05b6f6-1e21-4d99-948d-a0fa000d0aea for instance bc368e51-a804-44e7-8341-b5a36c3173a5 on hv-cinder-82002 Jul 21 22:01:18.889050 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-e069365f-c36c-4b43-8c93-a324d2070e79 req-52c3b006-5515-4813-97c2-d2dee478cb6d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034343 Jul 21 22:01:18.890066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 155/298] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:01:19.138291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-466741c8-07c6-4a9c-b352-220c50f1e42b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:19.138919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-466741c8-07c6-4a9c-b352-220c50f1e42b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:19.148391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-466741c8-07c6-4a9c-b352-220c50f1e42b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:19.148846 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-466741c8-07c6-4a9c-b352-220c50f1e42b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:19.150817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-466741c8-07c6-4a9c-b352-220c50f1e42b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:19.151293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-466741c8-07c6-4a9c-b352-220c50f1e42b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:19.281499 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cbd87642-36e8-4e48-b9c3-1624b8293cee tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:19.282308 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cbd87642-36e8-4e48-b9c3-1624b8293cee tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:19.288862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cbd87642-36e8-4e48-b9c3-1624b8293cee tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:19.289413 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cbd87642-36e8-4e48-b9c3-1624b8293cee tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:19.290279 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cbd87642-36e8-4e48-b9c3-1624b8293cee tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:19.290783 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cbd87642-36e8-4e48-b9c3-1624b8293cee tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:19.299620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-466741c8-07c6-4a9c-b352-220c50f1e42b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:19.308170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-466741c8-07c6-4a9c-b352-220c50f1e42b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1277 microversion: 2.1 time: 0.174115 Jul 21 22:01:19.308767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 144/299] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:19 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:19.439713 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cbd87642-36e8-4e48-b9c3-1624b8293cee tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:19.447381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cbd87642-36e8-4e48-b9c3-1624b8293cee tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1371 microversion: 2.1 time: 0.170696 Jul 21 22:01:19.448193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 156/300] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:19 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:01:20.326678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-99b6f606-ef09-4648-837e-6bcfed259829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:20.327411 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-99b6f606-ef09-4648-837e-6bcfed259829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:20.334489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-99b6f606-ef09-4648-837e-6bcfed259829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:20.335066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-99b6f606-ef09-4648-837e-6bcfed259829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:20.336394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-99b6f606-ef09-4648-837e-6bcfed259829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:20.336845 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-99b6f606-ef09-4648-837e-6bcfed259829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:20.465861 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2668f009-5923-41db-97f6-d692fcd0b16f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:20.467685 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2668f009-5923-41db-97f6-d692fcd0b16f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:20.474668 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-99b6f606-ef09-4648-837e-6bcfed259829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:20.476731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2668f009-5923-41db-97f6-d692fcd0b16f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:20.477944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2668f009-5923-41db-97f6-d692fcd0b16f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:20.478921 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2668f009-5923-41db-97f6-d692fcd0b16f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:20.479543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2668f009-5923-41db-97f6-d692fcd0b16f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:20.493636 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-99b6f606-ef09-4648-837e-6bcfed259829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.170672 Jul 21 22:01:20.498096 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 145/301] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:20 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:20.634863 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2668f009-5923-41db-97f6-d692fcd0b16f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:20.643459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2668f009-5923-41db-97f6-d692fcd0b16f tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1371 microversion: 2.1 time: 0.181933 Jul 21 22:01:20.644049 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 157/302] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:20 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:01:21.514981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-53cb9a1e-6880-49b8-bade-d3a1c2a0e02e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:21.515613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-53cb9a1e-6880-49b8-bade-d3a1c2a0e02e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:21.522100 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-53cb9a1e-6880-49b8-bade-d3a1c2a0e02e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:21.522561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-53cb9a1e-6880-49b8-bade-d3a1c2a0e02e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:21.523372 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-53cb9a1e-6880-49b8-bade-d3a1c2a0e02e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:21.523844 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-53cb9a1e-6880-49b8-bade-d3a1c2a0e02e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:21.661897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ddc57843-5acf-41ed-8b20-d864b3081471 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:21.662588 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ddc57843-5acf-41ed-8b20-d864b3081471 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:21.667342 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-53cb9a1e-6880-49b8-bade-d3a1c2a0e02e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:21.671684 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ddc57843-5acf-41ed-8b20-d864b3081471 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:21.672315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ddc57843-5acf-41ed-8b20-d864b3081471 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:21.673068 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ddc57843-5acf-41ed-8b20-d864b3081471 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:21.673502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ddc57843-5acf-41ed-8b20-d864b3081471 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:21.677261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-53cb9a1e-6880-49b8-bade-d3a1c2a0e02e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.165946 Jul 21 22:01:21.687638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 146/303] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:21 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:21.817523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ddc57843-5acf-41ed-8b20-d864b3081471 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:21.827424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ddc57843-5acf-41ed-8b20-d864b3081471 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1565 microversion: 2.1 time: 0.170172 Jul 21 22:01:21.828418 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 158/304] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:21 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:01:21.844644 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6b6ab7d0-1581-4548-91c3-ed9db19bf10a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:21.845151 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6b6ab7d0-1581-4548-91c3-ed9db19bf10a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:21.851130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b6ab7d0-1581-4548-91c3-ed9db19bf10a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:21.851590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b6ab7d0-1581-4548-91c3-ed9db19bf10a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:21.852380 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b6ab7d0-1581-4548-91c3-ed9db19bf10a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:21.852806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b6ab7d0-1581-4548-91c3-ed9db19bf10a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:21.956145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6b6ab7d0-1581-4548-91c3-ed9db19bf10a tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116137 Jul 21 22:01:21.956826 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 147/305] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 22:01:21 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:01:22.695359 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c7f44a47-c3ad-43d1-a294-9928be1b38bd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:22.696847 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c7f44a47-c3ad-43d1-a294-9928be1b38bd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:22.706661 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c7f44a47-c3ad-43d1-a294-9928be1b38bd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:22.707878 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c7f44a47-c3ad-43d1-a294-9928be1b38bd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:22.708919 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c7f44a47-c3ad-43d1-a294-9928be1b38bd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:22.709572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c7f44a47-c3ad-43d1-a294-9928be1b38bd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:22.976345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c7f44a47-c3ad-43d1-a294-9928be1b38bd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:22.987284 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c7f44a47-c3ad-43d1-a294-9928be1b38bd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.295774 Jul 21 22:01:22.988274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 159/306] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:22 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:23.300126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-1fdbdcd2-344f-4fcc-962b-6587065db703 req-fbeeb105-83ab-43a2-8602-4ea38c60415e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6534b28d-a96e-4bda-bf05-14b2da7ea0f1", "tag": "1507a60f-758e-4f76-9b6e-6495171e3c21"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:01:23.311180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-1fdbdcd2-344f-4fcc-962b-6587065db703 req-fbeeb105-83ab-43a2-8602-4ea38c60415e service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:23.311717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-1fdbdcd2-344f-4fcc-962b-6587065db703 req-fbeeb105-83ab-43a2-8602-4ea38c60415e service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:23.334127 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-1fdbdcd2-344f-4fcc-962b-6587065db703 req-fbeeb105-83ab-43a2-8602-4ea38c60415e service nova] Creating event network-changed:1507a60f-758e-4f76-9b6e-6495171e3c21 for instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 on hv-cinder-82002 Jul 21 22:01:23.346079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-1fdbdcd2-344f-4fcc-962b-6587065db703 req-fbeeb105-83ab-43a2-8602-4ea38c60415e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052642 Jul 21 22:01:23.347652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 148/307] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:01:24.004937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e03cbbb7-9107-4b87-beeb-d8fda4a0ca3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:24.006586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e03cbbb7-9107-4b87-beeb-d8fda4a0ca3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:24.014313 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e03cbbb7-9107-4b87-beeb-d8fda4a0ca3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:24.015024 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e03cbbb7-9107-4b87-beeb-d8fda4a0ca3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:24.019448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e03cbbb7-9107-4b87-beeb-d8fda4a0ca3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:24.022006 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e03cbbb7-9107-4b87-beeb-d8fda4a0ca3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:24.177799 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e03cbbb7-9107-4b87-beeb-d8fda4a0ca3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:24.188583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e03cbbb7-9107-4b87-beeb-d8fda4a0ca3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.188057 Jul 21 22:01:24.201627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 160/308] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:23 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:24.460878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1595552755", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "networks": [{"uuid": "ceff7810-76a6-46bc-8ad4-81b09722a8db"}]}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:01:24.521237 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.network.neutron [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] validate_networks() for [('ceff7810-76a6-46bc-8ad4-81b09722a8db', None, None, None, None, None)] {{(pid=117979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:01:24.928562 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Flavor limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:01:24.928817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Image limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:01:24.929297 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Flavor pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:01:24.929707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Image pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:01:24.930117 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:01:24.939486 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:24.939934 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:24.940730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:24.941162 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:24.957470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Getting quotas for project fd46d5bdfd044627bcd71cd16b99649b. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:01:24.961388 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Getting quotas for user 17d33bb455874228bcc76644b24272de and project fd46d5bdfd044627bcd71cd16b99649b. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:01:24.973320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Going to run 1 instances... {{(pid=117979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:01:24.975580 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:01:25.020560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-277c4c98-83f9-4a10-a1f4-126991adc09d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.566764 Jul 21 22:01:25.021386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 149/309] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 22:01:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:01:25.031542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9333bca7-a500-4ed3-9255-8f8635d35d9c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:25.032153 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9333bca7-a500-4ed3-9255-8f8635d35d9c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:25.092782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9333bca7-a500-4ed3-9255-8f8635d35d9c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:25.100071 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9333bca7-a500-4ed3-9255-8f8635d35d9c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1219 microversion: 2.1 time: 0.072786 Jul 21 22:01:25.100645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 161/310] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:25 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:25.208313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-23ea9507-c04a-42c9-b66f-a4898af9a351 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:25.209221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-23ea9507-c04a-42c9-b66f-a4898af9a351 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:25.217719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23ea9507-c04a-42c9-b66f-a4898af9a351 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:25.218258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23ea9507-c04a-42c9-b66f-a4898af9a351 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:25.219146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23ea9507-c04a-42c9-b66f-a4898af9a351 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:25.219796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23ea9507-c04a-42c9-b66f-a4898af9a351 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:25.377861 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-23ea9507-c04a-42c9-b66f-a4898af9a351 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:25.383251 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:25.389166 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-23ea9507-c04a-42c9-b66f-a4898af9a351 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.184321 Jul 21 22:01:25.390186 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 150/311] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:25 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:26.117251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9999e49f-0b5d-4c80-b219-971b095b9e6e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:26.118024 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9999e49f-0b5d-4c80-b219-971b095b9e6e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:26.124791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9999e49f-0b5d-4c80-b219-971b095b9e6e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:26.125201 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9999e49f-0b5d-4c80-b219-971b095b9e6e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:26.126021 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9999e49f-0b5d-4c80-b219-971b095b9e6e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:26.126462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9999e49f-0b5d-4c80-b219-971b095b9e6e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:26.196481 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9999e49f-0b5d-4c80-b219-971b095b9e6e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:26.205652 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9999e49f-0b5d-4c80-b219-971b095b9e6e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1279 microversion: 2.1 time: 0.092256 Jul 21 22:01:26.206429 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 162/312] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:26 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:26.406704 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d58ce7c7-f864-4d41-87a5-97afd18155df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:26.408066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d58ce7c7-f864-4d41-87a5-97afd18155df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:26.418455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d58ce7c7-f864-4d41-87a5-97afd18155df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:26.419076 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d58ce7c7-f864-4d41-87a5-97afd18155df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:26.420004 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d58ce7c7-f864-4d41-87a5-97afd18155df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:26.420821 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d58ce7c7-f864-4d41-87a5-97afd18155df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:26.568456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d58ce7c7-f864-4d41-87a5-97afd18155df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:26.576768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d58ce7c7-f864-4d41-87a5-97afd18155df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.174959 Jul 21 22:01:26.577442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 151/313] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:26 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:27.223185 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e95f2bd8-3bc4-488a-af73-b328aa294ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:27.223804 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e95f2bd8-3bc4-488a-af73-b328aa294ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:27.229967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e95f2bd8-3bc4-488a-af73-b328aa294ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:27.230421 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e95f2bd8-3bc4-488a-af73-b328aa294ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:27.231358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e95f2bd8-3bc4-488a-af73-b328aa294ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:27.231800 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e95f2bd8-3bc4-488a-af73-b328aa294ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:27.247675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:27.388625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e95f2bd8-3bc4-488a-af73-b328aa294ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:27.398176 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e95f2bd8-3bc4-488a-af73-b328aa294ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1319 microversion: 2.1 time: 0.178612 Jul 21 22:01:27.399510 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 163/314] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:27 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:01:27.594710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3219cadf-69d5-48ca-b1e3-c37207f43ac7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:27.595519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3219cadf-69d5-48ca-b1e3-c37207f43ac7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:27.608533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3219cadf-69d5-48ca-b1e3-c37207f43ac7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:27.608978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3219cadf-69d5-48ca-b1e3-c37207f43ac7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:27.609774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3219cadf-69d5-48ca-b1e3-c37207f43ac7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:27.610211 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3219cadf-69d5-48ca-b1e3-c37207f43ac7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:27.657011 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-1a9c185b-c702-45fe-a186-e7bc3c6aea8e req-35e9bb8a-6dcc-49fd-bb53-0185067926a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b34275f2-dfb0-4cd8-bac0-3e182fcb2fca", "tag": "67f04c76-8cac-4431-9345-83cef2ae8f77"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:01:27.667132 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-1a9c185b-c702-45fe-a186-e7bc3c6aea8e req-35e9bb8a-6dcc-49fd-bb53-0185067926a6 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:27.668462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-1a9c185b-c702-45fe-a186-e7bc3c6aea8e req-35e9bb8a-6dcc-49fd-bb53-0185067926a6 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:27.679580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-1a9c185b-c702-45fe-a186-e7bc3c6aea8e req-35e9bb8a-6dcc-49fd-bb53-0185067926a6 service nova] Creating event network-changed:67f04c76-8cac-4431-9345-83cef2ae8f77 for instance b34275f2-dfb0-4cd8-bac0-3e182fcb2fca on hv-cinder-82002 Jul 21 22:01:27.685315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-1a9c185b-c702-45fe-a186-e7bc3c6aea8e req-35e9bb8a-6dcc-49fd-bb53-0185067926a6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031865 Jul 21 22:01:27.685916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 164/315] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:01:27.788146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3219cadf-69d5-48ca-b1e3-c37207f43ac7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:27.799589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3219cadf-69d5-48ca-b1e3-c37207f43ac7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.209395 Jul 21 22:01:27.800382 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 152/316] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:27 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:01:28.417125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2b1b4b89-67eb-4e15-9be6-e18da3759381 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:28.417769 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2b1b4b89-67eb-4e15-9be6-e18da3759381 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:28.424056 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2b1b4b89-67eb-4e15-9be6-e18da3759381 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:28.424502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2b1b4b89-67eb-4e15-9be6-e18da3759381 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:28.425263 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2b1b4b89-67eb-4e15-9be6-e18da3759381 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:28.425697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2b1b4b89-67eb-4e15-9be6-e18da3759381 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:28.556235 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2b1b4b89-67eb-4e15-9be6-e18da3759381 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:28.564329 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2b1b4b89-67eb-4e15-9be6-e18da3759381 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1319 microversion: 2.1 time: 0.151889 Jul 21 22:01:28.564951 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 165/317] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:28 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:01:28.816104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7e767b03-ac7a-4d44-9db8-0d10f6fc054c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:28.816650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7e767b03-ac7a-4d44-9db8-0d10f6fc054c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:28.823337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7e767b03-ac7a-4d44-9db8-0d10f6fc054c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:28.824492 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7e767b03-ac7a-4d44-9db8-0d10f6fc054c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:28.825271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7e767b03-ac7a-4d44-9db8-0d10f6fc054c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:28.825705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7e767b03-ac7a-4d44-9db8-0d10f6fc054c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:29.205303 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7e767b03-ac7a-4d44-9db8-0d10f6fc054c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:29.214020 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7e767b03-ac7a-4d44-9db8-0d10f6fc054c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.401749 Jul 21 22:01:29.215206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 153/318] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:28 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:29.581770 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2e3c0fc6-d57c-4edc-b1a8-8d51823b2c0f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:29.582297 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2e3c0fc6-d57c-4edc-b1a8-8d51823b2c0f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:29.588747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e3c0fc6-d57c-4edc-b1a8-8d51823b2c0f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:29.589851 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e3c0fc6-d57c-4edc-b1a8-8d51823b2c0f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:29.591015 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e3c0fc6-d57c-4edc-b1a8-8d51823b2c0f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:29.591469 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e3c0fc6-d57c-4edc-b1a8-8d51823b2c0f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:29.727656 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2e3c0fc6-d57c-4edc-b1a8-8d51823b2c0f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:29.735581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2e3c0fc6-d57c-4edc-b1a8-8d51823b2c0f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1319 microversion: 2.1 time: 0.157687 Jul 21 22:01:29.736385 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 166/319] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:29 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:30.231767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c0b8f65f-7ca8-47a9-b989-938b6fdf39fc tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:30.232408 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c0b8f65f-7ca8-47a9-b989-938b6fdf39fc tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:30.239253 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c0b8f65f-7ca8-47a9-b989-938b6fdf39fc tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:30.239850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c0b8f65f-7ca8-47a9-b989-938b6fdf39fc tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:30.240648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c0b8f65f-7ca8-47a9-b989-938b6fdf39fc tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:30.241152 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c0b8f65f-7ca8-47a9-b989-938b6fdf39fc tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:30.380432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c0b8f65f-7ca8-47a9-b989-938b6fdf39fc tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:30.387928 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c0b8f65f-7ca8-47a9-b989-938b6fdf39fc tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.160188 Jul 21 22:01:30.388490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 154/320] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:30 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:30.752061 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d1a2646b-f617-49a6-b972-c15a9e5a4989 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:30.752659 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d1a2646b-f617-49a6-b972-c15a9e5a4989 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:30.759050 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1a2646b-f617-49a6-b972-c15a9e5a4989 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:30.759510 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1a2646b-f617-49a6-b972-c15a9e5a4989 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:30.760305 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1a2646b-f617-49a6-b972-c15a9e5a4989 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:30.760766 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1a2646b-f617-49a6-b972-c15a9e5a4989 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:30.899600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d1a2646b-f617-49a6-b972-c15a9e5a4989 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:30.910048 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d1a2646b-f617-49a6-b972-c15a9e5a4989 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1319 microversion: 2.1 time: 0.161860 Jul 21 22:01:30.910633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 167/321] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:30 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:31.405215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a593f6ee-3f09-4f2d-9dd3-c71bdc481e6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:31.405825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a593f6ee-3f09-4f2d-9dd3-c71bdc481e6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:31.412457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a593f6ee-3f09-4f2d-9dd3-c71bdc481e6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:31.412907 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a593f6ee-3f09-4f2d-9dd3-c71bdc481e6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:31.413731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a593f6ee-3f09-4f2d-9dd3-c71bdc481e6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:31.414110 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a593f6ee-3f09-4f2d-9dd3-c71bdc481e6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:31.544788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a593f6ee-3f09-4f2d-9dd3-c71bdc481e6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:31.552552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a593f6ee-3f09-4f2d-9dd3-c71bdc481e6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.151749 Jul 21 22:01:31.553160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 155/322] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:31 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:31.927938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4eefbfa2-5c92-4ad1-9c06-eb31e1b5f81e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:31.928514 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4eefbfa2-5c92-4ad1-9c06-eb31e1b5f81e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:31.935565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4eefbfa2-5c92-4ad1-9c06-eb31e1b5f81e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:31.936013 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4eefbfa2-5c92-4ad1-9c06-eb31e1b5f81e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:31.936932 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4eefbfa2-5c92-4ad1-9c06-eb31e1b5f81e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:31.937367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4eefbfa2-5c92-4ad1-9c06-eb31e1b5f81e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:32.117599 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4eefbfa2-5c92-4ad1-9c06-eb31e1b5f81e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:32.125983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4eefbfa2-5c92-4ad1-9c06-eb31e1b5f81e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1319 microversion: 2.1 time: 0.201947 Jul 21 22:01:32.136483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 168/323] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:31 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:32.571312 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a7597cec-2bf1-4fe6-aace-3f192f2bf37a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:32.572236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a7597cec-2bf1-4fe6-aace-3f192f2bf37a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:32.580412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7597cec-2bf1-4fe6-aace-3f192f2bf37a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:32.581261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7597cec-2bf1-4fe6-aace-3f192f2bf37a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:32.582324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7597cec-2bf1-4fe6-aace-3f192f2bf37a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:32.582932 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7597cec-2bf1-4fe6-aace-3f192f2bf37a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:32.747194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a7597cec-2bf1-4fe6-aace-3f192f2bf37a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:32.754758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a7597cec-2bf1-4fe6-aace-3f192f2bf37a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.188873 Jul 21 22:01:32.764764 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 156/324] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:32 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:33.143360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-161d29d0-0695-4312-8a6b-13ea9834ae30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:33.143987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-161d29d0-0695-4312-8a6b-13ea9834ae30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:33.149869 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-161d29d0-0695-4312-8a6b-13ea9834ae30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:33.150324 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-161d29d0-0695-4312-8a6b-13ea9834ae30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:33.151121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-161d29d0-0695-4312-8a6b-13ea9834ae30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:33.151568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-161d29d0-0695-4312-8a6b-13ea9834ae30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:33.291205 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-161d29d0-0695-4312-8a6b-13ea9834ae30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:33.299666 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-161d29d0-0695-4312-8a6b-13ea9834ae30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1319 microversion: 2.1 time: 0.160010 Jul 21 22:01:33.300256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 169/325] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:33 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:01:33.773019 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5c5ca89a-6e93-4ac7-9881-dd472a2faa68 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:33.773546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5c5ca89a-6e93-4ac7-9881-dd472a2faa68 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:33.780807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5c5ca89a-6e93-4ac7-9881-dd472a2faa68 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:33.781258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5c5ca89a-6e93-4ac7-9881-dd472a2faa68 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:33.782265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5c5ca89a-6e93-4ac7-9881-dd472a2faa68 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:33.782705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5c5ca89a-6e93-4ac7-9881-dd472a2faa68 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:33.941840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5c5ca89a-6e93-4ac7-9881-dd472a2faa68 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:33.951815 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5c5ca89a-6e93-4ac7-9881-dd472a2faa68 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.181291 Jul 21 22:01:33.951815 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 157/326] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:33 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:34.124678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-38809c63-bfff-46d6-87e2-964ceb851444 req-529db57a-33df-4e7e-b0db-4c067032799e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc368e51-a804-44e7-8341-b5a36c3173a5", "name": "network-vif-plugged", "status": "completed", "tag": "ea05b6f6-1e21-4d99-948d-a0fa000d0aea"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:01:34.132985 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-38809c63-bfff-46d6-87e2-964ceb851444 req-529db57a-33df-4e7e-b0db-4c067032799e service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:34.133448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-38809c63-bfff-46d6-87e2-964ceb851444 req-529db57a-33df-4e7e-b0db-4c067032799e service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:34.298931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-38809c63-bfff-46d6-87e2-964ceb851444 req-529db57a-33df-4e7e-b0db-4c067032799e service nova] Creating event network-vif-plugged:ea05b6f6-1e21-4d99-948d-a0fa000d0aea for instance bc368e51-a804-44e7-8341-b5a36c3173a5 on hv-cinder-82002 Jul 21 22:01:34.303921 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-38809c63-bfff-46d6-87e2-964ceb851444 req-529db57a-33df-4e7e-b0db-4c067032799e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183276 Jul 21 22:01:34.304451 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 170/327] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:01:34.317436 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3c1c64a6-4ca6-4881-b65b-9066eedec763 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:34.318049 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3c1c64a6-4ca6-4881-b65b-9066eedec763 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:34.324799 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3c1c64a6-4ca6-4881-b65b-9066eedec763 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:34.325247 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3c1c64a6-4ca6-4881-b65b-9066eedec763 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:34.326008 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3c1c64a6-4ca6-4881-b65b-9066eedec763 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:34.326442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3c1c64a6-4ca6-4881-b65b-9066eedec763 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:34.468644 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3c1c64a6-4ca6-4881-b65b-9066eedec763 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:34.476276 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3c1c64a6-4ca6-4881-b65b-9066eedec763 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1319 microversion: 2.1 time: 0.162553 Jul 21 22:01:34.476856 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 158/328] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:34 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:34.967733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b7fa04cc-3eed-402c-9a87-28a87bcfe2a9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:34.968436 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b7fa04cc-3eed-402c-9a87-28a87bcfe2a9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:34.974779 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b7fa04cc-3eed-402c-9a87-28a87bcfe2a9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:34.975276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b7fa04cc-3eed-402c-9a87-28a87bcfe2a9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:34.976054 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b7fa04cc-3eed-402c-9a87-28a87bcfe2a9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:34.976498 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b7fa04cc-3eed-402c-9a87-28a87bcfe2a9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:35.099771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:35.109702 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b7fa04cc-3eed-402c-9a87-28a87bcfe2a9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:35.117058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b7fa04cc-3eed-402c-9a87-28a87bcfe2a9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.153859 Jul 21 22:01:35.117610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 171/329] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:34 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:35.493180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e654a3fa-c022-4c05-9eb6-60d28ccf60cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:35.493817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e654a3fa-c022-4c05-9eb6-60d28ccf60cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:35.496109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:35.496777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=6 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:35.503207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e654a3fa-c022-4c05-9eb6-60d28ccf60cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:35.503600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e654a3fa-c022-4c05-9eb6-60d28ccf60cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:35.504365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e654a3fa-c022-4c05-9eb6-60d28ccf60cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:35.504798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e654a3fa-c022-4c05-9eb6-60d28ccf60cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:35.634593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e654a3fa-c022-4c05-9eb6-60d28ccf60cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:35.642723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e654a3fa-c022-4c05-9eb6-60d28ccf60cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1319 microversion: 2.1 time: 0.153440 Jul 21 22:01:35.643333 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 159/330] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:35 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:36.133808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3b0328ae-4839-4177-a39e-dd21d7f16634 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:36.134538 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3b0328ae-4839-4177-a39e-dd21d7f16634 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:36.137011 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:36.142483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3b0328ae-4839-4177-a39e-dd21d7f16634 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:36.142940 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3b0328ae-4839-4177-a39e-dd21d7f16634 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:36.143755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3b0328ae-4839-4177-a39e-dd21d7f16634 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:36.144203 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3b0328ae-4839-4177-a39e-dd21d7f16634 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:36.307070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3b0328ae-4839-4177-a39e-dd21d7f16634 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:36.315470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3b0328ae-4839-4177-a39e-dd21d7f16634 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1265 microversion: 2.1 time: 0.185414 Jul 21 22:01:36.316219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 172/331] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:36 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:36.318441 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-897efc72-97d5-408c-a663-9113a89c89af req-cbbaef89-34bb-46fa-bfd0-32fdb3dd045e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34275f2-dfb0-4cd8-bac0-3e182fcb2fca", "name": "network-vif-plugged", "status": "completed", "tag": "67f04c76-8cac-4431-9345-83cef2ae8f77"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:01:36.327398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-897efc72-97d5-408c-a663-9113a89c89af req-cbbaef89-34bb-46fa-bfd0-32fdb3dd045e service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:36.327849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-897efc72-97d5-408c-a663-9113a89c89af req-cbbaef89-34bb-46fa-bfd0-32fdb3dd045e service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:36.346546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-897efc72-97d5-408c-a663-9113a89c89af req-cbbaef89-34bb-46fa-bfd0-32fdb3dd045e service nova] Creating event network-vif-plugged:67f04c76-8cac-4431-9345-83cef2ae8f77 for instance b34275f2-dfb0-4cd8-bac0-3e182fcb2fca on hv-cinder-82002 Jul 21 22:01:36.351593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-897efc72-97d5-408c-a663-9113a89c89af req-cbbaef89-34bb-46fa-bfd0-32fdb3dd045e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036879 Jul 21 22:01:36.352189 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 160/332] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:01:36.660026 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8d90dfe3-8a2f-4b94-ad43-cac9a79bd436 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:36.668694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8d90dfe3-8a2f-4b94-ad43-cac9a79bd436 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:36.678906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8d90dfe3-8a2f-4b94-ad43-cac9a79bd436 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:36.678906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8d90dfe3-8a2f-4b94-ad43-cac9a79bd436 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:36.679556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8d90dfe3-8a2f-4b94-ad43-cac9a79bd436 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:36.679993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8d90dfe3-8a2f-4b94-ad43-cac9a79bd436 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:36.817572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8d90dfe3-8a2f-4b94-ad43-cac9a79bd436 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:36.825026 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8d90dfe3-8a2f-4b94-ad43-cac9a79bd436 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1319 microversion: 2.1 time: 0.169095 Jul 21 22:01:36.825559 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 173/333] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:36 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:37.333931 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f5c69e39-502b-46b6-9d5f-43a29468b7d0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:37.334624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f5c69e39-502b-46b6-9d5f-43a29468b7d0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:37.341877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5c69e39-502b-46b6-9d5f-43a29468b7d0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:37.342325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5c69e39-502b-46b6-9d5f-43a29468b7d0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:37.343155 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5c69e39-502b-46b6-9d5f-43a29468b7d0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:37.343588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5c69e39-502b-46b6-9d5f-43a29468b7d0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:37.480728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f5c69e39-502b-46b6-9d5f-43a29468b7d0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:37.488448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f5c69e39-502b-46b6-9d5f-43a29468b7d0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1451 microversion: 2.1 time: 0.159173 Jul 21 22:01:37.489034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 161/334] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:37 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:37.505324 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ef3340be-b388-4b60-a869-067dc64412e2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:37.505966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ef3340be-b388-4b60-a869-067dc64412e2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:37.512595 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ef3340be-b388-4b60-a869-067dc64412e2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:37.513045 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ef3340be-b388-4b60-a869-067dc64412e2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:37.513810 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ef3340be-b388-4b60-a869-067dc64412e2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:37.514246 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ef3340be-b388-4b60-a869-067dc64412e2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:37.650374 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ef3340be-b388-4b60-a869-067dc64412e2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:37.658118 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ef3340be-b388-4b60-a869-067dc64412e2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1451 microversion: 2.1 time: 0.156590 Jul 21 22:01:37.658688 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 174/335] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:37 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:37.841966 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-83daf7a0-b3a2-4f56-8209-9f013ea4cc8f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:37.842578 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-83daf7a0-b3a2-4f56-8209-9f013ea4cc8f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:37.848694 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-83daf7a0-b3a2-4f56-8209-9f013ea4cc8f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:37.849147 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-83daf7a0-b3a2-4f56-8209-9f013ea4cc8f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:37.849926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-83daf7a0-b3a2-4f56-8209-9f013ea4cc8f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:37.850362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-83daf7a0-b3a2-4f56-8209-9f013ea4cc8f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:37.990744 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-83daf7a0-b3a2-4f56-8209-9f013ea4cc8f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:37.999135 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-83daf7a0-b3a2-4f56-8209-9f013ea4cc8f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1319 microversion: 2.1 time: 0.161240 Jul 21 22:01:37.999752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 162/336] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:37 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:39.017282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-14ddc047-2e40-4cdb-86fc-3a53a145eada tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:39.017984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-14ddc047-2e40-4cdb-86fc-3a53a145eada tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:39.024393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-14ddc047-2e40-4cdb-86fc-3a53a145eada tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:39.024899 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-14ddc047-2e40-4cdb-86fc-3a53a145eada tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:39.025883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-14ddc047-2e40-4cdb-86fc-3a53a145eada tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:39.026447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-14ddc047-2e40-4cdb-86fc-3a53a145eada tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:39.174126 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-14ddc047-2e40-4cdb-86fc-3a53a145eada tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:39.181539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-14ddc047-2e40-4cdb-86fc-3a53a145eada tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1319 microversion: 2.1 time: 0.168502 Jul 21 22:01:39.182202 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 175/337] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:39 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:39.739826 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-c714cfc5-7108-4c4e-bcc3-840a4727950b req-06044766-4dc5-47bb-8e83-088f45a8305d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc368e51-a804-44e7-8341-b5a36c3173a5", "tag": "ea05b6f6-1e21-4d99-948d-a0fa000d0aea"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:01:39.743880 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:39.750133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-c714cfc5-7108-4c4e-bcc3-840a4727950b req-06044766-4dc5-47bb-8e83-088f45a8305d service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:39.750698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-c714cfc5-7108-4c4e-bcc3-840a4727950b req-06044766-4dc5-47bb-8e83-088f45a8305d service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:39.765429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-c714cfc5-7108-4c4e-bcc3-840a4727950b req-06044766-4dc5-47bb-8e83-088f45a8305d service nova] Creating event network-changed:ea05b6f6-1e21-4d99-948d-a0fa000d0aea for instance bc368e51-a804-44e7-8341-b5a36c3173a5 on hv-cinder-82002 Jul 21 22:01:39.771603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-c714cfc5-7108-4c4e-bcc3-840a4727950b req-06044766-4dc5-47bb-8e83-088f45a8305d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035059 Jul 21 22:01:39.772353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 163/338] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:01:40.199551 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2875a835-1e46-4a69-874d-52b056a629b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:40.200832 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2875a835-1e46-4a69-874d-52b056a629b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:40.206935 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2875a835-1e46-4a69-874d-52b056a629b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:40.207664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2875a835-1e46-4a69-874d-52b056a629b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:40.208503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2875a835-1e46-4a69-874d-52b056a629b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:40.209012 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2875a835-1e46-4a69-874d-52b056a629b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:40.350642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2875a835-1e46-4a69-874d-52b056a629b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:01:40.359512 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2875a835-1e46-4a69-874d-52b056a629b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1507 microversion: 2.1 time: 0.164468 Jul 21 22:01:40.364622 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 176/339] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:01:40 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:01:59.153392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-72210518-ca9c-4cac-8ab0-d2c9423a7ea8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:01:59.154351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-72210518-ca9c-4cac-8ab0-d2c9423a7ea8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:01:59.156349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=71 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:59.156973 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:01:59.165096 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72210518-ca9c-4cac-8ab0-d2c9423a7ea8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:59.165545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72210518-ca9c-4cac-8ab0-d2c9423a7ea8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:59.166826 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72210518-ca9c-4cac-8ab0-d2c9423a7ea8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:01:59.167291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72210518-ca9c-4cac-8ab0-d2c9423a7ea8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:01:59.194359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-72210518-ca9c-4cac-8ab0-d2c9423a7ea8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/ips" status: 200 len: 150 microversion: 2.20 time: 0.045257 Jul 21 22:01:59.194918 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 164/340] 10.222.0.44 () {60 vars in 1288 bytes} [Thu Jul 21 22:01:59 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:02:02.788729 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e22e0a6b-2bf2-4388-83af-e942f31bd7ad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:02:02.789308 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e22e0a6b-2bf2-4388-83af-e942f31bd7ad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:02.791278 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=9 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:02:02.791932 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=75 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:02:02.798811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e22e0a6b-2bf2-4388-83af-e942f31bd7ad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:02.799282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e22e0a6b-2bf2-4388-83af-e942f31bd7ad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:02.800068 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e22e0a6b-2bf2-4388-83af-e942f31bd7ad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:02.800623 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e22e0a6b-2bf2-4388-83af-e942f31bd7ad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:02.826215 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-e22e0a6b-2bf2-4388-83af-e942f31bd7ad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lazy-loading 'flavor' on Instance uuid 84e2efbe-11d4-4ecc-8825-11f420d36f03 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:02:03.106217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e22e0a6b-2bf2-4388-83af-e942f31bd7ad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "POST /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/action" status: 202 len: 0 microversion: 2.20 time: 0.321098 Jul 21 22:02:03.106942 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 177/341] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jul 21 22:02:02 2022] POST /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:02:03.117168 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0ef324ba-00d7-4bd6-9a80-2fc7d250b458 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:03.117767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0ef324ba-00d7-4bd6-9a80-2fc7d250b458 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:03.124655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0ef324ba-00d7-4bd6-9a80-2fc7d250b458 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:03.125145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0ef324ba-00d7-4bd6-9a80-2fc7d250b458 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:03.125883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0ef324ba-00d7-4bd6-9a80-2fc7d250b458 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:03.126368 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0ef324ba-00d7-4bd6-9a80-2fc7d250b458 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:03.271532 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0ef324ba-00d7-4bd6-9a80-2fc7d250b458 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:03.279747 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0ef324ba-00d7-4bd6-9a80-2fc7d250b458 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:03.281265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0ef324ba-00d7-4bd6-9a80-2fc7d250b458 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:03.282420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0ef324ba-00d7-4bd6-9a80-2fc7d250b458 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.170192 Jul 21 22:02:03.282973 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 165/342] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:03 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:03.670187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8f29399b-54a4-4941-b914-33e00b61317e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:03.670767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8f29399b-54a4-4941-b914-33e00b61317e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:03.677116 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f29399b-54a4-4941-b914-33e00b61317e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:03.677584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f29399b-54a4-4941-b914-33e00b61317e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:03.678391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f29399b-54a4-4941-b914-33e00b61317e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:03.678828 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f29399b-54a4-4941-b914-33e00b61317e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:03.703084 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8f29399b-54a4-4941-b914-33e00b61317e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/ips" status: 200 len: 145 microversion: 2.1 time: 0.037607 Jul 21 22:02:03.703663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 178/343] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 22:02:03 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:02:04.302328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a582a87b-abe2-4103-9572-83a4f0f98148 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:04.303150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a582a87b-abe2-4103-9572-83a4f0f98148 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:04.311313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a582a87b-abe2-4103-9572-83a4f0f98148 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:04.311976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a582a87b-abe2-4103-9572-83a4f0f98148 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:04.313066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a582a87b-abe2-4103-9572-83a4f0f98148 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:04.313728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a582a87b-abe2-4103-9572-83a4f0f98148 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:04.483899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a582a87b-abe2-4103-9572-83a4f0f98148 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:04.491960 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a582a87b-abe2-4103-9572-83a4f0f98148 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:04.493480 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a582a87b-abe2-4103-9572-83a4f0f98148 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:04.495166 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a582a87b-abe2-4103-9572-83a4f0f98148 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.197770 Jul 21 22:02:04.495731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 166/344] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:04 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:05.514264 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-afd0c23d-b034-4ae4-a6b7-d4bf12bdf73d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:05.514864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-afd0c23d-b034-4ae4-a6b7-d4bf12bdf73d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:05.521587 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-afd0c23d-b034-4ae4-a6b7-d4bf12bdf73d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:05.522209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-afd0c23d-b034-4ae4-a6b7-d4bf12bdf73d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:05.523729 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-afd0c23d-b034-4ae4-a6b7-d4bf12bdf73d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:05.524546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-afd0c23d-b034-4ae4-a6b7-d4bf12bdf73d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:05.661534 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-afd0c23d-b034-4ae4-a6b7-d4bf12bdf73d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:05.669867 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-afd0c23d-b034-4ae4-a6b7-d4bf12bdf73d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:05.671417 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-afd0c23d-b034-4ae4-a6b7-d4bf12bdf73d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:05.672566 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-afd0c23d-b034-4ae4-a6b7-d4bf12bdf73d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.162372 Jul 21 22:02:05.673251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 179/345] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:05 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:06.690768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-22685f5a-6675-43a7-aa52-161571f21ed9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:06.691434 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-22685f5a-6675-43a7-aa52-161571f21ed9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:06.698042 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-22685f5a-6675-43a7-aa52-161571f21ed9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:06.698492 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-22685f5a-6675-43a7-aa52-161571f21ed9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:06.699295 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-22685f5a-6675-43a7-aa52-161571f21ed9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:06.699729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-22685f5a-6675-43a7-aa52-161571f21ed9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:06.832903 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-22685f5a-6675-43a7-aa52-161571f21ed9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:06.842183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-22685f5a-6675-43a7-aa52-161571f21ed9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:06.844035 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-22685f5a-6675-43a7-aa52-161571f21ed9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:06.845766 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-22685f5a-6675-43a7-aa52-161571f21ed9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.158798 Jul 21 22:02:06.846433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 167/346] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:06 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:06.996889 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-83bb01ee-d663-42ae-a36c-ce029c6c0773 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87559f54-5fd6-4f81-9742-d876e6902bdc"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:02:06.998019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-83bb01ee-d663-42ae-a36c-ce029c6c0773 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:07.005490 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83bb01ee-d663-42ae-a36c-ce029c6c0773 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:07.005952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83bb01ee-d663-42ae-a36c-ce029c6c0773 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:07.006727 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83bb01ee-d663-42ae-a36c-ce029c6c0773 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:07.007527 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83bb01ee-d663-42ae-a36c-ce029c6c0773 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:07.056151 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7c9cc7c8-5252-4b9b-8a43-d09db67b2b2e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1", "device": "/dev/sdb"}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:02:07.057779 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7c9cc7c8-5252-4b9b-8a43-d09db67b2b2e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:07.064018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7c9cc7c8-5252-4b9b-8a43-d09db67b2b2e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:07.064481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7c9cc7c8-5252-4b9b-8a43-d09db67b2b2e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:07.065272 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7c9cc7c8-5252-4b9b-8a43-d09db67b2b2e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:07.065717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7c9cc7c8-5252-4b9b-8a43-d09db67b2b2e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:07.336270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-83bb01ee-d663-42ae-a36c-ce029c6c0773 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "POST /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343147 Jul 21 22:02:07.337182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 180/347] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 22:02:06 2022] POST /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:02:07.373910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7c9cc7c8-5252-4b9b-8a43-d09db67b2b2e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "POST /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321712 Jul 21 22:02:07.374640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 168/348] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 22:02:07 2022] POST /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:02:07.866835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6f4d2d03-603a-432d-a837-e8d08cd88345 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:07.867458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6f4d2d03-603a-432d-a837-e8d08cd88345 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:07.874578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f4d2d03-603a-432d-a837-e8d08cd88345 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:07.875067 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f4d2d03-603a-432d-a837-e8d08cd88345 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:07.875858 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f4d2d03-603a-432d-a837-e8d08cd88345 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:07.876307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f4d2d03-603a-432d-a837-e8d08cd88345 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:08.009961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6f4d2d03-603a-432d-a837-e8d08cd88345 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:08.018029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6f4d2d03-603a-432d-a837-e8d08cd88345 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:08.019593 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6f4d2d03-603a-432d-a837-e8d08cd88345 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:08.020824 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6f4d2d03-603a-432d-a837-e8d08cd88345 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.158906 Jul 21 22:02:08.021467 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 181/349] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:07 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:08.320474 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-91e8b003-6676-4857-9ba1-364b186980e7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:08.321034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-91e8b003-6676-4857-9ba1-364b186980e7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:08.327335 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91e8b003-6676-4857-9ba1-364b186980e7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:08.327788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91e8b003-6676-4857-9ba1-364b186980e7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:08.328562 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91e8b003-6676-4857-9ba1-364b186980e7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:08.328996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91e8b003-6676-4857-9ba1-364b186980e7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:08.354574 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-91e8b003-6676-4857-9ba1-364b186980e7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/ips" status: 200 len: 149 microversion: 2.1 time: 0.038769 Jul 21 22:02:08.355167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 169/350] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 22:02:08 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:02:09.039353 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d0a6330f-5847-4936-ad4d-5ee8ee927020 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:09.039884 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d0a6330f-5847-4936-ad4d-5ee8ee927020 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:09.046332 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d0a6330f-5847-4936-ad4d-5ee8ee927020 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:09.046790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d0a6330f-5847-4936-ad4d-5ee8ee927020 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:09.047594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d0a6330f-5847-4936-ad4d-5ee8ee927020 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:09.048041 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d0a6330f-5847-4936-ad4d-5ee8ee927020 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:09.188176 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d0a6330f-5847-4936-ad4d-5ee8ee927020 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:09.196269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d0a6330f-5847-4936-ad4d-5ee8ee927020 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:09.198446 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d0a6330f-5847-4936-ad4d-5ee8ee927020 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:09.199807 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d0a6330f-5847-4936-ad4d-5ee8ee927020 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.164340 Jul 21 22:02:09.200759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 182/351] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:09 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:09.733466 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ba89d443-d06b-4e09-980f-1d6a88bba3a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e833a0d1-aafb-4650-b1f4-e369f36f1edb"}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:02:09.734523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ba89d443-d06b-4e09-980f-1d6a88bba3a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:09.741509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba89d443-d06b-4e09-980f-1d6a88bba3a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:09.741981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba89d443-d06b-4e09-980f-1d6a88bba3a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:09.742787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba89d443-d06b-4e09-980f-1d6a88bba3a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:09.743250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba89d443-d06b-4e09-980f-1d6a88bba3a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:10.021131 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ba89d443-d06b-4e09-980f-1d6a88bba3a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "POST /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291492 Jul 21 22:02:10.022455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 170/352] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 22:02:09 2022] POST /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:02:10.220592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a562ea70-98d1-4ac0-914c-faf20703285f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:10.221217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a562ea70-98d1-4ac0-914c-faf20703285f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:10.228005 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a562ea70-98d1-4ac0-914c-faf20703285f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:10.228468 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a562ea70-98d1-4ac0-914c-faf20703285f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:10.229259 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a562ea70-98d1-4ac0-914c-faf20703285f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:10.229701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a562ea70-98d1-4ac0-914c-faf20703285f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:10.363954 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a562ea70-98d1-4ac0-914c-faf20703285f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:10.372407 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a562ea70-98d1-4ac0-914c-faf20703285f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:10.373920 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a562ea70-98d1-4ac0-914c-faf20703285f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:10.375115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a562ea70-98d1-4ac0-914c-faf20703285f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.159143 Jul 21 22:02:10.375960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 183/353] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:10 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:11.394564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9a3a7934-4cf1-4d50-8cd1-62d1adc17931 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:11.395298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9a3a7934-4cf1-4d50-8cd1-62d1adc17931 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:11.402456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a3a7934-4cf1-4d50-8cd1-62d1adc17931 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:11.402899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a3a7934-4cf1-4d50-8cd1-62d1adc17931 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:11.403687 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a3a7934-4cf1-4d50-8cd1-62d1adc17931 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:11.404127 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a3a7934-4cf1-4d50-8cd1-62d1adc17931 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:11.536940 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9a3a7934-4cf1-4d50-8cd1-62d1adc17931 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:11.545800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9a3a7934-4cf1-4d50-8cd1-62d1adc17931 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:11.547356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9a3a7934-4cf1-4d50-8cd1-62d1adc17931 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:11.548530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9a3a7934-4cf1-4d50-8cd1-62d1adc17931 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.158493 Jul 21 22:02:11.549080 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 171/354] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:11 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:12.566743 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-68ca9294-d1ee-470c-8519-24cf810b60fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:12.567370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-68ca9294-d1ee-470c-8519-24cf810b60fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:12.574108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68ca9294-d1ee-470c-8519-24cf810b60fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:12.574573 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68ca9294-d1ee-470c-8519-24cf810b60fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:12.575381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68ca9294-d1ee-470c-8519-24cf810b60fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:12.575818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68ca9294-d1ee-470c-8519-24cf810b60fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:12.739257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-68ca9294-d1ee-470c-8519-24cf810b60fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:12.753585 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-68ca9294-d1ee-470c-8519-24cf810b60fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:12.756375 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-68ca9294-d1ee-470c-8519-24cf810b60fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:12.758346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-68ca9294-d1ee-470c-8519-24cf810b60fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.195377 Jul 21 22:02:12.759332 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 184/355] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:12 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:13.776713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e7c136d2-0ef3-46f2-9186-95cbd7f6acca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:13.777314 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e7c136d2-0ef3-46f2-9186-95cbd7f6acca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:13.783817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e7c136d2-0ef3-46f2-9186-95cbd7f6acca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:13.784294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e7c136d2-0ef3-46f2-9186-95cbd7f6acca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:13.785061 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e7c136d2-0ef3-46f2-9186-95cbd7f6acca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:13.785490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e7c136d2-0ef3-46f2-9186-95cbd7f6acca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:13.920396 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e7c136d2-0ef3-46f2-9186-95cbd7f6acca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:13.928438 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e7c136d2-0ef3-46f2-9186-95cbd7f6acca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:13.929977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e7c136d2-0ef3-46f2-9186-95cbd7f6acca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:13.931360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e7c136d2-0ef3-46f2-9186-95cbd7f6acca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.158364 Jul 21 22:02:13.931916 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 172/356] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:13 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:14.924874 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-448155b4-2b6f-4051-a62a-63d5ce8ca167 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:02:14.932721 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-448155b4-2b6f-4051-a62a-63d5ce8ca167 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:14.933209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-448155b4-2b6f-4051-a62a-63d5ce8ca167 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:14.950276 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2251a16d-5ab8-4325-8e71-565abb055731 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:14.951574 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2251a16d-5ab8-4325-8e71-565abb055731 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:14.958308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2251a16d-5ab8-4325-8e71-565abb055731 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:14.958762 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2251a16d-5ab8-4325-8e71-565abb055731 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:14.959571 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2251a16d-5ab8-4325-8e71-565abb055731 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:14.960009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2251a16d-5ab8-4325-8e71-565abb055731 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:15.001417 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-448155b4-2b6f-4051-a62a-63d5ce8ca167 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Going to try to stop instance {{(pid=117978) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 21 22:02:15.050939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-448155b4-2b6f-4051-a62a-63d5ce8ca167 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "POST /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/action" status: 202 len: 0 microversion: 2.1 time: 0.131721 Jul 21 22:02:15.054672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 185/357] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 22:02:14 2022] POST /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:02:15.060344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c584b4d2-cc5e-4727-bf18-3cbe135c29cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:15.061295 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c584b4d2-cc5e-4727-bf18-3cbe135c29cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:15.067692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c584b4d2-cc5e-4727-bf18-3cbe135c29cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:15.068000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c584b4d2-cc5e-4727-bf18-3cbe135c29cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:15.068859 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c584b4d2-cc5e-4727-bf18-3cbe135c29cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:15.069549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c584b4d2-cc5e-4727-bf18-3cbe135c29cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:15.131194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2251a16d-5ab8-4325-8e71-565abb055731 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:15.140706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2251a16d-5ab8-4325-8e71-565abb055731 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:15.142230 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2251a16d-5ab8-4325-8e71-565abb055731 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:15.143470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2251a16d-5ab8-4325-8e71-565abb055731 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.197607 Jul 21 22:02:15.144031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 173/358] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:14 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:15.226318 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c584b4d2-cc5e-4727-bf18-3cbe135c29cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:15.234957 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c584b4d2-cc5e-4727-bf18-3cbe135c29cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.179155 Jul 21 22:02:15.235554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 186/359] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:15 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:02:16.162115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e50ca988-9204-474f-b342-d5a99a118aef tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:16.162784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e50ca988-9204-474f-b342-d5a99a118aef tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:16.170268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e50ca988-9204-474f-b342-d5a99a118aef tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:16.170741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e50ca988-9204-474f-b342-d5a99a118aef tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:16.171570 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e50ca988-9204-474f-b342-d5a99a118aef tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:16.172040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e50ca988-9204-474f-b342-d5a99a118aef tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:16.252534 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0bce863e-b5c1-4175-91a3-95acfb209b28 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:16.253151 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0bce863e-b5c1-4175-91a3-95acfb209b28 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:16.259891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bce863e-b5c1-4175-91a3-95acfb209b28 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:16.260346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bce863e-b5c1-4175-91a3-95acfb209b28 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:16.261131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bce863e-b5c1-4175-91a3-95acfb209b28 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:16.261574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bce863e-b5c1-4175-91a3-95acfb209b28 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:16.316234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e50ca988-9204-474f-b342-d5a99a118aef tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:16.324613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e50ca988-9204-474f-b342-d5a99a118aef tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:16.326222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e50ca988-9204-474f-b342-d5a99a118aef tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:16.327566 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e50ca988-9204-474f-b342-d5a99a118aef tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.169566 Jul 21 22:02:16.328231 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 174/360] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:16 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:16.405047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0bce863e-b5c1-4175-91a3-95acfb209b28 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:16.413500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0bce863e-b5c1-4175-91a3-95acfb209b28 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.164727 Jul 21 22:02:16.413993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 187/361] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:16 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:02:17.347385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-24529e4e-7177-4543-ac8e-9ec1b7e3d953 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:17.348171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-24529e4e-7177-4543-ac8e-9ec1b7e3d953 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:17.354479 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-24529e4e-7177-4543-ac8e-9ec1b7e3d953 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:17.354932 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-24529e4e-7177-4543-ac8e-9ec1b7e3d953 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:17.355741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-24529e4e-7177-4543-ac8e-9ec1b7e3d953 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:17.356183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-24529e4e-7177-4543-ac8e-9ec1b7e3d953 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:17.431489 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-64b0a38b-e05d-4ae8-8ca2-bd07b5af402e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:17.432250 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-64b0a38b-e05d-4ae8-8ca2-bd07b5af402e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:17.438914 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64b0a38b-e05d-4ae8-8ca2-bd07b5af402e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:17.439608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64b0a38b-e05d-4ae8-8ca2-bd07b5af402e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:17.440402 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64b0a38b-e05d-4ae8-8ca2-bd07b5af402e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:17.440848 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64b0a38b-e05d-4ae8-8ca2-bd07b5af402e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:17.531176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-24529e4e-7177-4543-ac8e-9ec1b7e3d953 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:17.539451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-24529e4e-7177-4543-ac8e-9ec1b7e3d953 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:17.541341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-24529e4e-7177-4543-ac8e-9ec1b7e3d953 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:17.542521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-24529e4e-7177-4543-ac8e-9ec1b7e3d953 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.200284 Jul 21 22:02:17.543057 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 175/362] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:17 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:17.613762 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-64b0a38b-e05d-4ae8-8ca2-bd07b5af402e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:17.622589 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-64b0a38b-e05d-4ae8-8ca2-bd07b5af402e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.195488 Jul 21 22:02:17.623197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 188/363] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:17 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:02:18.560761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9855681a-e2ae-460f-a07f-f127aef92d32 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:18.561357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9855681a-e2ae-460f-a07f-f127aef92d32 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:18.567892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9855681a-e2ae-460f-a07f-f127aef92d32 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:18.568390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9855681a-e2ae-460f-a07f-f127aef92d32 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:18.569104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9855681a-e2ae-460f-a07f-f127aef92d32 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:18.569538 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9855681a-e2ae-460f-a07f-f127aef92d32 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:18.640208 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-912b7a05-eae3-4209-959e-44be12044b74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:18.640815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-912b7a05-eae3-4209-959e-44be12044b74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:18.647253 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-912b7a05-eae3-4209-959e-44be12044b74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:18.647710 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-912b7a05-eae3-4209-959e-44be12044b74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:18.648799 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-912b7a05-eae3-4209-959e-44be12044b74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:18.649282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-912b7a05-eae3-4209-959e-44be12044b74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:18.669205 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:02:18.738317 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9855681a-e2ae-460f-a07f-f127aef92d32 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:18.746951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9855681a-e2ae-460f-a07f-f127aef92d32 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:18.748501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9855681a-e2ae-460f-a07f-f127aef92d32 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:18.749682 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9855681a-e2ae-460f-a07f-f127aef92d32 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.192823 Jul 21 22:02:18.750242 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 176/364] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:18 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:18.799123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-912b7a05-eae3-4209-959e-44be12044b74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:18.807866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-912b7a05-eae3-4209-959e-44be12044b74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.171494 Jul 21 22:02:18.808454 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 189/365] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:18 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:02:19.768687 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9b2e6780-c6bc-4b15-aadd-970d52f8fb41 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:19.769301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9b2e6780-c6bc-4b15-aadd-970d52f8fb41 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:19.776717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b2e6780-c6bc-4b15-aadd-970d52f8fb41 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:19.777148 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b2e6780-c6bc-4b15-aadd-970d52f8fb41 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:19.777926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b2e6780-c6bc-4b15-aadd-970d52f8fb41 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:19.778367 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b2e6780-c6bc-4b15-aadd-970d52f8fb41 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:19.825268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d07e6562-15cf-4fa0-b959-1b892ba0ef49 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:19.825881 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d07e6562-15cf-4fa0-b959-1b892ba0ef49 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:19.832363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d07e6562-15cf-4fa0-b959-1b892ba0ef49 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:19.832816 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d07e6562-15cf-4fa0-b959-1b892ba0ef49 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:19.833625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d07e6562-15cf-4fa0-b959-1b892ba0ef49 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:19.834075 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d07e6562-15cf-4fa0-b959-1b892ba0ef49 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:19.952549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9b2e6780-c6bc-4b15-aadd-970d52f8fb41 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:19.961004 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9b2e6780-c6bc-4b15-aadd-970d52f8fb41 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:19.962661 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9b2e6780-c6bc-4b15-aadd-970d52f8fb41 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:19.964031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9b2e6780-c6bc-4b15-aadd-970d52f8fb41 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1721 microversion: 2.20 time: 0.199080 Jul 21 22:02:19.964454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 177/366] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:19 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:19.997505 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d07e6562-15cf-4fa0-b959-1b892ba0ef49 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:20.005771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d07e6562-15cf-4fa0-b959-1b892ba0ef49 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.184759 Jul 21 22:02:20.006282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 190/367] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:19 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:02:20.982325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d4d74702-92d6-437d-8ec8-5e08b124dfb3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:20.982927 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d4d74702-92d6-437d-8ec8-5e08b124dfb3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:20.989430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d4d74702-92d6-437d-8ec8-5e08b124dfb3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:20.989880 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d4d74702-92d6-437d-8ec8-5e08b124dfb3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:20.990640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d4d74702-92d6-437d-8ec8-5e08b124dfb3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:20.991166 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d4d74702-92d6-437d-8ec8-5e08b124dfb3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:21.010055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:02:21.022665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ec9e2d7f-3c89-402a-a746-f5f8ec5e1191 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:21.024047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ec9e2d7f-3c89-402a-a746-f5f8ec5e1191 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:21.031181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec9e2d7f-3c89-402a-a746-f5f8ec5e1191 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:21.031647 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec9e2d7f-3c89-402a-a746-f5f8ec5e1191 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:21.032766 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec9e2d7f-3c89-402a-a746-f5f8ec5e1191 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:21.033591 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec9e2d7f-3c89-402a-a746-f5f8ec5e1191 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:21.186748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d4d74702-92d6-437d-8ec8-5e08b124dfb3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:21.203975 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d4d74702-92d6-437d-8ec8-5e08b124dfb3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:21.205613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d4d74702-92d6-437d-8ec8-5e08b124dfb3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:21.206886 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d4d74702-92d6-437d-8ec8-5e08b124dfb3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1742 microversion: 2.20 time: 0.228593 Jul 21 22:02:21.207472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 178/368] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:20 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1742 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:21.214156 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ec9e2d7f-3c89-402a-a746-f5f8ec5e1191 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:21.222347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ec9e2d7f-3c89-402a-a746-f5f8ec5e1191 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.203673 Jul 21 22:02:21.222908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 191/369] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:21 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:02:22.225617 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c2d105f1-e706-4fe0-ac9b-dd672cc56aa7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:22.226332 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c2d105f1-e706-4fe0-ac9b-dd672cc56aa7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:22.233135 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2d105f1-e706-4fe0-ac9b-dd672cc56aa7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:22.233599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2d105f1-e706-4fe0-ac9b-dd672cc56aa7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:22.234626 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2d105f1-e706-4fe0-ac9b-dd672cc56aa7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:22.235123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2d105f1-e706-4fe0-ac9b-dd672cc56aa7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:22.242470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-863a1508-9557-4d12-88eb-8f0cfd61de71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:22.243271 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-863a1508-9557-4d12-88eb-8f0cfd61de71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:22.262317 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-863a1508-9557-4d12-88eb-8f0cfd61de71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:22.263034 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-863a1508-9557-4d12-88eb-8f0cfd61de71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:22.264992 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-863a1508-9557-4d12-88eb-8f0cfd61de71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:22.265642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-863a1508-9557-4d12-88eb-8f0cfd61de71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:22.482316 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-863a1508-9557-4d12-88eb-8f0cfd61de71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:22.494421 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-863a1508-9557-4d12-88eb-8f0cfd61de71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.258203 Jul 21 22:02:22.495589 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 192/370] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:22 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:02:22.502051 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c2d105f1-e706-4fe0-ac9b-dd672cc56aa7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:22.512399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c2d105f1-e706-4fe0-ac9b-dd672cc56aa7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:22.519831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c2d105f1-e706-4fe0-ac9b-dd672cc56aa7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:22.519831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c2d105f1-e706-4fe0-ac9b-dd672cc56aa7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1742 microversion: 2.20 time: 0.294781 Jul 21 22:02:22.527795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 179/371] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:22 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1742 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:23.512432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3acb7efc-9f9f-421b-89f1-cfee79097e4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:23.513039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3acb7efc-9f9f-421b-89f1-cfee79097e4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:23.519915 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3acb7efc-9f9f-421b-89f1-cfee79097e4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:23.520369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3acb7efc-9f9f-421b-89f1-cfee79097e4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:23.521152 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3acb7efc-9f9f-421b-89f1-cfee79097e4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:23.521594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3acb7efc-9f9f-421b-89f1-cfee79097e4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:23.534725 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a014c32f-f90d-475d-9950-a976e9ff2600 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:23.535364 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a014c32f-f90d-475d-9950-a976e9ff2600 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:23.542475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a014c32f-f90d-475d-9950-a976e9ff2600 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:23.542926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a014c32f-f90d-475d-9950-a976e9ff2600 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:23.543747 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a014c32f-f90d-475d-9950-a976e9ff2600 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:23.544185 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a014c32f-f90d-475d-9950-a976e9ff2600 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:23.729726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3acb7efc-9f9f-421b-89f1-cfee79097e4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:23.733531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a014c32f-f90d-475d-9950-a976e9ff2600 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:23.738524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3acb7efc-9f9f-421b-89f1-cfee79097e4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.229889 Jul 21 22:02:23.739125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 193/372] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:23 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:23.741488 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a014c32f-f90d-475d-9950-a976e9ff2600 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:23.743035 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a014c32f-f90d-475d-9950-a976e9ff2600 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:23.744265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a014c32f-f90d-475d-9950-a976e9ff2600 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1742 microversion: 2.20 time: 0.213459 Jul 21 22:02:23.744989 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 180/373] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:23 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1742 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:24.409128 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-b2c66fb0-99d3-474c-b3ad-fe9a16a7a054 req-a115a907-e36d-4611-bd4d-bd59eb3a86cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e2efbe-11d4-4ecc-8825-11f420d36f03", "name": "network-vif-plugged", "status": "completed", "tag": "978d1e0a-28ef-408b-a540-0a23b3da9c0b"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:02:24.418023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-b2c66fb0-99d3-474c-b3ad-fe9a16a7a054 req-a115a907-e36d-4611-bd4d-bd59eb3a86cc service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:24.418471 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-b2c66fb0-99d3-474c-b3ad-fe9a16a7a054 req-a115a907-e36d-4611-bd4d-bd59eb3a86cc service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:24.430948 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-b2c66fb0-99d3-474c-b3ad-fe9a16a7a054 req-a115a907-e36d-4611-bd4d-bd59eb3a86cc service nova] Creating event network-vif-plugged:978d1e0a-28ef-408b-a540-0a23b3da9c0b for instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 on hv-cinder-82002 Jul 21 22:02:24.436231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-b2c66fb0-99d3-474c-b3ad-fe9a16a7a054 req-a115a907-e36d-4611-bd4d-bd59eb3a86cc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030867 Jul 21 22:02:24.436838 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 194/374] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:02:24.756272 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c24e2e66-a668-4bcc-bf05-c53455bd8398 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:24.756943 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c24e2e66-a668-4bcc-bf05-c53455bd8398 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:24.763767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c24e2e66-a668-4bcc-bf05-c53455bd8398 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:24.764223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c24e2e66-a668-4bcc-bf05-c53455bd8398 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:24.765013 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c24e2e66-a668-4bcc-bf05-c53455bd8398 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:24.765458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c24e2e66-a668-4bcc-bf05-c53455bd8398 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:24.766144 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f704d813-acaf-4698-9465-dc101bc64321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:24.766890 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f704d813-acaf-4698-9465-dc101bc64321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:24.773475 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f704d813-acaf-4698-9465-dc101bc64321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:24.774418 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f704d813-acaf-4698-9465-dc101bc64321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:24.775315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f704d813-acaf-4698-9465-dc101bc64321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:24.775756 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f704d813-acaf-4698-9465-dc101bc64321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:24.968750 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c24e2e66-a668-4bcc-bf05-c53455bd8398 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:24.972790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f704d813-acaf-4698-9465-dc101bc64321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:24.977679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c24e2e66-a668-4bcc-bf05-c53455bd8398 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.224722 Jul 21 22:02:24.978285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 181/375] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:24 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:24.981809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f704d813-acaf-4698-9465-dc101bc64321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:24.983394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f704d813-acaf-4698-9465-dc101bc64321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:24.984538 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f704d813-acaf-4698-9465-dc101bc64321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1742 microversion: 2.20 time: 0.223160 Jul 21 22:02:24.985266 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 195/376] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:24 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1742 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:25.995577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-54992d96-7718-412e-ad8c-e3d4a063f807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:25.996198 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-54992d96-7718-412e-ad8c-e3d4a063f807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:26.001798 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-608005bb-0521-48b5-bc1f-d80371bc7df9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:26.002412 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-608005bb-0521-48b5-bc1f-d80371bc7df9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:26.002762 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-54992d96-7718-412e-ad8c-e3d4a063f807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:26.003256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-54992d96-7718-412e-ad8c-e3d4a063f807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:26.004043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-54992d96-7718-412e-ad8c-e3d4a063f807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:26.004484 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-54992d96-7718-412e-ad8c-e3d4a063f807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:26.008929 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-608005bb-0521-48b5-bc1f-d80371bc7df9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:26.009383 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-608005bb-0521-48b5-bc1f-d80371bc7df9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:26.010173 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-608005bb-0521-48b5-bc1f-d80371bc7df9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:26.010624 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-608005bb-0521-48b5-bc1f-d80371bc7df9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:26.198611 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-54992d96-7718-412e-ad8c-e3d4a063f807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:26.202404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-608005bb-0521-48b5-bc1f-d80371bc7df9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:26.206814 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-54992d96-7718-412e-ad8c-e3d4a063f807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.215755 Jul 21 22:02:26.207486 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 182/377] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:25 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:26.210535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-608005bb-0521-48b5-bc1f-d80371bc7df9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:26.212639 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-608005bb-0521-48b5-bc1f-d80371bc7df9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:26.213799 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-608005bb-0521-48b5-bc1f-d80371bc7df9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1742 microversion: 2.20 time: 0.215878 Jul 21 22:02:26.214352 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 196/378] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:25 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1742 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:27.224850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-79a9ff02-03ed-4c8c-9e4b-2ac9920a0328 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:27.225417 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-79a9ff02-03ed-4c8c-9e4b-2ac9920a0328 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:27.231463 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8b1823bc-78c1-4740-95bf-a8dfc5d21822 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:27.232007 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79a9ff02-03ed-4c8c-9e4b-2ac9920a0328 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:27.232122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8b1823bc-78c1-4740-95bf-a8dfc5d21822 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:27.232465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79a9ff02-03ed-4c8c-9e4b-2ac9920a0328 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:27.233243 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79a9ff02-03ed-4c8c-9e4b-2ac9920a0328 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:27.233744 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79a9ff02-03ed-4c8c-9e4b-2ac9920a0328 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:27.238531 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b1823bc-78c1-4740-95bf-a8dfc5d21822 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:27.239033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b1823bc-78c1-4740-95bf-a8dfc5d21822 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:27.239811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b1823bc-78c1-4740-95bf-a8dfc5d21822 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:27.240252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b1823bc-78c1-4740-95bf-a8dfc5d21822 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:27.426131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8b1823bc-78c1-4740-95bf-a8dfc5d21822 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:27.434263 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-79a9ff02-03ed-4c8c-9e4b-2ac9920a0328 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:27.434890 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8b1823bc-78c1-4740-95bf-a8dfc5d21822 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:27.436477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8b1823bc-78c1-4740-95bf-a8dfc5d21822 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:27.437647 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8b1823bc-78c1-4740-95bf-a8dfc5d21822 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1742 microversion: 2.20 time: 0.210082 Jul 21 22:02:27.438206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 197/379] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:27 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1742 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:27.442300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-79a9ff02-03ed-4c8c-9e4b-2ac9920a0328 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.221335 Jul 21 22:02:27.442886 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 183/380] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:27 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:28.458141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8939d728-8af5-4aca-a65f-275ed0b8ba91 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:28.458792 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8939d728-8af5-4aca-a65f-275ed0b8ba91 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:28.459056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-33abc85a-4d7e-4802-9b30-c919821ca3bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:28.460783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-33abc85a-4d7e-4802-9b30-c919821ca3bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:28.467551 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8939d728-8af5-4aca-a65f-275ed0b8ba91 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:28.468050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-33abc85a-4d7e-4802-9b30-c919821ca3bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:28.468178 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8939d728-8af5-4aca-a65f-275ed0b8ba91 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:28.468523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-33abc85a-4d7e-4802-9b30-c919821ca3bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:28.469185 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8939d728-8af5-4aca-a65f-275ed0b8ba91 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:28.469292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-33abc85a-4d7e-4802-9b30-c919821ca3bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:28.469741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-33abc85a-4d7e-4802-9b30-c919821ca3bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:28.470567 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8939d728-8af5-4aca-a65f-275ed0b8ba91 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:28.668165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-33abc85a-4d7e-4802-9b30-c919821ca3bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:28.674989 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8939d728-8af5-4aca-a65f-275ed0b8ba91 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:28.676229 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-33abc85a-4d7e-4802-9b30-c919821ca3bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.220849 Jul 21 22:02:28.676804 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 184/381] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:28 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:02:28.683741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8939d728-8af5-4aca-a65f-275ed0b8ba91 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:28.685309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8939d728-8af5-4aca-a65f-275ed0b8ba91 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:28.686488 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8939d728-8af5-4aca-a65f-275ed0b8ba91 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.232357 Jul 21 22:02:28.687056 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 198/382] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:28 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:29.693709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-71d559cc-d940-4d81-a625-0aa1fe3f35fb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:29.694361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-71d559cc-d940-4d81-a625-0aa1fe3f35fb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:29.697164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=43 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:02:29.702675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71d559cc-d940-4d81-a625-0aa1fe3f35fb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:29.703162 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71d559cc-d940-4d81-a625-0aa1fe3f35fb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:29.703954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71d559cc-d940-4d81-a625-0aa1fe3f35fb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:29.704398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71d559cc-d940-4d81-a625-0aa1fe3f35fb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:29.704949 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-76b063e3-2956-4682-b9b0-433fae1aa5cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:29.705694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-76b063e3-2956-4682-b9b0-433fae1aa5cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:29.712813 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76b063e3-2956-4682-b9b0-433fae1aa5cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:29.713262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76b063e3-2956-4682-b9b0-433fae1aa5cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:29.714026 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76b063e3-2956-4682-b9b0-433fae1aa5cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:29.714728 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76b063e3-2956-4682-b9b0-433fae1aa5cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:29.916038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-71d559cc-d940-4d81-a625-0aa1fe3f35fb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:29.918689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-76b063e3-2956-4682-b9b0-433fae1aa5cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:29.927388 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-76b063e3-2956-4682-b9b0-433fae1aa5cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:29.928945 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-76b063e3-2956-4682-b9b0-433fae1aa5cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:29.930537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-71d559cc-d940-4d81-a625-0aa1fe3f35fb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.240087 Jul 21 22:02:29.930687 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-76b063e3-2956-4682-b9b0-433fae1aa5cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.228916 Jul 21 22:02:29.931165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 185/383] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:29 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:29.931344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 199/384] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:29 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:30.949334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4f4c23f6-995f-41de-a53c-616682d76675 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:30.949927 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e859245d-75bc-4ffb-96d9-450c1e06deb0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:30.950291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4f4c23f6-995f-41de-a53c-616682d76675 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:30.950381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e859245d-75bc-4ffb-96d9-450c1e06deb0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:30.956478 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4f4c23f6-995f-41de-a53c-616682d76675 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:30.956731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e859245d-75bc-4ffb-96d9-450c1e06deb0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:30.956930 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4f4c23f6-995f-41de-a53c-616682d76675 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:30.957181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e859245d-75bc-4ffb-96d9-450c1e06deb0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:30.957709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4f4c23f6-995f-41de-a53c-616682d76675 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:30.957945 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e859245d-75bc-4ffb-96d9-450c1e06deb0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:30.958145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4f4c23f6-995f-41de-a53c-616682d76675 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:30.958380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e859245d-75bc-4ffb-96d9-450c1e06deb0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:31.162437 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4f4c23f6-995f-41de-a53c-616682d76675 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:31.169283 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e859245d-75bc-4ffb-96d9-450c1e06deb0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:31.172983 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4f4c23f6-995f-41de-a53c-616682d76675 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.227424 Jul 21 22:02:31.176894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 186/385] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:30 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:31.185175 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e859245d-75bc-4ffb-96d9-450c1e06deb0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:31.186693 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e859245d-75bc-4ffb-96d9-450c1e06deb0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:31.187921 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e859245d-75bc-4ffb-96d9-450c1e06deb0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.242242 Jul 21 22:02:31.188485 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 200/386] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:30 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:32.190956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-999d01b8-2872-45c6-a940-cc8f42ded971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:32.191605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-999d01b8-2872-45c6-a940-cc8f42ded971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:32.198390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-999d01b8-2872-45c6-a940-cc8f42ded971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:32.198868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-999d01b8-2872-45c6-a940-cc8f42ded971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:32.199726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-999d01b8-2872-45c6-a940-cc8f42ded971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:32.200323 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-999d01b8-2872-45c6-a940-cc8f42ded971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:32.206010 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b0acdf77-1603-4187-8faa-a4a5b29cfa96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:32.206776 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b0acdf77-1603-4187-8faa-a4a5b29cfa96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:32.213886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0acdf77-1603-4187-8faa-a4a5b29cfa96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:32.214587 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0acdf77-1603-4187-8faa-a4a5b29cfa96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:32.215434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0acdf77-1603-4187-8faa-a4a5b29cfa96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:32.215873 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0acdf77-1603-4187-8faa-a4a5b29cfa96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:32.404789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-999d01b8-2872-45c6-a940-cc8f42ded971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:32.412010 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b0acdf77-1603-4187-8faa-a4a5b29cfa96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:32.412977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-999d01b8-2872-45c6-a940-cc8f42ded971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.226823 Jul 21 22:02:32.413564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 187/387] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:32 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:02:32.421153 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b0acdf77-1603-4187-8faa-a4a5b29cfa96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:32.422672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b0acdf77-1603-4187-8faa-a4a5b29cfa96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:32.423913 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b0acdf77-1603-4187-8faa-a4a5b29cfa96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.222104 Jul 21 22:02:32.424478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 201/388] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:32 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:33.430675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6a16484d-b068-44f9-8d0b-0e71e952a0b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:33.431314 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6a16484d-b068-44f9-8d0b-0e71e952a0b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:33.437968 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a16484d-b068-44f9-8d0b-0e71e952a0b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:33.438423 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a16484d-b068-44f9-8d0b-0e71e952a0b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:33.439242 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a16484d-b068-44f9-8d0b-0e71e952a0b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:33.439678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a16484d-b068-44f9-8d0b-0e71e952a0b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:33.441944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3159ef25-4e8c-453f-843c-a355300594a5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:33.442561 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3159ef25-4e8c-453f-843c-a355300594a5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:33.445068 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=51 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:02:33.453691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3159ef25-4e8c-453f-843c-a355300594a5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:33.453691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3159ef25-4e8c-453f-843c-a355300594a5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:33.453691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3159ef25-4e8c-453f-843c-a355300594a5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:33.453691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3159ef25-4e8c-453f-843c-a355300594a5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:33.649232 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6a16484d-b068-44f9-8d0b-0e71e952a0b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:33.652893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3159ef25-4e8c-453f-843c-a355300594a5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:33.657907 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6a16484d-b068-44f9-8d0b-0e71e952a0b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.231007 Jul 21 22:02:33.658579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 188/389] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:33 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:33.660986 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3159ef25-4e8c-453f-843c-a355300594a5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:33.662515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3159ef25-4e8c-453f-843c-a355300594a5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:33.663712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3159ef25-4e8c-453f-843c-a355300594a5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.225648 Jul 21 22:02:33.664270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 202/390] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:33 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:34.675124 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6df34a84-62e6-4273-98f9-6bb91bc3a01f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:34.675714 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6df34a84-62e6-4273-98f9-6bb91bc3a01f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:34.681712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-943a13f0-aa53-4de4-bc13-a7cf05e7b02b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:34.682327 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-943a13f0-aa53-4de4-bc13-a7cf05e7b02b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:34.682464 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6df34a84-62e6-4273-98f9-6bb91bc3a01f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:34.682926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6df34a84-62e6-4273-98f9-6bb91bc3a01f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:34.683740 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6df34a84-62e6-4273-98f9-6bb91bc3a01f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:34.684177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6df34a84-62e6-4273-98f9-6bb91bc3a01f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:34.689283 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-943a13f0-aa53-4de4-bc13-a7cf05e7b02b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:34.689744 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-943a13f0-aa53-4de4-bc13-a7cf05e7b02b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:34.691255 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-943a13f0-aa53-4de4-bc13-a7cf05e7b02b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:34.691698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-943a13f0-aa53-4de4-bc13-a7cf05e7b02b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:34.886420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6df34a84-62e6-4273-98f9-6bb91bc3a01f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:34.889606 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-943a13f0-aa53-4de4-bc13-a7cf05e7b02b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:34.895020 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6df34a84-62e6-4273-98f9-6bb91bc3a01f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.223713 Jul 21 22:02:34.895597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 189/391] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:34 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:34.902574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-943a13f0-aa53-4de4-bc13-a7cf05e7b02b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:34.904191 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-943a13f0-aa53-4de4-bc13-a7cf05e7b02b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:34.905434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-943a13f0-aa53-4de4-bc13-a7cf05e7b02b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.227802 Jul 21 22:02:34.906086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 203/392] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:34 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:35.913317 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b8e46e0d-9cd1-4473-86cb-49d07e70c102 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:35.913926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b8e46e0d-9cd1-4473-86cb-49d07e70c102 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:35.921532 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b8e46e0d-9cd1-4473-86cb-49d07e70c102 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:35.921992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b8e46e0d-9cd1-4473-86cb-49d07e70c102 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:35.922771 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b8e46e0d-9cd1-4473-86cb-49d07e70c102 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:35.923238 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b8e46e0d-9cd1-4473-86cb-49d07e70c102 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:35.923391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-960534ef-0065-41b4-8d9a-03b86b014b4a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:35.924540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-960534ef-0065-41b4-8d9a-03b86b014b4a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:35.932224 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-960534ef-0065-41b4-8d9a-03b86b014b4a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:35.932686 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-960534ef-0065-41b4-8d9a-03b86b014b4a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:35.933491 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-960534ef-0065-41b4-8d9a-03b86b014b4a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:35.933961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-960534ef-0065-41b4-8d9a-03b86b014b4a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:36.135546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-960534ef-0065-41b4-8d9a-03b86b014b4a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:36.138379 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b8e46e0d-9cd1-4473-86cb-49d07e70c102 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:36.146862 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b8e46e0d-9cd1-4473-86cb-49d07e70c102 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.237324 Jul 21 22:02:36.147398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 190/393] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:35 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:36.147837 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-960534ef-0065-41b4-8d9a-03b86b014b4a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:36.150068 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-960534ef-0065-41b4-8d9a-03b86b014b4a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:36.151277 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-960534ef-0065-41b4-8d9a-03b86b014b4a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.232321 Jul 21 22:02:36.151833 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 204/394] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:35 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:37.170857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ec29a79d-48ed-49f3-a2f6-2f2457def602 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:37.171490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ec29a79d-48ed-49f3-a2f6-2f2457def602 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:37.173457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-faeb2c33-9f46-46e5-991f-9d97ccb99cde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:37.174071 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-faeb2c33-9f46-46e5-991f-9d97ccb99cde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:37.178266 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec29a79d-48ed-49f3-a2f6-2f2457def602 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:37.178769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec29a79d-48ed-49f3-a2f6-2f2457def602 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:37.179521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec29a79d-48ed-49f3-a2f6-2f2457def602 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:37.179959 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec29a79d-48ed-49f3-a2f6-2f2457def602 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:37.188239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-faeb2c33-9f46-46e5-991f-9d97ccb99cde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:37.188700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-faeb2c33-9f46-46e5-991f-9d97ccb99cde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:37.189514 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-faeb2c33-9f46-46e5-991f-9d97ccb99cde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:37.189957 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-faeb2c33-9f46-46e5-991f-9d97ccb99cde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:37.370195 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ec29a79d-48ed-49f3-a2f6-2f2457def602 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:37.379117 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ec29a79d-48ed-49f3-a2f6-2f2457def602 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.212237 Jul 21 22:02:37.379705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 191/395] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:37 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:37.392485 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-faeb2c33-9f46-46e5-991f-9d97ccb99cde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:37.401112 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-faeb2c33-9f46-46e5-991f-9d97ccb99cde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:37.402575 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-faeb2c33-9f46-46e5-991f-9d97ccb99cde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:37.403762 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-faeb2c33-9f46-46e5-991f-9d97ccb99cde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.234175 Jul 21 22:02:37.404332 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 205/396] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:37 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:38.396176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-26ec1b86-4022-4439-b09b-d529e3a8629a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:38.396861 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-26ec1b86-4022-4439-b09b-d529e3a8629a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:38.404011 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26ec1b86-4022-4439-b09b-d529e3a8629a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:38.404471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26ec1b86-4022-4439-b09b-d529e3a8629a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:38.405252 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26ec1b86-4022-4439-b09b-d529e3a8629a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:38.405694 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26ec1b86-4022-4439-b09b-d529e3a8629a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:38.421709 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-72157b48-808e-4f75-94c2-cea16bb0ebbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:38.422310 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-72157b48-808e-4f75-94c2-cea16bb0ebbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:38.429339 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72157b48-808e-4f75-94c2-cea16bb0ebbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:38.429833 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72157b48-808e-4f75-94c2-cea16bb0ebbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:38.431226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72157b48-808e-4f75-94c2-cea16bb0ebbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:38.431663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72157b48-808e-4f75-94c2-cea16bb0ebbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:38.603033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-26ec1b86-4022-4439-b09b-d529e3a8629a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:38.611178 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-26ec1b86-4022-4439-b09b-d529e3a8629a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.218707 Jul 21 22:02:38.611996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 192/397] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:38 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:38.614606 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-72157b48-808e-4f75-94c2-cea16bb0ebbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:38.618853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:02:38.625371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-72157b48-808e-4f75-94c2-cea16bb0ebbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:38.626905 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-72157b48-808e-4f75-94c2-cea16bb0ebbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:38.628091 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-72157b48-808e-4f75-94c2-cea16bb0ebbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.210320 Jul 21 22:02:38.628650 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 206/398] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:38 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:39.629152 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5f66bd60-071f-493e-b6aa-7bec2fd89968 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:39.629756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5f66bd60-071f-493e-b6aa-7bec2fd89968 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:39.637527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5f66bd60-071f-493e-b6aa-7bec2fd89968 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:39.637976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5f66bd60-071f-493e-b6aa-7bec2fd89968 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:39.638750 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5f66bd60-071f-493e-b6aa-7bec2fd89968 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:39.639212 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5f66bd60-071f-493e-b6aa-7bec2fd89968 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:39.648281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-396f50ef-2a15-45c3-8af1-392f024c27e2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:39.648894 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-396f50ef-2a15-45c3-8af1-392f024c27e2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:39.659708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-396f50ef-2a15-45c3-8af1-392f024c27e2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:39.660169 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-396f50ef-2a15-45c3-8af1-392f024c27e2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:39.661032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-396f50ef-2a15-45c3-8af1-392f024c27e2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:39.661484 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-396f50ef-2a15-45c3-8af1-392f024c27e2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:40.042314 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5f66bd60-071f-493e-b6aa-7bec2fd89968 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:40.050074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5f66bd60-071f-493e-b6aa-7bec2fd89968 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.424934 Jul 21 22:02:40.055103 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 193/399] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:39 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:40.055301 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-396f50ef-2a15-45c3-8af1-392f024c27e2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:40.061648 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-396f50ef-2a15-45c3-8af1-392f024c27e2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:40.063200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-396f50ef-2a15-45c3-8af1-392f024c27e2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:40.064354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-396f50ef-2a15-45c3-8af1-392f024c27e2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.420021 Jul 21 22:02:40.064906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 207/400] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:39 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:41.067239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bd27850d-c073-44f9-ae09-5cbb7a94f9a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:41.067850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bd27850d-c073-44f9-ae09-5cbb7a94f9a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:41.074949 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd27850d-c073-44f9-ae09-5cbb7a94f9a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:41.075513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd27850d-c073-44f9-ae09-5cbb7a94f9a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:41.076212 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd27850d-c073-44f9-ae09-5cbb7a94f9a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:41.076857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd27850d-c073-44f9-ae09-5cbb7a94f9a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:41.082392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f094eac0-6358-4a0f-bdf9-62af2a78cc60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:41.083036 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f094eac0-6358-4a0f-bdf9-62af2a78cc60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:41.090050 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f094eac0-6358-4a0f-bdf9-62af2a78cc60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:41.090502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f094eac0-6358-4a0f-bdf9-62af2a78cc60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:41.091315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f094eac0-6358-4a0f-bdf9-62af2a78cc60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:41.091753 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f094eac0-6358-4a0f-bdf9-62af2a78cc60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:41.290263 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bd27850d-c073-44f9-ae09-5cbb7a94f9a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:41.298511 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bd27850d-c073-44f9-ae09-5cbb7a94f9a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.235225 Jul 21 22:02:41.299122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 194/401] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:41 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:41.299882 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f094eac0-6358-4a0f-bdf9-62af2a78cc60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:41.308855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f094eac0-6358-4a0f-bdf9-62af2a78cc60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:41.310404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f094eac0-6358-4a0f-bdf9-62af2a78cc60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:41.311699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f094eac0-6358-4a0f-bdf9-62af2a78cc60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.233762 Jul 21 22:02:41.312263 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 208/402] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:41 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:42.316134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e0e3c6bf-1fdc-4aba-a52a-28e864727b81 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:42.316655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e0e3c6bf-1fdc-4aba-a52a-28e864727b81 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:42.324146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0e3c6bf-1fdc-4aba-a52a-28e864727b81 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:42.324604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0e3c6bf-1fdc-4aba-a52a-28e864727b81 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:42.325411 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0e3c6bf-1fdc-4aba-a52a-28e864727b81 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:42.325849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0e3c6bf-1fdc-4aba-a52a-28e864727b81 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:42.330511 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:02:42.330747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9ac46cab-2cfc-4b5f-a744-a9972e5b457d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:42.331728 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9ac46cab-2cfc-4b5f-a744-a9972e5b457d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:42.339465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9ac46cab-2cfc-4b5f-a744-a9972e5b457d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:42.339928 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9ac46cab-2cfc-4b5f-a744-a9972e5b457d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:42.340735 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9ac46cab-2cfc-4b5f-a744-a9972e5b457d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:42.341177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9ac46cab-2cfc-4b5f-a744-a9972e5b457d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:42.541103 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e0e3c6bf-1fdc-4aba-a52a-28e864727b81 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:42.545140 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9ac46cab-2cfc-4b5f-a744-a9972e5b457d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:42.549152 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e0e3c6bf-1fdc-4aba-a52a-28e864727b81 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.236871 Jul 21 22:02:42.549729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 195/403] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:42 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:02:42.553307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9ac46cab-2cfc-4b5f-a744-a9972e5b457d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:42.554826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9ac46cab-2cfc-4b5f-a744-a9972e5b457d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:42.556085 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9ac46cab-2cfc-4b5f-a744-a9972e5b457d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.229394 Jul 21 22:02:42.556653 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 209/404] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:42 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:43.567159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2b09ad74-1b86-4b34-8322-e902719d8e6c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:43.567791 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2b09ad74-1b86-4b34-8322-e902719d8e6c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:43.574558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5221d29f-bac0-4f13-aaeb-40c88f6a42ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:43.575258 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5221d29f-bac0-4f13-aaeb-40c88f6a42ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:43.575369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2b09ad74-1b86-4b34-8322-e902719d8e6c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:43.575727 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2b09ad74-1b86-4b34-8322-e902719d8e6c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:43.576526 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2b09ad74-1b86-4b34-8322-e902719d8e6c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:43.576970 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2b09ad74-1b86-4b34-8322-e902719d8e6c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:43.582065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5221d29f-bac0-4f13-aaeb-40c88f6a42ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:43.582533 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5221d29f-bac0-4f13-aaeb-40c88f6a42ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:43.583349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5221d29f-bac0-4f13-aaeb-40c88f6a42ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:43.583798 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5221d29f-bac0-4f13-aaeb-40c88f6a42ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:43.782304 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2b09ad74-1b86-4b34-8322-e902719d8e6c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:43.785358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5221d29f-bac0-4f13-aaeb-40c88f6a42ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:43.791113 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2b09ad74-1b86-4b34-8322-e902719d8e6c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.228610 Jul 21 22:02:43.791730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 196/405] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:43 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:43.794757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5221d29f-bac0-4f13-aaeb-40c88f6a42ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:43.796354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5221d29f-bac0-4f13-aaeb-40c88f6a42ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:43.797516 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5221d29f-bac0-4f13-aaeb-40c88f6a42ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.227540 Jul 21 22:02:43.798070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 210/406] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:43 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:44.808184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7f9aedd2-6c57-46b8-ba5e-9b48caa5dbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:44.808760 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7f9aedd2-6c57-46b8-ba5e-9b48caa5dbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:44.815428 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f9aedd2-6c57-46b8-ba5e-9b48caa5dbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:44.815788 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d9b54e7b-a4ae-40a4-bc8a-186ca2e2703d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:44.816226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f9aedd2-6c57-46b8-ba5e-9b48caa5dbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:44.816405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d9b54e7b-a4ae-40a4-bc8a-186ca2e2703d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:44.816666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f9aedd2-6c57-46b8-ba5e-9b48caa5dbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:44.817108 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f9aedd2-6c57-46b8-ba5e-9b48caa5dbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:44.823229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9b54e7b-a4ae-40a4-bc8a-186ca2e2703d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:44.823686 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9b54e7b-a4ae-40a4-bc8a-186ca2e2703d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:44.824464 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9b54e7b-a4ae-40a4-bc8a-186ca2e2703d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:44.824911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9b54e7b-a4ae-40a4-bc8a-186ca2e2703d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:45.025281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7f9aedd2-6c57-46b8-ba5e-9b48caa5dbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:45.029549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d9b54e7b-a4ae-40a4-bc8a-186ca2e2703d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:45.033299 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7f9aedd2-6c57-46b8-ba5e-9b48caa5dbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.229630 Jul 21 22:02:45.033910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 197/407] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:44 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:45.037896 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d9b54e7b-a4ae-40a4-bc8a-186ca2e2703d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:45.040222 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d9b54e7b-a4ae-40a4-bc8a-186ca2e2703d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:45.041445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d9b54e7b-a4ae-40a4-bc8a-186ca2e2703d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.229507 Jul 21 22:02:45.042027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 211/408] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:44 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:46.052365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-04757e48-d41b-4212-9d65-0af40b3d20cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:46.052970 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-04757e48-d41b-4212-9d65-0af40b3d20cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:46.059775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04757e48-d41b-4212-9d65-0af40b3d20cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:46.060221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04757e48-d41b-4212-9d65-0af40b3d20cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:46.060458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f19fc6ce-7401-469d-8fbb-95272e20c48d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:46.061035 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04757e48-d41b-4212-9d65-0af40b3d20cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:46.061139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f19fc6ce-7401-469d-8fbb-95272e20c48d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:46.061479 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04757e48-d41b-4212-9d65-0af40b3d20cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:46.067810 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f19fc6ce-7401-469d-8fbb-95272e20c48d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:46.068278 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f19fc6ce-7401-469d-8fbb-95272e20c48d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:46.069062 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f19fc6ce-7401-469d-8fbb-95272e20c48d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:46.069503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f19fc6ce-7401-469d-8fbb-95272e20c48d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:46.261143 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-04757e48-d41b-4212-9d65-0af40b3d20cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:46.269368 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-04757e48-d41b-4212-9d65-0af40b3d20cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.221035 Jul 21 22:02:46.269957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 198/409] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:46 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:46.275583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f19fc6ce-7401-469d-8fbb-95272e20c48d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:46.283624 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f19fc6ce-7401-469d-8fbb-95272e20c48d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:46.285139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f19fc6ce-7401-469d-8fbb-95272e20c48d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:46.286296 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f19fc6ce-7401-469d-8fbb-95272e20c48d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.229722 Jul 21 22:02:46.286858 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 212/410] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:46 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:47.285902 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2e3c6c9d-1ffa-4b58-9a75-552cffca44b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:47.286447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2e3c6c9d-1ffa-4b58-9a75-552cffca44b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:47.293535 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e3c6c9d-1ffa-4b58-9a75-552cffca44b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:47.293988 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e3c6c9d-1ffa-4b58-9a75-552cffca44b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:47.294754 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e3c6c9d-1ffa-4b58-9a75-552cffca44b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:47.295224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e3c6c9d-1ffa-4b58-9a75-552cffca44b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:47.305254 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0f9341af-ed3c-4dce-bbc9-e3b8342d4aee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:47.305861 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0f9341af-ed3c-4dce-bbc9-e3b8342d4aee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:47.312303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0f9341af-ed3c-4dce-bbc9-e3b8342d4aee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:47.312760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0f9341af-ed3c-4dce-bbc9-e3b8342d4aee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:47.313528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0f9341af-ed3c-4dce-bbc9-e3b8342d4aee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:47.313962 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0f9341af-ed3c-4dce-bbc9-e3b8342d4aee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:47.492056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2e3c6c9d-1ffa-4b58-9a75-552cffca44b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:47.499117 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0f9341af-ed3c-4dce-bbc9-e3b8342d4aee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:47.500065 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2e3c6c9d-1ffa-4b58-9a75-552cffca44b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.218047 Jul 21 22:02:47.500655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 199/411] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:47 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:47.507184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0f9341af-ed3c-4dce-bbc9-e3b8342d4aee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:47.508702 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0f9341af-ed3c-4dce-bbc9-e3b8342d4aee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:47.509858 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0f9341af-ed3c-4dce-bbc9-e3b8342d4aee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.208833 Jul 21 22:02:47.510422 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 213/412] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:47 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:48.517494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-41dd2915-905b-4cb5-851d-2f2020a93afc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:48.518099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-41dd2915-905b-4cb5-851d-2f2020a93afc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:48.524564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41dd2915-905b-4cb5-851d-2f2020a93afc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:48.525013 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41dd2915-905b-4cb5-851d-2f2020a93afc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:48.525778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41dd2915-905b-4cb5-851d-2f2020a93afc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:48.526212 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41dd2915-905b-4cb5-851d-2f2020a93afc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:48.526716 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e63632c0-4676-4ba2-b1d9-c0bbb1e8dfec tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:48.527361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e63632c0-4676-4ba2-b1d9-c0bbb1e8dfec tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:48.533513 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e63632c0-4676-4ba2-b1d9-c0bbb1e8dfec tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:48.533962 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e63632c0-4676-4ba2-b1d9-c0bbb1e8dfec tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:48.534738 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e63632c0-4676-4ba2-b1d9-c0bbb1e8dfec tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:48.535209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e63632c0-4676-4ba2-b1d9-c0bbb1e8dfec tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:48.724427 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-41dd2915-905b-4cb5-851d-2f2020a93afc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:48.728240 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e63632c0-4676-4ba2-b1d9-c0bbb1e8dfec tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:48.732993 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-41dd2915-905b-4cb5-851d-2f2020a93afc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.219346 Jul 21 22:02:48.733557 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 200/413] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:48 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:48.736448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e63632c0-4676-4ba2-b1d9-c0bbb1e8dfec tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:48.737941 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e63632c0-4676-4ba2-b1d9-c0bbb1e8dfec tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:48.739117 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e63632c0-4676-4ba2-b1d9-c0bbb1e8dfec tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.216166 Jul 21 22:02:48.739663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 214/414] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:48 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:49.749715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a0a23acf-ecf7-4410-a645-f2dfbd370cd3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:49.750237 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a0a23acf-ecf7-4410-a645-f2dfbd370cd3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:49.757070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a0a23acf-ecf7-4410-a645-f2dfbd370cd3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:49.757250 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e536b8eb-d2ed-4175-bdc0-b7c957fb96ce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:49.757681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a0a23acf-ecf7-4410-a645-f2dfbd370cd3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:49.757783 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e536b8eb-d2ed-4175-bdc0-b7c957fb96ce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:49.758358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a0a23acf-ecf7-4410-a645-f2dfbd370cd3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:49.758802 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a0a23acf-ecf7-4410-a645-f2dfbd370cd3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:49.764304 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e536b8eb-d2ed-4175-bdc0-b7c957fb96ce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:49.764755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e536b8eb-d2ed-4175-bdc0-b7c957fb96ce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:49.765550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e536b8eb-d2ed-4175-bdc0-b7c957fb96ce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:49.765989 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e536b8eb-d2ed-4175-bdc0-b7c957fb96ce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:49.952607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a0a23acf-ecf7-4410-a645-f2dfbd370cd3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:49.959596 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e536b8eb-d2ed-4175-bdc0-b7c957fb96ce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:49.960515 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a0a23acf-ecf7-4410-a645-f2dfbd370cd3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.214633 Jul 21 22:02:49.961426 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 201/415] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:49 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:49.968169 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e536b8eb-d2ed-4175-bdc0-b7c957fb96ce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:49.969684 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e536b8eb-d2ed-4175-bdc0-b7c957fb96ce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:49.970836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e536b8eb-d2ed-4175-bdc0-b7c957fb96ce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.217529 Jul 21 22:02:49.971426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 215/416] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:49 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:50.977697 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fea08123-e70e-46bd-a5e7-dc2ab64bbe59 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:50.978306 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fea08123-e70e-46bd-a5e7-dc2ab64bbe59 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:50.984782 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fea08123-e70e-46bd-a5e7-dc2ab64bbe59 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:50.985236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fea08123-e70e-46bd-a5e7-dc2ab64bbe59 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:50.986012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fea08123-e70e-46bd-a5e7-dc2ab64bbe59 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:50.986449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fea08123-e70e-46bd-a5e7-dc2ab64bbe59 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:50.989032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0ceecbd9-1046-4cd0-b68b-ee141bfefdf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:50.989636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0ceecbd9-1046-4cd0-b68b-ee141bfefdf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:50.997049 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ceecbd9-1046-4cd0-b68b-ee141bfefdf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:50.997532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ceecbd9-1046-4cd0-b68b-ee141bfefdf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:50.998301 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ceecbd9-1046-4cd0-b68b-ee141bfefdf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:50.998739 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ceecbd9-1046-4cd0-b68b-ee141bfefdf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:51.179554 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fea08123-e70e-46bd-a5e7-dc2ab64bbe59 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:51.183340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0ceecbd9-1046-4cd0-b68b-ee141bfefdf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:51.188127 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fea08123-e70e-46bd-a5e7-dc2ab64bbe59 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.214375 Jul 21 22:02:51.188703 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 202/417] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:50 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:51.191630 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0ceecbd9-1046-4cd0-b68b-ee141bfefdf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:51.193455 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0ceecbd9-1046-4cd0-b68b-ee141bfefdf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:51.194612 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0ceecbd9-1046-4cd0-b68b-ee141bfefdf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.209373 Jul 21 22:02:51.195497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 216/418] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:50 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:52.205822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-06d0fd06-4682-4f7f-a09c-88010d95c06a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:52.206428 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-06d0fd06-4682-4f7f-a09c-88010d95c06a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:52.213666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-06d0fd06-4682-4f7f-a09c-88010d95c06a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:52.213826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d4e8af87-ddcf-4c40-b9db-6654966af7c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:52.214489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-06d0fd06-4682-4f7f-a09c-88010d95c06a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:52.214583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d4e8af87-ddcf-4c40-b9db-6654966af7c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:52.215164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-06d0fd06-4682-4f7f-a09c-88010d95c06a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:52.215603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-06d0fd06-4682-4f7f-a09c-88010d95c06a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:52.220901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4e8af87-ddcf-4c40-b9db-6654966af7c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:52.221347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4e8af87-ddcf-4c40-b9db-6654966af7c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:52.222111 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4e8af87-ddcf-4c40-b9db-6654966af7c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:52.222548 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4e8af87-ddcf-4c40-b9db-6654966af7c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:52.413640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-06d0fd06-4682-4f7f-a09c-88010d95c06a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:52.417598 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d4e8af87-ddcf-4c40-b9db-6654966af7c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:52.422004 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-06d0fd06-4682-4f7f-a09c-88010d95c06a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.220064 Jul 21 22:02:52.422650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 203/419] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:52 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:52.425647 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d4e8af87-ddcf-4c40-b9db-6654966af7c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:52.427191 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d4e8af87-ddcf-4c40-b9db-6654966af7c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:52.428341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d4e8af87-ddcf-4c40-b9db-6654966af7c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.219273 Jul 21 22:02:52.428893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 217/420] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:52 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:53.438703 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-98bfdbc2-ccb2-4811-9491-c59fda7a23c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:53.439516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-98bfdbc2-ccb2-4811-9491-c59fda7a23c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:53.446102 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9e1934a4-516f-4393-bb5a-82c25968a110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:53.446538 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-98bfdbc2-ccb2-4811-9491-c59fda7a23c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:53.446642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-98bfdbc2-ccb2-4811-9491-c59fda7a23c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:53.446743 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9e1934a4-516f-4393-bb5a-82c25968a110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:53.447383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-98bfdbc2-ccb2-4811-9491-c59fda7a23c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:53.447833 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-98bfdbc2-ccb2-4811-9491-c59fda7a23c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:53.453182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e1934a4-516f-4393-bb5a-82c25968a110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:53.453616 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e1934a4-516f-4393-bb5a-82c25968a110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:53.454377 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e1934a4-516f-4393-bb5a-82c25968a110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:53.454813 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e1934a4-516f-4393-bb5a-82c25968a110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:53.648608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-98bfdbc2-ccb2-4811-9491-c59fda7a23c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:53.651714 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9e1934a4-516f-4393-bb5a-82c25968a110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:53.657320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-98bfdbc2-ccb2-4811-9491-c59fda7a23c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.222402 Jul 21 22:02:53.657899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 204/421] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:53 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:53.661093 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9e1934a4-516f-4393-bb5a-82c25968a110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:53.662762 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9e1934a4-516f-4393-bb5a-82c25968a110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:53.663934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9e1934a4-516f-4393-bb5a-82c25968a110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.221644 Jul 21 22:02:53.664487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 218/422] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:53 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:54.673618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3a5e459e-6701-4c0f-8a22-5a2deb6e13de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:54.674230 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3a5e459e-6701-4c0f-8a22-5a2deb6e13de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:54.680887 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3a5e459e-6701-4c0f-8a22-5a2deb6e13de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:54.681343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3a5e459e-6701-4c0f-8a22-5a2deb6e13de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:54.681572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f93257de-a9c5-4788-b58f-86c0b3e20a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:54.682117 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3a5e459e-6701-4c0f-8a22-5a2deb6e13de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:54.682217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f93257de-a9c5-4788-b58f-86c0b3e20a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:54.682559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3a5e459e-6701-4c0f-8a22-5a2deb6e13de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:54.689009 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f93257de-a9c5-4788-b58f-86c0b3e20a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:54.689582 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f93257de-a9c5-4788-b58f-86c0b3e20a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:54.690354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f93257de-a9c5-4788-b58f-86c0b3e20a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:54.690790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f93257de-a9c5-4788-b58f-86c0b3e20a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:54.869336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3a5e459e-6701-4c0f-8a22-5a2deb6e13de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:54.874448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f93257de-a9c5-4788-b58f-86c0b3e20a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:54.877524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3a5e459e-6701-4c0f-8a22-5a2deb6e13de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.207665 Jul 21 22:02:54.878102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 205/423] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:54 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:54.882505 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f93257de-a9c5-4788-b58f-86c0b3e20a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:54.884124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f93257de-a9c5-4788-b58f-86c0b3e20a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:54.885371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f93257de-a9c5-4788-b58f-86c0b3e20a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.207791 Jul 21 22:02:54.886131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 219/424] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:54 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:55.893618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-39799c68-f4b5-458c-a8d0-7969c19dd061 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:55.894262 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-39799c68-f4b5-458c-a8d0-7969c19dd061 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:55.900797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-39799c68-f4b5-458c-a8d0-7969c19dd061 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:55.901258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-39799c68-f4b5-458c-a8d0-7969c19dd061 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:55.902060 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-39799c68-f4b5-458c-a8d0-7969c19dd061 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:55.902509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-39799c68-f4b5-458c-a8d0-7969c19dd061 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:55.903481 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6bfc0807-14eb-4075-9c3c-8815b60fa082 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:55.904100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6bfc0807-14eb-4075-9c3c-8815b60fa082 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:55.910429 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6bfc0807-14eb-4075-9c3c-8815b60fa082 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:55.910896 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6bfc0807-14eb-4075-9c3c-8815b60fa082 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:55.911755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6bfc0807-14eb-4075-9c3c-8815b60fa082 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:55.912203 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6bfc0807-14eb-4075-9c3c-8815b60fa082 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:56.096409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-39799c68-f4b5-458c-a8d0-7969c19dd061 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:56.104155 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6bfc0807-14eb-4075-9c3c-8815b60fa082 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:56.104930 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-39799c68-f4b5-458c-a8d0-7969c19dd061 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.215182 Jul 21 22:02:56.105502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 206/425] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:55 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:56.113029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6bfc0807-14eb-4075-9c3c-8815b60fa082 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:56.116158 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6bfc0807-14eb-4075-9c3c-8815b60fa082 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:56.118139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6bfc0807-14eb-4075-9c3c-8815b60fa082 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.218363 Jul 21 22:02:56.119715 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 220/426] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:55 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:02:57.122130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a1600c01-a44f-40a6-be5f-1f2a205c2a80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:57.122771 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a1600c01-a44f-40a6-be5f-1f2a205c2a80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:57.129259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1600c01-a44f-40a6-be5f-1f2a205c2a80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:57.129712 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1600c01-a44f-40a6-be5f-1f2a205c2a80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:57.130484 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1600c01-a44f-40a6-be5f-1f2a205c2a80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:57.130919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1600c01-a44f-40a6-be5f-1f2a205c2a80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:57.137595 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e1b03e36-aac1-4e98-bf1f-5a65fd87f676 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:57.138195 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e1b03e36-aac1-4e98-bf1f-5a65fd87f676 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:57.145065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e1b03e36-aac1-4e98-bf1f-5a65fd87f676 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:57.145512 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e1b03e36-aac1-4e98-bf1f-5a65fd87f676 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:57.146281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e1b03e36-aac1-4e98-bf1f-5a65fd87f676 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:57.146713 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e1b03e36-aac1-4e98-bf1f-5a65fd87f676 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:57.333475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a1600c01-a44f-40a6-be5f-1f2a205c2a80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:57.338342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e1b03e36-aac1-4e98-bf1f-5a65fd87f676 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:57.342431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a1600c01-a44f-40a6-be5f-1f2a205c2a80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.224619 Jul 21 22:02:57.343081 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 207/427] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:57 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:57.346849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e1b03e36-aac1-4e98-bf1f-5a65fd87f676 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:57.348379 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e1b03e36-aac1-4e98-bf1f-5a65fd87f676 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:57.349550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e1b03e36-aac1-4e98-bf1f-5a65fd87f676 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.216482 Jul 21 22:02:57.350088 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 221/428] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:57 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:58.359868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-529f13e9-1f97-4350-b308-2d39731efbe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:58.360477 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-529f13e9-1f97-4350-b308-2d39731efbe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:58.366955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-529f13e9-1f97-4350-b308-2d39731efbe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:58.367455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-529f13e9-1f97-4350-b308-2d39731efbe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:58.367689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d0558088-8c1f-4120-99b5-d9549ddee143 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:58.368226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-529f13e9-1f97-4350-b308-2d39731efbe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:58.368341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d0558088-8c1f-4120-99b5-d9549ddee143 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:58.368665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-529f13e9-1f97-4350-b308-2d39731efbe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:58.375141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d0558088-8c1f-4120-99b5-d9549ddee143 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:58.375591 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d0558088-8c1f-4120-99b5-d9549ddee143 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:58.376360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d0558088-8c1f-4120-99b5-d9549ddee143 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:58.376796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d0558088-8c1f-4120-99b5-d9549ddee143 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:58.564408 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d0558088-8c1f-4120-99b5-d9549ddee143 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:58.568670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-529f13e9-1f97-4350-b308-2d39731efbe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:58.574652 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d0558088-8c1f-4120-99b5-d9549ddee143 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:58.576238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d0558088-8c1f-4120-99b5-d9549ddee143 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:58.577381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-529f13e9-1f97-4350-b308-2d39731efbe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.221268 Jul 21 22:02:58.577501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d0558088-8c1f-4120-99b5-d9549ddee143 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.213931 Jul 21 22:02:58.578175 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 222/429] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:58 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:02:58.578289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 208/430] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:58 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:59.593645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b4085e9d-91a9-4992-a292-5d423006d283 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:59.594247 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b4085e9d-91a9-4992-a292-5d423006d283 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:59.600991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b4085e9d-91a9-4992-a292-5d423006d283 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:59.601466 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b4085e9d-91a9-4992-a292-5d423006d283 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:59.602225 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b4085e9d-91a9-4992-a292-5d423006d283 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:59.602662 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b4085e9d-91a9-4992-a292-5d423006d283 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:59.605348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6868129e-6f32-486e-885c-7ab3f591bb2f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:02:59.605955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6868129e-6f32-486e-885c-7ab3f591bb2f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:02:59.612354 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6868129e-6f32-486e-885c-7ab3f591bb2f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:59.612802 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6868129e-6f32-486e-885c-7ab3f591bb2f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:59.613567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6868129e-6f32-486e-885c-7ab3f591bb2f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:02:59.614001 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6868129e-6f32-486e-885c-7ab3f591bb2f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:02:59.625243 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:02:59.804789 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b4085e9d-91a9-4992-a292-5d423006d283 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:59.809365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6868129e-6f32-486e-885c-7ab3f591bb2f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:59.813405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b4085e9d-91a9-4992-a292-5d423006d283 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.223497 Jul 21 22:02:59.813985 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 223/431] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:02:59 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:02:59.817143 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6868129e-6f32-486e-885c-7ab3f591bb2f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:59.818645 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6868129e-6f32-486e-885c-7ab3f591bb2f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:02:59.819831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6868129e-6f32-486e-885c-7ab3f591bb2f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.219120 Jul 21 22:02:59.820373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 209/432] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:02:59 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:00.829333 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d832ed65-3b03-4b01-a03c-b4d3fb7d35b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:00.829942 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d832ed65-3b03-4b01-a03c-b4d3fb7d35b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:00.836586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d832ed65-3b03-4b01-a03c-b4d3fb7d35b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:00.837037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d832ed65-3b03-4b01-a03c-b4d3fb7d35b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:00.837324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ddd61e2c-673f-413d-b1aa-e1c71827bf0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:00.837809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d832ed65-3b03-4b01-a03c-b4d3fb7d35b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:00.837936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ddd61e2c-673f-413d-b1aa-e1c71827bf0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:00.838242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d832ed65-3b03-4b01-a03c-b4d3fb7d35b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:00.840480 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=50 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:00.845781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddd61e2c-673f-413d-b1aa-e1c71827bf0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:00.846234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddd61e2c-673f-413d-b1aa-e1c71827bf0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:00.847030 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddd61e2c-673f-413d-b1aa-e1c71827bf0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:00.847474 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddd61e2c-673f-413d-b1aa-e1c71827bf0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:01.048526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d832ed65-3b03-4b01-a03c-b4d3fb7d35b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:01.051284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ddd61e2c-673f-413d-b1aa-e1c71827bf0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:01.057250 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d832ed65-3b03-4b01-a03c-b4d3fb7d35b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.231125 Jul 21 22:03:01.058017 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 224/433] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:00 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:01.059913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ddd61e2c-673f-413d-b1aa-e1c71827bf0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:01.061466 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ddd61e2c-673f-413d-b1aa-e1c71827bf0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:01.062621 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ddd61e2c-673f-413d-b1aa-e1c71827bf0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.229138 Jul 21 22:03:01.063189 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 210/434] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:00 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:02.074183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-991f1aa4-65a6-46f8-8ee8-5901c58ce7d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:02.074725 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-991f1aa4-65a6-46f8-8ee8-5901c58ce7d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:02.080217 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-103a76e7-2efd-40da-b42d-63c4e8a6d261 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:02.080827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-103a76e7-2efd-40da-b42d-63c4e8a6d261 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:02.081143 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-991f1aa4-65a6-46f8-8ee8-5901c58ce7d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:02.081596 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-991f1aa4-65a6-46f8-8ee8-5901c58ce7d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:02.082363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-991f1aa4-65a6-46f8-8ee8-5901c58ce7d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:02.082796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-991f1aa4-65a6-46f8-8ee8-5901c58ce7d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:02.087261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-103a76e7-2efd-40da-b42d-63c4e8a6d261 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:02.087743 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-103a76e7-2efd-40da-b42d-63c4e8a6d261 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:02.088509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-103a76e7-2efd-40da-b42d-63c4e8a6d261 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:02.089211 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-103a76e7-2efd-40da-b42d-63c4e8a6d261 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:02.282593 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-991f1aa4-65a6-46f8-8ee8-5901c58ce7d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:02.287196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-103a76e7-2efd-40da-b42d-63c4e8a6d261 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:02.291268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-991f1aa4-65a6-46f8-8ee8-5901c58ce7d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.220456 Jul 21 22:03:02.291414 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:02.291949 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 225/435] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:02 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:02.296834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-103a76e7-2efd-40da-b42d-63c4e8a6d261 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:02.298350 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-103a76e7-2efd-40da-b42d-63c4e8a6d261 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:02.299561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-103a76e7-2efd-40da-b42d-63c4e8a6d261 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.223228 Jul 21 22:03:02.300105 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 211/436] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:02 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:03.308948 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0470ce26-d3d6-4ff7-ab1b-c5ddaa166037 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:03.309537 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0470ce26-d3d6-4ff7-ab1b-c5ddaa166037 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:03.317876 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0470ce26-d3d6-4ff7-ab1b-c5ddaa166037 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:03.318292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4953286d-18b1-4d16-8d69-13b7350050b8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:03.318753 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0470ce26-d3d6-4ff7-ab1b-c5ddaa166037 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:03.318901 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4953286d-18b1-4d16-8d69-13b7350050b8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:03.319117 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0470ce26-d3d6-4ff7-ab1b-c5ddaa166037 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:03.319550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0470ce26-d3d6-4ff7-ab1b-c5ddaa166037 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:03.325619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4953286d-18b1-4d16-8d69-13b7350050b8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:03.326076 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4953286d-18b1-4d16-8d69-13b7350050b8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:03.326850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4953286d-18b1-4d16-8d69-13b7350050b8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:03.327315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4953286d-18b1-4d16-8d69-13b7350050b8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:03.513866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0470ce26-d3d6-4ff7-ab1b-c5ddaa166037 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:03.520567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4953286d-18b1-4d16-8d69-13b7350050b8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:03.522177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0470ce26-d3d6-4ff7-ab1b-c5ddaa166037 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.217760 Jul 21 22:03:03.522764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 226/437] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:03 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:03.528809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4953286d-18b1-4d16-8d69-13b7350050b8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:03.530401 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4953286d-18b1-4d16-8d69-13b7350050b8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:03.531715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4953286d-18b1-4d16-8d69-13b7350050b8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.218023 Jul 21 22:03:03.532282 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 212/438] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:03 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:04.539039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-36cc8d53-3ac4-4736-8c2f-79b731d88c8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:04.539651 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-36cc8d53-3ac4-4736-8c2f-79b731d88c8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:04.541907 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=50 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:04.547428 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36cc8d53-3ac4-4736-8c2f-79b731d88c8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:04.547885 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36cc8d53-3ac4-4736-8c2f-79b731d88c8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:04.548658 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36cc8d53-3ac4-4736-8c2f-79b731d88c8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:04.549103 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36cc8d53-3ac4-4736-8c2f-79b731d88c8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:04.549775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-141283ad-4f5a-44de-b06d-f31df6c264e7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:04.550385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-141283ad-4f5a-44de-b06d-f31df6c264e7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:04.556828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-141283ad-4f5a-44de-b06d-f31df6c264e7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:04.557284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-141283ad-4f5a-44de-b06d-f31df6c264e7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:04.558056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-141283ad-4f5a-44de-b06d-f31df6c264e7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:04.559100 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-141283ad-4f5a-44de-b06d-f31df6c264e7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:04.743082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-36cc8d53-3ac4-4736-8c2f-79b731d88c8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:04.747628 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-141283ad-4f5a-44de-b06d-f31df6c264e7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:04.751829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-36cc8d53-3ac4-4736-8c2f-79b731d88c8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.216584 Jul 21 22:03:04.752485 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 227/439] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:04 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:04.755688 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-141283ad-4f5a-44de-b06d-f31df6c264e7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:04.757174 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-141283ad-4f5a-44de-b06d-f31df6c264e7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:04.758310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-141283ad-4f5a-44de-b06d-f31df6c264e7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.212434 Jul 21 22:03:04.758881 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 213/440] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:04 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:05.768949 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-032e49a3-da3d-433a-b70a-c53d746761fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:05.769560 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-032e49a3-da3d-433a-b70a-c53d746761fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:05.775987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-032e49a3-da3d-433a-b70a-c53d746761fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:05.776291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-55a423bb-d260-4d89-b51e-1e4186c5abaf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:05.776689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-032e49a3-da3d-433a-b70a-c53d746761fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:05.776962 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-55a423bb-d260-4d89-b51e-1e4186c5abaf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:05.777181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-032e49a3-da3d-433a-b70a-c53d746761fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:05.777614 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-032e49a3-da3d-433a-b70a-c53d746761fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:05.783999 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55a423bb-d260-4d89-b51e-1e4186c5abaf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:05.784443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55a423bb-d260-4d89-b51e-1e4186c5abaf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:05.785207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55a423bb-d260-4d89-b51e-1e4186c5abaf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:05.785641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55a423bb-d260-4d89-b51e-1e4186c5abaf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:05.971060 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-032e49a3-da3d-433a-b70a-c53d746761fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:05.974655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-55a423bb-d260-4d89-b51e-1e4186c5abaf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:05.979404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-032e49a3-da3d-433a-b70a-c53d746761fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.214200 Jul 21 22:03:05.980216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 228/441] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:05 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:05.983836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-55a423bb-d260-4d89-b51e-1e4186c5abaf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:05.985497 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-55a423bb-d260-4d89-b51e-1e4186c5abaf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:05.986794 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-55a423bb-d260-4d89-b51e-1e4186c5abaf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.214339 Jul 21 22:03:05.987641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 214/442] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:05 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:06.996925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8f2a01a1-732f-4256-a3aa-b5c5ce3be125 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:06.997494 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8f2a01a1-732f-4256-a3aa-b5c5ce3be125 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:07.004756 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f2a01a1-732f-4256-a3aa-b5c5ce3be125 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:07.005205 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f2a01a1-732f-4256-a3aa-b5c5ce3be125 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:07.005980 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f2a01a1-732f-4256-a3aa-b5c5ce3be125 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:07.006415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f2a01a1-732f-4256-a3aa-b5c5ce3be125 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:07.006623 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e8e6a6bd-9732-4f6a-8c2b-9c67f722b0c2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:07.007264 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e8e6a6bd-9732-4f6a-8c2b-9c67f722b0c2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:07.017513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e8e6a6bd-9732-4f6a-8c2b-9c67f722b0c2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:07.017975 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e8e6a6bd-9732-4f6a-8c2b-9c67f722b0c2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:07.018769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e8e6a6bd-9732-4f6a-8c2b-9c67f722b0c2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:07.019255 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e8e6a6bd-9732-4f6a-8c2b-9c67f722b0c2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:07.209371 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e8e6a6bd-9732-4f6a-8c2b-9c67f722b0c2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:07.209911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8f2a01a1-732f-4256-a3aa-b5c5ce3be125 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:07.217735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e8e6a6bd-9732-4f6a-8c2b-9c67f722b0c2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:07.218186 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8f2a01a1-732f-4256-a3aa-b5c5ce3be125 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.225152 Jul 21 22:03:07.218838 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 229/443] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:06 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:07.219362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e8e6a6bd-9732-4f6a-8c2b-9c67f722b0c2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:07.220675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e8e6a6bd-9732-4f6a-8c2b-9c67f722b0c2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.219503 Jul 21 22:03:07.221229 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 215/444] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:07 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:08.235908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c15e1268-38fa-4cd7-908d-2b3106070ecb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:08.236528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c15e1268-38fa-4cd7-908d-2b3106070ecb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:08.239093 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-68a1f551-afcb-49ed-b010-cb6e8bb6a435 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:08.239705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-68a1f551-afcb-49ed-b010-cb6e8bb6a435 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:08.243112 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c15e1268-38fa-4cd7-908d-2b3106070ecb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:08.243579 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c15e1268-38fa-4cd7-908d-2b3106070ecb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:08.244359 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c15e1268-38fa-4cd7-908d-2b3106070ecb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:08.244805 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c15e1268-38fa-4cd7-908d-2b3106070ecb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:08.246045 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-68a1f551-afcb-49ed-b010-cb6e8bb6a435 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:08.246492 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-68a1f551-afcb-49ed-b010-cb6e8bb6a435 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:08.247285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-68a1f551-afcb-49ed-b010-cb6e8bb6a435 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:08.247723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-68a1f551-afcb-49ed-b010-cb6e8bb6a435 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:08.430111 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c15e1268-38fa-4cd7-908d-2b3106070ecb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:08.436723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-68a1f551-afcb-49ed-b010-cb6e8bb6a435 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:08.438064 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c15e1268-38fa-4cd7-908d-2b3106070ecb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.206762 Jul 21 22:03:08.438645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 230/445] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:08 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:08.445391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-68a1f551-afcb-49ed-b010-cb6e8bb6a435 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:08.446937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-68a1f551-afcb-49ed-b010-cb6e8bb6a435 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:08.448108 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-68a1f551-afcb-49ed-b010-cb6e8bb6a435 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.213018 Jul 21 22:03:08.448653 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 216/446] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:08 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:08.820252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1146cfcb-8bb6-48dd-a856-03b59af18236 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca8788d3-4cc4-4daf-b123-e9d79b4478b7"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:03:08.821363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1146cfcb-8bb6-48dd-a856-03b59af18236 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:08.827994 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1146cfcb-8bb6-48dd-a856-03b59af18236 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:08.828446 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1146cfcb-8bb6-48dd-a856-03b59af18236 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:08.829221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1146cfcb-8bb6-48dd-a856-03b59af18236 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:08.829661 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1146cfcb-8bb6-48dd-a856-03b59af18236 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:09.455558 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-55b9fa4a-6362-4ed0-8b93-5cb22512447d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:09.456170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-55b9fa4a-6362-4ed0-8b93-5cb22512447d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:09.462728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55b9fa4a-6362-4ed0-8b93-5cb22512447d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:09.463220 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55b9fa4a-6362-4ed0-8b93-5cb22512447d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:09.464252 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55b9fa4a-6362-4ed0-8b93-5cb22512447d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:09.464693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55b9fa4a-6362-4ed0-8b93-5cb22512447d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:09.594276 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-55b9fa4a-6362-4ed0-8b93-5cb22512447d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:09.602188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-55b9fa4a-6362-4ed0-8b93-5cb22512447d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.151113 Jul 21 22:03:09.602740 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 217/447] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:09 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:03:09.607510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-50c45d6a-8ace-4f86-9806-eb981bf51935 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:09.608101 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-50c45d6a-8ace-4f86-9806-eb981bf51935 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:09.613790 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-50c45d6a-8ace-4f86-9806-eb981bf51935 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:09.614240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-50c45d6a-8ace-4f86-9806-eb981bf51935 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:09.615012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-50c45d6a-8ace-4f86-9806-eb981bf51935 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:09.615474 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-50c45d6a-8ace-4f86-9806-eb981bf51935 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:09.741064 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-50c45d6a-8ace-4f86-9806-eb981bf51935 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:09.748981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-50c45d6a-8ace-4f86-9806-eb981bf51935 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:09.750496 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-50c45d6a-8ace-4f86-9806-eb981bf51935 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:09.751687 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-50c45d6a-8ace-4f86-9806-eb981bf51935 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.148019 Jul 21 22:03:09.752250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 218/448] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:09 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:10.618553 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-21181100-efbe-45c7-93f8-127b40398edf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:10.619205 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-21181100-efbe-45c7-93f8-127b40398edf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:10.625784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-21181100-efbe-45c7-93f8-127b40398edf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:10.626224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-21181100-efbe-45c7-93f8-127b40398edf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:10.626978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-21181100-efbe-45c7-93f8-127b40398edf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:10.627428 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-21181100-efbe-45c7-93f8-127b40398edf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:10.759561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-21181100-efbe-45c7-93f8-127b40398edf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:10.768127 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-21181100-efbe-45c7-93f8-127b40398edf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.153403 Jul 21 22:03:10.768699 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 219/449] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:10 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:03:10.773117 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-120c7543-8913-4afa-830d-806acd8c2c8b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:10.773722 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-120c7543-8913-4afa-830d-806acd8c2c8b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:10.779370 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-120c7543-8913-4afa-830d-806acd8c2c8b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:10.779825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-120c7543-8913-4afa-830d-806acd8c2c8b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:10.780597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-120c7543-8913-4afa-830d-806acd8c2c8b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:10.781039 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-120c7543-8913-4afa-830d-806acd8c2c8b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:10.907873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-120c7543-8913-4afa-830d-806acd8c2c8b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:10.915852 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-120c7543-8913-4afa-830d-806acd8c2c8b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:10.917369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-120c7543-8913-4afa-830d-806acd8c2c8b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:10.918510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-120c7543-8913-4afa-830d-806acd8c2c8b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.148908 Jul 21 22:03:10.919116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 220/450] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:10 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:11.784920 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c9e4189c-cc09-48c5-8f7e-1c9ffb6a7168 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:11.785589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c9e4189c-cc09-48c5-8f7e-1c9ffb6a7168 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:11.791896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c9e4189c-cc09-48c5-8f7e-1c9ffb6a7168 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:11.792348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c9e4189c-cc09-48c5-8f7e-1c9ffb6a7168 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:11.793110 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c9e4189c-cc09-48c5-8f7e-1c9ffb6a7168 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:11.793547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c9e4189c-cc09-48c5-8f7e-1c9ffb6a7168 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:11.922519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c9e4189c-cc09-48c5-8f7e-1c9ffb6a7168 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:11.930464 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c9e4189c-cc09-48c5-8f7e-1c9ffb6a7168 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.149511 Jul 21 22:03:11.931080 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 221/451] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:11 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:03:11.937578 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-de869113-3e65-4924-9d63-7e52b8e09f1e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:11.938185 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-de869113-3e65-4924-9d63-7e52b8e09f1e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:11.943885 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de869113-3e65-4924-9d63-7e52b8e09f1e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:11.944342 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de869113-3e65-4924-9d63-7e52b8e09f1e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:11.945109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de869113-3e65-4924-9d63-7e52b8e09f1e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:11.945552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de869113-3e65-4924-9d63-7e52b8e09f1e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:12.072884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-de869113-3e65-4924-9d63-7e52b8e09f1e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:12.081046 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-de869113-3e65-4924-9d63-7e52b8e09f1e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:12.082545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-de869113-3e65-4924-9d63-7e52b8e09f1e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:12.083723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-de869113-3e65-4924-9d63-7e52b8e09f1e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.150258 Jul 21 22:03:12.084313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 222/452] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:11 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:12.947778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d8068e0a-8aa4-47a0-a649-3061792297e2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:12.948381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d8068e0a-8aa4-47a0-a649-3061792297e2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:12.955373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d8068e0a-8aa4-47a0-a649-3061792297e2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:12.955822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d8068e0a-8aa4-47a0-a649-3061792297e2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:12.956579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d8068e0a-8aa4-47a0-a649-3061792297e2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:12.957028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d8068e0a-8aa4-47a0-a649-3061792297e2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:13.096875 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d8068e0a-8aa4-47a0-a649-3061792297e2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:13.104854 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d8068e0a-8aa4-47a0-a649-3061792297e2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.160819 Jul 21 22:03:13.105455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 223/453] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:12 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:03:13.110393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-019ea561-61bb-4d13-a031-ce6a60e739fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:13.111022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-019ea561-61bb-4d13-a031-ce6a60e739fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:13.116693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-019ea561-61bb-4d13-a031-ce6a60e739fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:13.117140 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-019ea561-61bb-4d13-a031-ce6a60e739fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:13.117906 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-019ea561-61bb-4d13-a031-ce6a60e739fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:13.118341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-019ea561-61bb-4d13-a031-ce6a60e739fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:13.468111 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-019ea561-61bb-4d13-a031-ce6a60e739fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:13.476032 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-019ea561-61bb-4d13-a031-ce6a60e739fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:13.477551 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-019ea561-61bb-4d13-a031-ce6a60e739fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:13.478703 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-019ea561-61bb-4d13-a031-ce6a60e739fa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.372346 Jul 21 22:03:13.479290 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 224/454] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:13 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:14.122641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6858fe5e-54cc-4e59-bebc-3b7a0ec5b0d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:14.123294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6858fe5e-54cc-4e59-bebc-3b7a0ec5b0d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:14.129968 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6858fe5e-54cc-4e59-bebc-3b7a0ec5b0d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:14.130417 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6858fe5e-54cc-4e59-bebc-3b7a0ec5b0d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:14.131309 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6858fe5e-54cc-4e59-bebc-3b7a0ec5b0d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:14.131828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6858fe5e-54cc-4e59-bebc-3b7a0ec5b0d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:14.258583 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6858fe5e-54cc-4e59-bebc-3b7a0ec5b0d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:14.267279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6858fe5e-54cc-4e59-bebc-3b7a0ec5b0d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.148473 Jul 21 22:03:14.267841 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 225/455] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:14 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:03:14.496520 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e0bd17a6-a7a2-4be3-8cc2-c37fade09637 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:14.497153 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e0bd17a6-a7a2-4be3-8cc2-c37fade09637 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:14.503631 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0bd17a6-a7a2-4be3-8cc2-c37fade09637 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:14.504075 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0bd17a6-a7a2-4be3-8cc2-c37fade09637 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:14.504853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0bd17a6-a7a2-4be3-8cc2-c37fade09637 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:14.505285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0bd17a6-a7a2-4be3-8cc2-c37fade09637 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:14.632997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e0bd17a6-a7a2-4be3-8cc2-c37fade09637 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:14.641389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e0bd17a6-a7a2-4be3-8cc2-c37fade09637 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:14.642889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e0bd17a6-a7a2-4be3-8cc2-c37fade09637 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:14.644061 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e0bd17a6-a7a2-4be3-8cc2-c37fade09637 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.151481 Jul 21 22:03:14.644615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 226/456] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:14 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:15.284819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2ae1c73b-029c-4bba-a3cd-db235ae23957 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:15.285464 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2ae1c73b-029c-4bba-a3cd-db235ae23957 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:15.291836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2ae1c73b-029c-4bba-a3cd-db235ae23957 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:15.292321 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2ae1c73b-029c-4bba-a3cd-db235ae23957 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:15.293083 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2ae1c73b-029c-4bba-a3cd-db235ae23957 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:15.293516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2ae1c73b-029c-4bba-a3cd-db235ae23957 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:15.423687 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2ae1c73b-029c-4bba-a3cd-db235ae23957 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:15.431469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2ae1c73b-029c-4bba-a3cd-db235ae23957 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.150586 Jul 21 22:03:15.432024 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 227/457] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:15 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:03:15.661524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-63a7dfa5-41cf-4d23-9c45-65d69ce48cf8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:15.662129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-63a7dfa5-41cf-4d23-9c45-65d69ce48cf8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:15.668058 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-63a7dfa5-41cf-4d23-9c45-65d69ce48cf8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:15.668504 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-63a7dfa5-41cf-4d23-9c45-65d69ce48cf8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:15.669261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-63a7dfa5-41cf-4d23-9c45-65d69ce48cf8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:15.669743 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-63a7dfa5-41cf-4d23-9c45-65d69ce48cf8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:15.686936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:15.798982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-63a7dfa5-41cf-4d23-9c45-65d69ce48cf8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:15.806783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-63a7dfa5-41cf-4d23-9c45-65d69ce48cf8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:15.808338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-63a7dfa5-41cf-4d23-9c45-65d69ce48cf8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:15.809481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-63a7dfa5-41cf-4d23-9c45-65d69ce48cf8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.151836 Jul 21 22:03:15.810093 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 228/458] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:15 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:16.448208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4564fa51-a78d-48a2-984b-c111690117ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:16.448849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4564fa51-a78d-48a2-984b-c111690117ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:16.455323 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4564fa51-a78d-48a2-984b-c111690117ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:16.455777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4564fa51-a78d-48a2-984b-c111690117ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:16.456544 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4564fa51-a78d-48a2-984b-c111690117ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:16.457017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4564fa51-a78d-48a2-984b-c111690117ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:16.593798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4564fa51-a78d-48a2-984b-c111690117ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:16.602492 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4564fa51-a78d-48a2-984b-c111690117ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.158061 Jul 21 22:03:16.603095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 229/459] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:16 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:03:16.827884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b47a41e2-abcc-49ea-bca7-8894a34055f2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:16.828432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b47a41e2-abcc-49ea-bca7-8894a34055f2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:16.834371 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b47a41e2-abcc-49ea-bca7-8894a34055f2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:16.834822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b47a41e2-abcc-49ea-bca7-8894a34055f2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:16.835615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b47a41e2-abcc-49ea-bca7-8894a34055f2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:16.836067 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b47a41e2-abcc-49ea-bca7-8894a34055f2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:16.962387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b47a41e2-abcc-49ea-bca7-8894a34055f2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:16.971273 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b47a41e2-abcc-49ea-bca7-8894a34055f2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:16.972806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b47a41e2-abcc-49ea-bca7-8894a34055f2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:16.973945 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b47a41e2-abcc-49ea-bca7-8894a34055f2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.150133 Jul 21 22:03:16.974503 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 230/460] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:16 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:17.619283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3d874f38-cf25-417d-8611-f593151692fd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:17.619901 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3d874f38-cf25-417d-8611-f593151692fd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:17.626739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3d874f38-cf25-417d-8611-f593151692fd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:17.627227 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3d874f38-cf25-417d-8611-f593151692fd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:17.627990 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3d874f38-cf25-417d-8611-f593151692fd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:17.628418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3d874f38-cf25-417d-8611-f593151692fd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:17.757878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3d874f38-cf25-417d-8611-f593151692fd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:17.766301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3d874f38-cf25-417d-8611-f593151692fd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.150817 Jul 21 22:03:17.766951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 231/461] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:17 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:03:17.992229 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-48b795ff-daae-4935-9550-a4d79b0f85e8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:17.992824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-48b795ff-daae-4935-9550-a4d79b0f85e8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:18.000401 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-48b795ff-daae-4935-9550-a4d79b0f85e8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:18.000850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-48b795ff-daae-4935-9550-a4d79b0f85e8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:18.001618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-48b795ff-daae-4935-9550-a4d79b0f85e8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:18.002074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-48b795ff-daae-4935-9550-a4d79b0f85e8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:18.131916 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-48b795ff-daae-4935-9550-a4d79b0f85e8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:18.140061 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-48b795ff-daae-4935-9550-a4d79b0f85e8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:18.141548 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-48b795ff-daae-4935-9550-a4d79b0f85e8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:18.142681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-48b795ff-daae-4935-9550-a4d79b0f85e8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.154433 Jul 21 22:03:18.143261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 232/462] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:17 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:18.783506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-86fb0ee3-4135-4904-a89a-f3159e57fdee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:18.784128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-86fb0ee3-4135-4904-a89a-f3159e57fdee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:18.790547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86fb0ee3-4135-4904-a89a-f3159e57fdee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:18.791048 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86fb0ee3-4135-4904-a89a-f3159e57fdee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:18.791823 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86fb0ee3-4135-4904-a89a-f3159e57fdee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:18.792264 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86fb0ee3-4135-4904-a89a-f3159e57fdee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:18.825253 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=9 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:18.899745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=50 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:18.923310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-86fb0ee3-4135-4904-a89a-f3159e57fdee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:18.931226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-86fb0ee3-4135-4904-a89a-f3159e57fdee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1723 microversion: 2.1 time: 0.152129 Jul 21 22:03:18.931793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 233/463] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:18 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:03:19.159603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-883ced0d-1bd5-4f4a-8fca-c4cfb4c3e126 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:19.160221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-883ced0d-1bd5-4f4a-8fca-c4cfb4c3e126 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:19.166190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-883ced0d-1bd5-4f4a-8fca-c4cfb4c3e126 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:19.166642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-883ced0d-1bd5-4f4a-8fca-c4cfb4c3e126 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:19.167440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-883ced0d-1bd5-4f4a-8fca-c4cfb4c3e126 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:19.167881 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-883ced0d-1bd5-4f4a-8fca-c4cfb4c3e126 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:19.292807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-883ced0d-1bd5-4f4a-8fca-c4cfb4c3e126 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:19.301281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-883ced0d-1bd5-4f4a-8fca-c4cfb4c3e126 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:19.302803 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-883ced0d-1bd5-4f4a-8fca-c4cfb4c3e126 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:19.303981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-883ced0d-1bd5-4f4a-8fca-c4cfb4c3e126 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.148189 Jul 21 22:03:19.304545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 234/464] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:19 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:19.948416 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d8ba3338-4ba7-47f8-9b17-81a4363d2000 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:19.949143 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d8ba3338-4ba7-47f8-9b17-81a4363d2000 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:19.956507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d8ba3338-4ba7-47f8-9b17-81a4363d2000 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:19.957202 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d8ba3338-4ba7-47f8-9b17-81a4363d2000 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:19.958068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d8ba3338-4ba7-47f8-9b17-81a4363d2000 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:19.958574 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d8ba3338-4ba7-47f8-9b17-81a4363d2000 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:20.103975 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d8ba3338-4ba7-47f8-9b17-81a4363d2000 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:20.121377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d8ba3338-4ba7-47f8-9b17-81a4363d2000 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1700 microversion: 2.1 time: 0.176636 Jul 21 22:03:20.121989 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 235/465] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:19 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1700 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:03:20.139481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d42875ca-3354-40f1-acb6-114c37032853 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:03:20.146016 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d42875ca-3354-40f1-acb6-114c37032853 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:20.146582 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d42875ca-3354-40f1-acb6-114c37032853 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:20.211686 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d42875ca-3354-40f1-acb6-114c37032853 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Going to try to start instance {{(pid=117979) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 21 22:03:20.259622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d42875ca-3354-40f1-acb6-114c37032853 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "POST /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/action" status: 202 len: 0 microversion: 2.1 time: 0.124342 Jul 21 22:03:20.263502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 236/466] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 22:03:20 2022] POST /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:03:20.270934 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6e8e1626-f3a6-4779-9661-d4b660e036b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:20.271683 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6e8e1626-f3a6-4779-9661-d4b660e036b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:20.279732 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e8e1626-f3a6-4779-9661-d4b660e036b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:20.280743 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e8e1626-f3a6-4779-9661-d4b660e036b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:20.281530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e8e1626-f3a6-4779-9661-d4b660e036b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:20.282158 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e8e1626-f3a6-4779-9661-d4b660e036b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:20.499131 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6e8e1626-f3a6-4779-9661-d4b660e036b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:20.508188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6e8e1626-f3a6-4779-9661-d4b660e036b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1709 microversion: 2.1 time: 0.241175 Jul 21 22:03:20.512667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 237/467] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:20 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1709 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:20.522714 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a6854a3b-2633-4144-8159-d2499bdcd9a8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:20.531460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a6854a3b-2633-4144-8159-d2499bdcd9a8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:20.537524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a6854a3b-2633-4144-8159-d2499bdcd9a8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:20.537983 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a6854a3b-2633-4144-8159-d2499bdcd9a8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:20.538771 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a6854a3b-2633-4144-8159-d2499bdcd9a8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:20.539275 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a6854a3b-2633-4144-8159-d2499bdcd9a8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:20.585577 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1146cfcb-8bb6-48dd-a856-03b59af18236 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "POST /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.768958 Jul 21 22:03:20.587204 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 231/468] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 22:03:08 2022] POST /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1/os-volume_attachments => generated 194 bytes in 11771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:03:20.694433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a6854a3b-2633-4144-8159-d2499bdcd9a8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:20.703309 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a6854a3b-2633-4144-8159-d2499bdcd9a8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:20.704835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a6854a3b-2633-4144-8159-d2499bdcd9a8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:20.706028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a6854a3b-2633-4144-8159-d2499bdcd9a8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.191584 Jul 21 22:03:20.706584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 238/469] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:20 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:21.528110 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0b1b4d23-fcbe-4e5d-bf27-06db12196945 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:21.529755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0b1b4d23-fcbe-4e5d-bf27-06db12196945 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:21.539618 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b1b4d23-fcbe-4e5d-bf27-06db12196945 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:21.541000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b1b4d23-fcbe-4e5d-bf27-06db12196945 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:21.542147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b1b4d23-fcbe-4e5d-bf27-06db12196945 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:21.542738 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b1b4d23-fcbe-4e5d-bf27-06db12196945 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:21.688591 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0b1b4d23-fcbe-4e5d-bf27-06db12196945 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:21.697238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0b1b4d23-fcbe-4e5d-bf27-06db12196945 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1709 microversion: 2.1 time: 0.173086 Jul 21 22:03:21.699836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 232/470] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:21 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1709 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:21.729212 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b7918b74-45fd-4caa-801c-7f2b09188593 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:21.730261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b7918b74-45fd-4caa-801c-7f2b09188593 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:21.741305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b7918b74-45fd-4caa-801c-7f2b09188593 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:21.742381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b7918b74-45fd-4caa-801c-7f2b09188593 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:21.743817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b7918b74-45fd-4caa-801c-7f2b09188593 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:21.747667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b7918b74-45fd-4caa-801c-7f2b09188593 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:21.945279 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6b56fe17-9f55-4bce-b73e-c52c2b3851b3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Action: 'create', calling method: .version_select at 0x7faca1f7c940>, body: {"keypair": {"name": "tempest-keypair-1330530345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpi8kCOuh9hBQELJwFW1GoR7+dGCJK+R3R7Fnr+7QVBdNWYncmIzXwYDz0pPLZSuNT4RIWbJvOpbb9KjPDdUyPoKtymbZDXRlc+DKCTjdSeTfqkAU0SY0aEOQHx5nNMQw=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:03:21.979104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-6b56fe17-9f55-4bce-b73e-c52c2b3851b3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:03:21.992011 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-6b56fe17-9f55-4bce-b73e-c52c2b3851b3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for user 73f068abea75404fb2829065a674aee4 and project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:03:21.993410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b7918b74-45fd-4caa-801c-7f2b09188593 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:22.005063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b7918b74-45fd-4caa-801c-7f2b09188593 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:22.007450 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b7918b74-45fd-4caa-801c-7f2b09188593 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:22.010288 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b7918b74-45fd-4caa-801c-7f2b09188593 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.283674 Jul 21 22:03:22.011677 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 239/471] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:21 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:22.038098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6b56fe17-9f55-4bce-b73e-c52c2b3851b3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097013 Jul 21 22:03:22.040413 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 233/472] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 22:03:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:03:22.717842 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-29b13fe9-1511-422c-b3d4-ef61cf95b595 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:22.718825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-29b13fe9-1511-422c-b3d4-ef61cf95b595 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:22.728579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-29b13fe9-1511-422c-b3d4-ef61cf95b595 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:22.729785 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-29b13fe9-1511-422c-b3d4-ef61cf95b595 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:22.731522 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-29b13fe9-1511-422c-b3d4-ef61cf95b595 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:22.732749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-29b13fe9-1511-422c-b3d4-ef61cf95b595 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:22.959218 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-29b13fe9-1511-422c-b3d4-ef61cf95b595 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:22.980028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-29b13fe9-1511-422c-b3d4-ef61cf95b595 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1709 microversion: 2.1 time: 0.264360 Jul 21 22:03:22.981823 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 240/473] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:22 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1709 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:23.030938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d99e5226-4098-41a7-bf84-128cea466e36 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:23.031578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d99e5226-4098-41a7-bf84-128cea466e36 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:23.038861 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d99e5226-4098-41a7-bf84-128cea466e36 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:23.039845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d99e5226-4098-41a7-bf84-128cea466e36 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:23.040731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d99e5226-4098-41a7-bf84-128cea466e36 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:23.041183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d99e5226-4098-41a7-bf84-128cea466e36 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:23.320176 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d99e5226-4098-41a7-bf84-128cea466e36 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:23.330538 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d99e5226-4098-41a7-bf84-128cea466e36 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:23.343523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d99e5226-4098-41a7-bf84-128cea466e36 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:23.344784 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d99e5226-4098-41a7-bf84-128cea466e36 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.319185 Jul 21 22:03:23.345425 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 234/474] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:23 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:23.914484 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1447064422", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31aaafc3-d737-47df-987b-f83f4d3a2678"}], "security_groups": [{"name": "tempest-securitygroup--751839163"}], "key_name": "tempest-keypair-1330530345", "user_data": "}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:03:23.999136 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bad918bb-4d5a-4f05-8f3b-1d1f6125e4b1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:23.999824 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bad918bb-4d5a-4f05-8f3b-1d1f6125e4b1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:24.007710 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bad918bb-4d5a-4f05-8f3b-1d1f6125e4b1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:24.008784 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bad918bb-4d5a-4f05-8f3b-1d1f6125e4b1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:24.010159 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bad918bb-4d5a-4f05-8f3b-1d1f6125e4b1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:24.010810 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bad918bb-4d5a-4f05-8f3b-1d1f6125e4b1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:24.066621 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.network.neutron [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] validate_networks() for [('31aaafc3-d737-47df-987b-f83f4d3a2678', None, None, None, None, None)] {{(pid=117979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:03:24.328281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bad918bb-4d5a-4f05-8f3b-1d1f6125e4b1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:24.338042 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bad918bb-4d5a-4f05-8f3b-1d1f6125e4b1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1713 microversion: 2.1 time: 0.343182 Jul 21 22:03:24.339364 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 235/475] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:23 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1713 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:24.363555 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2e9474fe-c3e3-47fe-a85f-2e6334a026f8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:24.364170 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2e9474fe-c3e3-47fe-a85f-2e6334a026f8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:24.370187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e9474fe-c3e3-47fe-a85f-2e6334a026f8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:24.370843 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e9474fe-c3e3-47fe-a85f-2e6334a026f8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:24.371965 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e9474fe-c3e3-47fe-a85f-2e6334a026f8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:24.373095 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e9474fe-c3e3-47fe-a85f-2e6334a026f8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:24.603424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2e9474fe-c3e3-47fe-a85f-2e6334a026f8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:24.613870 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2e9474fe-c3e3-47fe-a85f-2e6334a026f8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:24.615746 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2e9474fe-c3e3-47fe-a85f-2e6334a026f8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:24.617177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2e9474fe-c3e3-47fe-a85f-2e6334a026f8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.257810 Jul 21 22:03:24.629147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 236/476] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:24 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:24.738575 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Flavor limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:03:24.739348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Image limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:03:24.740184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Flavor pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:03:24.740801 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Image pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:03:24.741253 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:03:24.752554 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:24.753007 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:24.753815 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:24.754343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:24.773798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:03:24.778150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for user 73f068abea75404fb2829065a674aee4 and project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:03:24.790173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Going to run 1 instances... {{(pid=117979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:03:24.792499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:03:24.840660 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6ba7c297-b21a-4621-b497-f373e55e038b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.930507 Jul 21 22:03:24.842131 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 241/477] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 22:03:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:03:24.852323 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9f923256-7050-4b66-bb39-9efd5dc1e647 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:24.853242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9f923256-7050-4b66-bb39-9efd5dc1e647 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:24.949204 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9f923256-7050-4b66-bb39-9efd5dc1e647 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:24.962877 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9f923256-7050-4b66-bb39-9efd5dc1e647 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1242 microversion: 2.1 time: 0.114191 Jul 21 22:03:24.963742 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 237/478] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:24 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:25.637058 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6b287f9f-4bf4-4ea0-8be5-f63936336daa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:25.638431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6b287f9f-4bf4-4ea0-8be5-f63936336daa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:25.659473 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b287f9f-4bf4-4ea0-8be5-f63936336daa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:25.660287 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b287f9f-4bf4-4ea0-8be5-f63936336daa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:25.661168 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b287f9f-4bf4-4ea0-8be5-f63936336daa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:25.661706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b287f9f-4bf4-4ea0-8be5-f63936336daa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:25.819295 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6b287f9f-4bf4-4ea0-8be5-f63936336daa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:25.828048 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6b287f9f-4bf4-4ea0-8be5-f63936336daa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:25.829776 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6b287f9f-4bf4-4ea0-8be5-f63936336daa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:25.830924 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6b287f9f-4bf4-4ea0-8be5-f63936336daa tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.198432 Jul 21 22:03:25.831966 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 242/479] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:25 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:25.992627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8ffda4e9-40f7-496c-800e-3fc709fa5386 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:25.993667 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8ffda4e9-40f7-496c-800e-3fc709fa5386 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:26.002390 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ffda4e9-40f7-496c-800e-3fc709fa5386 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:26.003296 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ffda4e9-40f7-496c-800e-3fc709fa5386 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:26.005208 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ffda4e9-40f7-496c-800e-3fc709fa5386 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:26.009273 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ffda4e9-40f7-496c-800e-3fc709fa5386 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:26.104175 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8ffda4e9-40f7-496c-800e-3fc709fa5386 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:26.119154 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8ffda4e9-40f7-496c-800e-3fc709fa5386 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1294 microversion: 2.1 time: 0.140835 Jul 21 22:03:26.148249 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 238/480] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:25 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1294 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:26.851666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7b86626b-b897-460f-b13d-2e06de0ab6cd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:26.853105 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7b86626b-b897-460f-b13d-2e06de0ab6cd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:26.860904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7b86626b-b897-460f-b13d-2e06de0ab6cd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:26.861665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7b86626b-b897-460f-b13d-2e06de0ab6cd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:26.862713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7b86626b-b897-460f-b13d-2e06de0ab6cd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:26.863281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7b86626b-b897-460f-b13d-2e06de0ab6cd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:27.037536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7b86626b-b897-460f-b13d-2e06de0ab6cd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:27.049244 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7b86626b-b897-460f-b13d-2e06de0ab6cd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:27.051721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7b86626b-b897-460f-b13d-2e06de0ab6cd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:27.053110 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7b86626b-b897-460f-b13d-2e06de0ab6cd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.206475 Jul 21 22:03:27.054149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 243/481] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:26 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:27.160495 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-620dcbae-49bf-4f75-ad41-aea25273ffa5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:27.161859 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-620dcbae-49bf-4f75-ad41-aea25273ffa5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:27.180795 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-620dcbae-49bf-4f75-ad41-aea25273ffa5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:27.181586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-620dcbae-49bf-4f75-ad41-aea25273ffa5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:27.183430 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-620dcbae-49bf-4f75-ad41-aea25273ffa5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:27.183883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-620dcbae-49bf-4f75-ad41-aea25273ffa5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:27.416408 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-620dcbae-49bf-4f75-ad41-aea25273ffa5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:27.427755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-620dcbae-49bf-4f75-ad41-aea25273ffa5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1367 microversion: 2.1 time: 0.271091 Jul 21 22:03:27.429126 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 239/482] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:27 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:28.073890 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b0c8d468-022a-45c1-a56c-5ac02f630523 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:28.075377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b0c8d468-022a-45c1-a56c-5ac02f630523 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:28.082526 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0c8d468-022a-45c1-a56c-5ac02f630523 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:28.083525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0c8d468-022a-45c1-a56c-5ac02f630523 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:28.084536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0c8d468-022a-45c1-a56c-5ac02f630523 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:28.085195 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0c8d468-022a-45c1-a56c-5ac02f630523 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:28.121233 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-f9dca0a9-b87d-4f14-a336-30c5163c9714 req-02e43a3d-2a41-4c74-bfee-8f55ad220913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8cef302-505a-45dc-9113-668fb800106f", "tag": "3d6fb7ed-a22e-4f29-96c2-6e75f44500d5"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:03:28.136089 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f9dca0a9-b87d-4f14-a336-30c5163c9714 req-02e43a3d-2a41-4c74-bfee-8f55ad220913 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:28.136760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f9dca0a9-b87d-4f14-a336-30c5163c9714 req-02e43a3d-2a41-4c74-bfee-8f55ad220913 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:28.165954 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-f9dca0a9-b87d-4f14-a336-30c5163c9714 req-02e43a3d-2a41-4c74-bfee-8f55ad220913 service nova] Creating event network-changed:3d6fb7ed-a22e-4f29-96c2-6e75f44500d5 for instance c8cef302-505a-45dc-9113-668fb800106f on hv-cinder-82002 Jul 21 22:03:28.175170 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-f9dca0a9-b87d-4f14-a336-30c5163c9714 req-02e43a3d-2a41-4c74-bfee-8f55ad220913 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057382 Jul 21 22:03:28.182158 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 240/483] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:03:28.296515 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b0c8d468-022a-45c1-a56c-5ac02f630523 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:28.306055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:28.310839 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b0c8d468-022a-45c1-a56c-5ac02f630523 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:28.312684 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b0c8d468-022a-45c1-a56c-5ac02f630523 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:28.314144 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b0c8d468-022a-45c1-a56c-5ac02f630523 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.245816 Jul 21 22:03:28.314915 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 244/484] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:28 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:28.451353 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2ab0b9d8-a080-4edb-b903-bf8762efc463 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:28.452926 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2ab0b9d8-a080-4edb-b903-bf8762efc463 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:28.467531 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ab0b9d8-a080-4edb-b903-bf8762efc463 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:28.469798 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ab0b9d8-a080-4edb-b903-bf8762efc463 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:28.474099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ab0b9d8-a080-4edb-b903-bf8762efc463 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:28.475566 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ab0b9d8-a080-4edb-b903-bf8762efc463 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:28.635488 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2ab0b9d8-a080-4edb-b903-bf8762efc463 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:28.647325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2ab0b9d8-a080-4edb-b903-bf8762efc463 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1367 microversion: 2.1 time: 0.203009 Jul 21 22:03:28.648556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 241/485] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:28 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:29.334408 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-22b7b9ba-dc15-4e18-b86c-d9e364e811f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:29.335103 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-22b7b9ba-dc15-4e18-b86c-d9e364e811f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:29.344376 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-22b7b9ba-dc15-4e18-b86c-d9e364e811f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:29.344841 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-22b7b9ba-dc15-4e18-b86c-d9e364e811f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:29.345646 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-22b7b9ba-dc15-4e18-b86c-d9e364e811f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:29.346089 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-22b7b9ba-dc15-4e18-b86c-d9e364e811f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:29.520026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-22b7b9ba-dc15-4e18-b86c-d9e364e811f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:29.528721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-22b7b9ba-dc15-4e18-b86c-d9e364e811f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:29.530225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-22b7b9ba-dc15-4e18-b86c-d9e364e811f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:29.531401 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-22b7b9ba-dc15-4e18-b86c-d9e364e811f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.201354 Jul 21 22:03:29.532126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 245/486] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:29 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:29.669510 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5e6cb0bc-c7c3-4b8c-bd5e-b64e3d495582 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:29.670167 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5e6cb0bc-c7c3-4b8c-bd5e-b64e3d495582 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:29.680984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e6cb0bc-c7c3-4b8c-bd5e-b64e3d495582 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:29.681436 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e6cb0bc-c7c3-4b8c-bd5e-b64e3d495582 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:29.682211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e6cb0bc-c7c3-4b8c-bd5e-b64e3d495582 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:29.682647 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e6cb0bc-c7c3-4b8c-bd5e-b64e3d495582 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:29.842520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5e6cb0bc-c7c3-4b8c-bd5e-b64e3d495582 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:29.852108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5e6cb0bc-c7c3-4b8c-bd5e-b64e3d495582 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1367 microversion: 2.1 time: 0.189717 Jul 21 22:03:29.852694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 242/487] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:29 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:30.549494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-986b1015-051f-4688-bdf9-422dbc6f2164 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:30.550120 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-986b1015-051f-4688-bdf9-422dbc6f2164 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:30.556889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-986b1015-051f-4688-bdf9-422dbc6f2164 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:30.557341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-986b1015-051f-4688-bdf9-422dbc6f2164 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:30.558107 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-986b1015-051f-4688-bdf9-422dbc6f2164 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:30.558553 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-986b1015-051f-4688-bdf9-422dbc6f2164 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:30.684593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-986b1015-051f-4688-bdf9-422dbc6f2164 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:30.692650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-986b1015-051f-4688-bdf9-422dbc6f2164 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:30.694160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-986b1015-051f-4688-bdf9-422dbc6f2164 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:30.695335 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-986b1015-051f-4688-bdf9-422dbc6f2164 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.149613 Jul 21 22:03:30.695889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 246/488] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:30 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:30.869003 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5b2045e8-956c-4cc3-99b1-3a6b27113a11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:30.869528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5b2045e8-956c-4cc3-99b1-3a6b27113a11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:30.876613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5b2045e8-956c-4cc3-99b1-3a6b27113a11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:30.877070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5b2045e8-956c-4cc3-99b1-3a6b27113a11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:30.877835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5b2045e8-956c-4cc3-99b1-3a6b27113a11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:30.878274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5b2045e8-956c-4cc3-99b1-3a6b27113a11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:31.002889 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5b2045e8-956c-4cc3-99b1-3a6b27113a11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:31.010281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5b2045e8-956c-4cc3-99b1-3a6b27113a11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1367 microversion: 2.1 time: 0.145193 Jul 21 22:03:31.010872 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 243/489] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:30 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:31.713745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c8eadd18-2282-41b5-b1ee-b19da4de078b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:31.714354 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c8eadd18-2282-41b5-b1ee-b19da4de078b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:31.716665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:31.721950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8eadd18-2282-41b5-b1ee-b19da4de078b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:31.722403 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8eadd18-2282-41b5-b1ee-b19da4de078b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:31.723214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8eadd18-2282-41b5-b1ee-b19da4de078b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:31.723673 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8eadd18-2282-41b5-b1ee-b19da4de078b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:31.854267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c8eadd18-2282-41b5-b1ee-b19da4de078b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:31.862182 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c8eadd18-2282-41b5-b1ee-b19da4de078b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:31.863755 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c8eadd18-2282-41b5-b1ee-b19da4de078b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:31.864906 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c8eadd18-2282-41b5-b1ee-b19da4de078b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.155250 Jul 21 22:03:31.865467 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 247/490] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:31 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:32.026768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cedcddc8-32ee-4ddf-8939-63f86c7d24be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:32.027451 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cedcddc8-32ee-4ddf-8939-63f86c7d24be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:32.034067 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cedcddc8-32ee-4ddf-8939-63f86c7d24be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:32.034552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cedcddc8-32ee-4ddf-8939-63f86c7d24be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:32.035401 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cedcddc8-32ee-4ddf-8939-63f86c7d24be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:32.035841 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cedcddc8-32ee-4ddf-8939-63f86c7d24be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:32.169637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cedcddc8-32ee-4ddf-8939-63f86c7d24be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:32.177109 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cedcddc8-32ee-4ddf-8939-63f86c7d24be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1367 microversion: 2.1 time: 0.153976 Jul 21 22:03:32.177682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 244/491] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:32 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:32.883455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-644f9ff3-7dcb-41e5-9af1-37dbae3e62cb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:32.884096 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-644f9ff3-7dcb-41e5-9af1-37dbae3e62cb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:32.890632 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-644f9ff3-7dcb-41e5-9af1-37dbae3e62cb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:32.891128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-644f9ff3-7dcb-41e5-9af1-37dbae3e62cb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:32.891936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-644f9ff3-7dcb-41e5-9af1-37dbae3e62cb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:32.892385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-644f9ff3-7dcb-41e5-9af1-37dbae3e62cb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:33.030041 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-644f9ff3-7dcb-41e5-9af1-37dbae3e62cb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:33.037959 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-644f9ff3-7dcb-41e5-9af1-37dbae3e62cb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:33.039510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-644f9ff3-7dcb-41e5-9af1-37dbae3e62cb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:33.040678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-644f9ff3-7dcb-41e5-9af1-37dbae3e62cb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1737 microversion: 2.20 time: 0.161095 Jul 21 22:03:33.041231 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 248/492] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:32 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:33.193727 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-81e07fb7-3d0d-4c85-ab2e-9c578683051b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:33.194342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-81e07fb7-3d0d-4c85-ab2e-9c578683051b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:33.200718 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-81e07fb7-3d0d-4c85-ab2e-9c578683051b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:33.201167 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-81e07fb7-3d0d-4c85-ab2e-9c578683051b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:33.201923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-81e07fb7-3d0d-4c85-ab2e-9c578683051b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:33.202357 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-81e07fb7-3d0d-4c85-ab2e-9c578683051b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:33.330905 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-81e07fb7-3d0d-4c85-ab2e-9c578683051b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:33.338644 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-81e07fb7-3d0d-4c85-ab2e-9c578683051b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1367 microversion: 2.1 time: 0.148555 Jul 21 22:03:33.339248 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 245/493] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:33 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:34.059352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6d3bd82d-0579-484d-8dea-faa8d3e6cc0d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:34.060446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6d3bd82d-0579-484d-8dea-faa8d3e6cc0d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:34.066807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6d3bd82d-0579-484d-8dea-faa8d3e6cc0d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:34.067437 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6d3bd82d-0579-484d-8dea-faa8d3e6cc0d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:34.068197 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6d3bd82d-0579-484d-8dea-faa8d3e6cc0d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:34.068632 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6d3bd82d-0579-484d-8dea-faa8d3e6cc0d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:34.197182 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6d3bd82d-0579-484d-8dea-faa8d3e6cc0d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:34.205690 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6d3bd82d-0579-484d-8dea-faa8d3e6cc0d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:34.207222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6d3bd82d-0579-484d-8dea-faa8d3e6cc0d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:34.208524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6d3bd82d-0579-484d-8dea-faa8d3e6cc0d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1719 microversion: 2.20 time: 0.153183 Jul 21 22:03:34.209068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 249/494] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:34 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:34.357078 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8be46604-6e5d-4ac3-b84a-0dd7f96ab129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:34.357684 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8be46604-6e5d-4ac3-b84a-0dd7f96ab129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:34.364290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8be46604-6e5d-4ac3-b84a-0dd7f96ab129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:34.364743 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8be46604-6e5d-4ac3-b84a-0dd7f96ab129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:34.365503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8be46604-6e5d-4ac3-b84a-0dd7f96ab129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:34.365939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8be46604-6e5d-4ac3-b84a-0dd7f96ab129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:34.494174 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8be46604-6e5d-4ac3-b84a-0dd7f96ab129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:34.502606 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8be46604-6e5d-4ac3-b84a-0dd7f96ab129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1367 microversion: 2.1 time: 0.149761 Jul 21 22:03:34.503212 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 246/495] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:34 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:35.082470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-e4a87e0e-586a-4767-8dd4-711b52385b14 req-4faddf78-0f7a-4154-8c24-37a91101f4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8cef302-505a-45dc-9113-668fb800106f", "name": "network-vif-plugged", "status": "completed", "tag": "3d6fb7ed-a22e-4f29-96c2-6e75f44500d5"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:03:35.086968 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:35.087637 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=6 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:35.093412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-e4a87e0e-586a-4767-8dd4-711b52385b14 req-4faddf78-0f7a-4154-8c24-37a91101f4c7 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:35.093861 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-e4a87e0e-586a-4767-8dd4-711b52385b14 req-4faddf78-0f7a-4154-8c24-37a91101f4c7 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:35.105005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-e4a87e0e-586a-4767-8dd4-711b52385b14 req-4faddf78-0f7a-4154-8c24-37a91101f4c7 service nova] Creating event network-vif-plugged:3d6fb7ed-a22e-4f29-96c2-6e75f44500d5 for instance c8cef302-505a-45dc-9113-668fb800106f on hv-cinder-82002 Jul 21 22:03:35.109798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-e4a87e0e-586a-4767-8dd4-711b52385b14 req-4faddf78-0f7a-4154-8c24-37a91101f4c7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030987 Jul 21 22:03:35.110384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 250/496] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:03:35.227192 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a4533b10-7268-4bec-9547-fe03ee0b4dce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:35.227825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a4533b10-7268-4bec-9547-fe03ee0b4dce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:35.229763 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:35.234982 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4533b10-7268-4bec-9547-fe03ee0b4dce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:35.235462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4533b10-7268-4bec-9547-fe03ee0b4dce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:35.236222 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4533b10-7268-4bec-9547-fe03ee0b4dce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:35.236656 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4533b10-7268-4bec-9547-fe03ee0b4dce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:35.365457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a4533b10-7268-4bec-9547-fe03ee0b4dce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:35.373935 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a4533b10-7268-4bec-9547-fe03ee0b4dce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:35.375458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a4533b10-7268-4bec-9547-fe03ee0b4dce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:35.376605 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a4533b10-7268-4bec-9547-fe03ee0b4dce tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1719 microversion: 2.20 time: 0.153357 Jul 21 22:03:35.377163 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 247/497] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:35 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:35.520319 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bdd4671d-cff9-4ec7-b5a4-1125ff016ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:35.521016 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bdd4671d-cff9-4ec7-b5a4-1125ff016ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:35.527278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bdd4671d-cff9-4ec7-b5a4-1125ff016ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:35.527730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bdd4671d-cff9-4ec7-b5a4-1125ff016ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:35.528494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bdd4671d-cff9-4ec7-b5a4-1125ff016ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:35.528931 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bdd4671d-cff9-4ec7-b5a4-1125ff016ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:35.658562 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bdd4671d-cff9-4ec7-b5a4-1125ff016ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:35.666123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bdd4671d-cff9-4ec7-b5a4-1125ff016ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1367 microversion: 2.1 time: 0.149890 Jul 21 22:03:35.666692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 251/498] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:35 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:36.393944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1fabd149-8c80-4cb9-b077-5842902ba22b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:36.394587 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1fabd149-8c80-4cb9-b077-5842902ba22b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:36.401090 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fabd149-8c80-4cb9-b077-5842902ba22b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:36.401541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fabd149-8c80-4cb9-b077-5842902ba22b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:36.402575 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fabd149-8c80-4cb9-b077-5842902ba22b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:36.403037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fabd149-8c80-4cb9-b077-5842902ba22b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:36.531778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1fabd149-8c80-4cb9-b077-5842902ba22b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:36.539568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1fabd149-8c80-4cb9-b077-5842902ba22b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:36.541070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1fabd149-8c80-4cb9-b077-5842902ba22b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:36.542207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1fabd149-8c80-4cb9-b077-5842902ba22b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1722 microversion: 2.20 time: 0.152130 Jul 21 22:03:36.542774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 248/499] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:36 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:36.559946 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9cc2c29d-35e6-47d4-a0d7-6a8b67fc6fde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62429cd7-9017-4dc8-a93b-18e307b00f22"}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:03:36.561112 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9cc2c29d-35e6-47d4-a0d7-6a8b67fc6fde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:36.567550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9cc2c29d-35e6-47d4-a0d7-6a8b67fc6fde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:36.567996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9cc2c29d-35e6-47d4-a0d7-6a8b67fc6fde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:36.568754 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9cc2c29d-35e6-47d4-a0d7-6a8b67fc6fde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:36.569188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9cc2c29d-35e6-47d4-a0d7-6a8b67fc6fde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:36.683239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-35e90d47-d781-4849-97f1-5947dd809771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:36.684114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-35e90d47-d781-4849-97f1-5947dd809771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:36.691825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-35e90d47-d781-4849-97f1-5947dd809771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:36.692627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-35e90d47-d781-4849-97f1-5947dd809771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:36.693422 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-35e90d47-d781-4849-97f1-5947dd809771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:36.693867 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-35e90d47-d781-4849-97f1-5947dd809771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:36.850662 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-35e90d47-d781-4849-97f1-5947dd809771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:36.854054 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:36.859857 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-35e90d47-d781-4849-97f1-5947dd809771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1367 microversion: 2.1 time: 0.181285 Jul 21 22:03:36.861090 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 249/500] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:36 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:03:36.861543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9cc2c29d-35e6-47d4-a0d7-6a8b67fc6fde tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "POST /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.305497 Jul 21 22:03:36.862254 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 252/501] 10.222.0.44 () {62 vars in 1363 bytes} [Thu Jul 21 22:03:36 2022] POST /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-volume_attachments => generated 188 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:03:37.012254 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cc511e56-bbf5-4f74-80d9-36a31390badf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:03:37.013416 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cc511e56-bbf5-4f74-80d9-36a31390badf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:37.020545 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cc511e56-bbf5-4f74-80d9-36a31390badf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:37.020991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cc511e56-bbf5-4f74-80d9-36a31390badf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:37.021752 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cc511e56-bbf5-4f74-80d9-36a31390badf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:37.022202 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cc511e56-bbf5-4f74-80d9-36a31390badf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:37.108056 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cc511e56-bbf5-4f74-80d9-36a31390badf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [7ef40797-9652-4adb-9e9c-48c8047e215f] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 22:03:37.877590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-88176d90-75e6-4f0a-99fb-17aa039767fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:37.878112 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-88176d90-75e6-4f0a-99fb-17aa039767fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:37.885337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-88176d90-75e6-4f0a-99fb-17aa039767fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:37.885816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-88176d90-75e6-4f0a-99fb-17aa039767fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:37.886586 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-88176d90-75e6-4f0a-99fb-17aa039767fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:37.887043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-88176d90-75e6-4f0a-99fb-17aa039767fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:38.019718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-88176d90-75e6-4f0a-99fb-17aa039767fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:38.027223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-88176d90-75e6-4f0a-99fb-17aa039767fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1367 microversion: 2.1 time: 0.153523 Jul 21 22:03:38.027788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 253/502] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:37 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:03:38.116094 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [None req-cc511e56-bbf5-4f74-80d9-36a31390badf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [7ef40797-9652-4adb-9e9c-48c8047e215f] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 56150. Jul 21 22:03:38.123383 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cc511e56-bbf5-4f74-80d9-36a31390badf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "POST /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/action" status: 202 len: 0 microversion: 2.20 time: 1.115099 Jul 21 22:03:38.124174 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 250/503] 10.222.0.44 () {62 vars in 1318 bytes} [Thu Jul 21 22:03:37 2022] POST /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/action => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:03:38.132353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f0a78c93-813a-4535-b99c-6c2d3e36b754 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:38.133006 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f0a78c93-813a-4535-b99c-6c2d3e36b754 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:38.139625 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0a78c93-813a-4535-b99c-6c2d3e36b754 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:38.140083 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0a78c93-813a-4535-b99c-6c2d3e36b754 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:38.140868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0a78c93-813a-4535-b99c-6c2d3e36b754 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:38.141302 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0a78c93-813a-4535-b99c-6c2d3e36b754 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:38.272517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f0a78c93-813a-4535-b99c-6c2d3e36b754 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:38.281611 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f0a78c93-813a-4535-b99c-6c2d3e36b754 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:38.283212 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f0a78c93-813a-4535-b99c-6c2d3e36b754 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:38.284451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f0a78c93-813a-4535-b99c-6c2d3e36b754 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1748 microversion: 2.20 time: 0.156082 Jul 21 22:03:38.285226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 254/504] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:38 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:38.923421 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-f7ff31cf-b47b-4286-9618-59451f10187e req-78c45999-5505-4344-96d4-e07593844689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e2efbe-11d4-4ecc-8825-11f420d36f03", "name": "network-vif-unplugged", "status": "completed", "tag": "978d1e0a-28ef-408b-a540-0a23b3da9c0b"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:03:38.929918 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f7ff31cf-b47b-4286-9618-59451f10187e req-78c45999-5505-4344-96d4-e07593844689 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:38.930618 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f7ff31cf-b47b-4286-9618-59451f10187e req-78c45999-5505-4344-96d4-e07593844689 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:38.943461 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.compute.server_external_events [req-f7ff31cf-b47b-4286-9618-59451f10187e req-78c45999-5505-4344-96d4-e07593844689 service nova] Unable to find a host for instance 84e2efbe-11d4-4ecc-8825-11f420d36f03. Dropping event network-vif-unplugged {{(pid=117978) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 22:03:38.944349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-f7ff31cf-b47b-4286-9618-59451f10187e req-78c45999-5505-4344-96d4-e07593844689 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029467 Jul 21 22:03:38.945384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 251/505] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 21 22:03:39.044349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-eaeb5d4e-3ae0-41c5-8162-212e4a70c31c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:39.045078 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-eaeb5d4e-3ae0-41c5-8162-212e4a70c31c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:39.052132 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eaeb5d4e-3ae0-41c5-8162-212e4a70c31c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:39.052587 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eaeb5d4e-3ae0-41c5-8162-212e4a70c31c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:39.053483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eaeb5d4e-3ae0-41c5-8162-212e4a70c31c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:39.053944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eaeb5d4e-3ae0-41c5-8162-212e4a70c31c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:39.190568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-eaeb5d4e-3ae0-41c5-8162-212e4a70c31c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:39.198170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-eaeb5d4e-3ae0-41c5-8162-212e4a70c31c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1556 microversion: 2.1 time: 0.158149 Jul 21 22:03:39.198719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 255/506] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:03:39 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:03:39.214151 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a79121b8-388e-42f2-a4fa-d7dd1c1c0722 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:39.214638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a79121b8-388e-42f2-a4fa-d7dd1c1c0722 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:39.221075 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a79121b8-388e-42f2-a4fa-d7dd1c1c0722 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:39.221531 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a79121b8-388e-42f2-a4fa-d7dd1c1c0722 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:39.222296 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a79121b8-388e-42f2-a4fa-d7dd1c1c0722 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:39.222732 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a79121b8-388e-42f2-a4fa-d7dd1c1c0722 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:39.302916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a79121b8-388e-42f2-a4fa-d7dd1c1c0722 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092771 Jul 21 22:03:39.303206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b3c62ad7-7af0-4a7e-aef8-7bc6daa94362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:39.303589 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 252/507] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 22:03:39 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:03:39.303885 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b3c62ad7-7af0-4a7e-aef8-7bc6daa94362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:39.309956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3c62ad7-7af0-4a7e-aef8-7bc6daa94362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:39.310410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3c62ad7-7af0-4a7e-aef8-7bc6daa94362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:39.311240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3c62ad7-7af0-4a7e-aef8-7bc6daa94362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:39.311682 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3c62ad7-7af0-4a7e-aef8-7bc6daa94362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:39.571590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b3c62ad7-7af0-4a7e-aef8-7bc6daa94362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:39.580654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b3c62ad7-7af0-4a7e-aef8-7bc6daa94362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:39.582180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b3c62ad7-7af0-4a7e-aef8-7bc6daa94362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:39.583371 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b3c62ad7-7af0-4a7e-aef8-7bc6daa94362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.284358 Jul 21 22:03:39.583929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 256/508] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:39 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:40.533354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-a95a4e8d-c1e5-41f4-aaad-5a131b831050 req-1c3f70c2-0926-44d9-9896-5e7892d85e94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8cef302-505a-45dc-9113-668fb800106f", "tag": "3d6fb7ed-a22e-4f29-96c2-6e75f44500d5"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:03:40.541495 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a95a4e8d-c1e5-41f4-aaad-5a131b831050 req-1c3f70c2-0926-44d9-9896-5e7892d85e94 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:40.542013 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a95a4e8d-c1e5-41f4-aaad-5a131b831050 req-1c3f70c2-0926-44d9-9896-5e7892d85e94 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:40.553264 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-a95a4e8d-c1e5-41f4-aaad-5a131b831050 req-1c3f70c2-0926-44d9-9896-5e7892d85e94 service nova] Creating event network-changed:3d6fb7ed-a22e-4f29-96c2-6e75f44500d5 for instance c8cef302-505a-45dc-9113-668fb800106f on hv-cinder-82002 Jul 21 22:03:40.558862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-a95a4e8d-c1e5-41f4-aaad-5a131b831050 req-1c3f70c2-0926-44d9-9896-5e7892d85e94 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029622 Jul 21 22:03:40.560540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 253/509] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:03:40.603061 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-aa774e2a-93c2-458f-8242-0907f31e2dcf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:40.603676 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-aa774e2a-93c2-458f-8242-0907f31e2dcf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:40.610789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa774e2a-93c2-458f-8242-0907f31e2dcf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:40.611273 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa774e2a-93c2-458f-8242-0907f31e2dcf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:40.612060 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa774e2a-93c2-458f-8242-0907f31e2dcf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:40.612496 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa774e2a-93c2-458f-8242-0907f31e2dcf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:40.750546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-aa774e2a-93c2-458f-8242-0907f31e2dcf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:40.760160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-aa774e2a-93c2-458f-8242-0907f31e2dcf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:40.762030 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-aa774e2a-93c2-458f-8242-0907f31e2dcf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:40.763503 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-aa774e2a-93c2-458f-8242-0907f31e2dcf tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.164422 Jul 21 22:03:40.764610 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 257/510] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:40 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:41.783617 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c9ebe23d-4732-4838-b1e7-d6cd6db80114 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:41.784275 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c9ebe23d-4732-4838-b1e7-d6cd6db80114 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:41.790871 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9ebe23d-4732-4838-b1e7-d6cd6db80114 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:41.791456 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9ebe23d-4732-4838-b1e7-d6cd6db80114 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:41.792229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9ebe23d-4732-4838-b1e7-d6cd6db80114 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:41.792669 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9ebe23d-4732-4838-b1e7-d6cd6db80114 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:41.976459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c9ebe23d-4732-4838-b1e7-d6cd6db80114 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:41.985422 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c9ebe23d-4732-4838-b1e7-d6cd6db80114 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:41.986930 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c9ebe23d-4732-4838-b1e7-d6cd6db80114 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:41.988126 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c9ebe23d-4732-4838-b1e7-d6cd6db80114 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.208828 Jul 21 22:03:41.988679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 254/511] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:41 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:43.005864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ea174d5f-3783-45d5-96d1-aedcd9950969 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:43.006493 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ea174d5f-3783-45d5-96d1-aedcd9950969 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:43.013226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea174d5f-3783-45d5-96d1-aedcd9950969 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:43.013680 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea174d5f-3783-45d5-96d1-aedcd9950969 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:43.014463 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea174d5f-3783-45d5-96d1-aedcd9950969 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:43.014907 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea174d5f-3783-45d5-96d1-aedcd9950969 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:43.201741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ea174d5f-3783-45d5-96d1-aedcd9950969 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:43.211768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ea174d5f-3783-45d5-96d1-aedcd9950969 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:43.213533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ea174d5f-3783-45d5-96d1-aedcd9950969 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:43.214677 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ea174d5f-3783-45d5-96d1-aedcd9950969 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.212727 Jul 21 22:03:43.216082 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 258/512] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:43 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:44.233855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-29274f56-f8d1-431e-81d9-b5a8d318a723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:44.234501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-29274f56-f8d1-431e-81d9-b5a8d318a723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:44.241011 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-29274f56-f8d1-431e-81d9-b5a8d318a723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:44.241412 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-29274f56-f8d1-431e-81d9-b5a8d318a723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:44.242719 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-29274f56-f8d1-431e-81d9-b5a8d318a723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:44.242719 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-29274f56-f8d1-431e-81d9-b5a8d318a723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:44.376756 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-29274f56-f8d1-431e-81d9-b5a8d318a723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:44.385055 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-29274f56-f8d1-431e-81d9-b5a8d318a723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:44.386590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-29274f56-f8d1-431e-81d9-b5a8d318a723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:44.387761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-29274f56-f8d1-431e-81d9-b5a8d318a723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.158349 Jul 21 22:03:44.388322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 255/513] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:44 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:45.408353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-467dc0ff-9739-4a4d-8159-429bf5e5e264 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:45.409375 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-467dc0ff-9739-4a4d-8159-429bf5e5e264 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:45.416963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-467dc0ff-9739-4a4d-8159-429bf5e5e264 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:45.417410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-467dc0ff-9739-4a4d-8159-429bf5e5e264 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:45.418190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-467dc0ff-9739-4a4d-8159-429bf5e5e264 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:45.418765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-467dc0ff-9739-4a4d-8159-429bf5e5e264 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:45.438721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:45.561506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-467dc0ff-9739-4a4d-8159-429bf5e5e264 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:45.569947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-467dc0ff-9739-4a4d-8159-429bf5e5e264 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:45.571529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-467dc0ff-9739-4a4d-8159-429bf5e5e264 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:45.572765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-467dc0ff-9739-4a4d-8159-429bf5e5e264 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.170654 Jul 21 22:03:45.573303 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 259/514] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:45 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:03:46.591583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f348db57-caf7-4432-8085-76da457e0b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:46.592297 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f348db57-caf7-4432-8085-76da457e0b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:46.598840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f348db57-caf7-4432-8085-76da457e0b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:46.599272 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f348db57-caf7-4432-8085-76da457e0b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:46.600044 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f348db57-caf7-4432-8085-76da457e0b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:46.600486 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f348db57-caf7-4432-8085-76da457e0b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:46.730994 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f348db57-caf7-4432-8085-76da457e0b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:46.739347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f348db57-caf7-4432-8085-76da457e0b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:46.740849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f348db57-caf7-4432-8085-76da457e0b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:46.741987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f348db57-caf7-4432-8085-76da457e0b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.155157 Jul 21 22:03:46.742550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 256/515] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:46 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:47.760718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-55b4a052-7a08-413d-808a-f95a1c9c2e49 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:47.761256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-55b4a052-7a08-413d-808a-f95a1c9c2e49 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:47.768363 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55b4a052-7a08-413d-808a-f95a1c9c2e49 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:47.768815 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55b4a052-7a08-413d-808a-f95a1c9c2e49 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:47.769579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55b4a052-7a08-413d-808a-f95a1c9c2e49 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:47.770015 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55b4a052-7a08-413d-808a-f95a1c9c2e49 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:47.902513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-55b4a052-7a08-413d-808a-f95a1c9c2e49 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:47.912161 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-55b4a052-7a08-413d-808a-f95a1c9c2e49 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:47.913698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-55b4a052-7a08-413d-808a-f95a1c9c2e49 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:47.914922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-55b4a052-7a08-413d-808a-f95a1c9c2e49 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.158129 Jul 21 22:03:47.915430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 260/516] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:47 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:48.933807 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-80b8564b-c219-43f8-8915-590f916c0c9d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:48.934520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-80b8564b-c219-43f8-8915-590f916c0c9d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:48.937136 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:03:48.942897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-80b8564b-c219-43f8-8915-590f916c0c9d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:48.943381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-80b8564b-c219-43f8-8915-590f916c0c9d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:48.944148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-80b8564b-c219-43f8-8915-590f916c0c9d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:48.944584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-80b8564b-c219-43f8-8915-590f916c0c9d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:49.072004 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-80b8564b-c219-43f8-8915-590f916c0c9d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:49.080262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-80b8564b-c219-43f8-8915-590f916c0c9d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:49.081752 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-80b8564b-c219-43f8-8915-590f916c0c9d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:49.082887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-80b8564b-c219-43f8-8915-590f916c0c9d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.153106 Jul 21 22:03:49.083484 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 257/517] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:48 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:50.101672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7b4ff6d2-f78a-4b45-ad82-75c56b6806b1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:50.102228 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7b4ff6d2-f78a-4b45-ad82-75c56b6806b1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:50.108752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7b4ff6d2-f78a-4b45-ad82-75c56b6806b1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:50.109204 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7b4ff6d2-f78a-4b45-ad82-75c56b6806b1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:50.109961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7b4ff6d2-f78a-4b45-ad82-75c56b6806b1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:50.110392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7b4ff6d2-f78a-4b45-ad82-75c56b6806b1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:50.240386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7b4ff6d2-f78a-4b45-ad82-75c56b6806b1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:50.248724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7b4ff6d2-f78a-4b45-ad82-75c56b6806b1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:50.250240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7b4ff6d2-f78a-4b45-ad82-75c56b6806b1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:50.251415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7b4ff6d2-f78a-4b45-ad82-75c56b6806b1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.153684 Jul 21 22:03:50.251976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 261/518] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:50 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:51.269851 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3cfe197d-a053-4e54-a423-db634b33c723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:51.270450 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3cfe197d-a053-4e54-a423-db634b33c723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:51.276903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3cfe197d-a053-4e54-a423-db634b33c723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:51.277851 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3cfe197d-a053-4e54-a423-db634b33c723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:51.278607 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3cfe197d-a053-4e54-a423-db634b33c723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:51.279061 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3cfe197d-a053-4e54-a423-db634b33c723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:51.404361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3cfe197d-a053-4e54-a423-db634b33c723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:51.412637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3cfe197d-a053-4e54-a423-db634b33c723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:51.414130 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3cfe197d-a053-4e54-a423-db634b33c723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:51.415302 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3cfe197d-a053-4e54-a423-db634b33c723 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.149277 Jul 21 22:03:51.415864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 258/519] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:51 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:52.434761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-53c500de-57fb-4a1a-8fb8-f6d7a8026342 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:52.435382 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-53c500de-57fb-4a1a-8fb8-f6d7a8026342 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:52.441720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-53c500de-57fb-4a1a-8fb8-f6d7a8026342 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:52.442167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-53c500de-57fb-4a1a-8fb8-f6d7a8026342 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:52.442923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-53c500de-57fb-4a1a-8fb8-f6d7a8026342 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:52.443384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-53c500de-57fb-4a1a-8fb8-f6d7a8026342 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:52.570605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-53c500de-57fb-4a1a-8fb8-f6d7a8026342 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:52.578938 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-53c500de-57fb-4a1a-8fb8-f6d7a8026342 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:52.580475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-53c500de-57fb-4a1a-8fb8-f6d7a8026342 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:52.581609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-53c500de-57fb-4a1a-8fb8-f6d7a8026342 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.151452 Jul 21 22:03:52.582256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 262/520] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:52 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:53.600138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fad84475-857e-4ef4-9e5b-bb4b468ac0de tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:53.600795 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fad84475-857e-4ef4-9e5b-bb4b468ac0de tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:53.607163 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fad84475-857e-4ef4-9e5b-bb4b468ac0de tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:53.607613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fad84475-857e-4ef4-9e5b-bb4b468ac0de tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:53.608373 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fad84475-857e-4ef4-9e5b-bb4b468ac0de tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:53.608807 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fad84475-857e-4ef4-9e5b-bb4b468ac0de tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:53.737474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fad84475-857e-4ef4-9e5b-bb4b468ac0de tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:53.746580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fad84475-857e-4ef4-9e5b-bb4b468ac0de tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:53.748118 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fad84475-857e-4ef4-9e5b-bb4b468ac0de tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:53.749264 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fad84475-857e-4ef4-9e5b-bb4b468ac0de tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.153250 Jul 21 22:03:53.749833 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 259/521] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:53 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:54.766949 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-47023d85-47c6-4443-91e3-c42edd133af9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:54.767496 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-47023d85-47c6-4443-91e3-c42edd133af9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:54.773964 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-47023d85-47c6-4443-91e3-c42edd133af9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:54.774415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-47023d85-47c6-4443-91e3-c42edd133af9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:54.775222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-47023d85-47c6-4443-91e3-c42edd133af9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:54.775662 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-47023d85-47c6-4443-91e3-c42edd133af9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:54.904404 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-47023d85-47c6-4443-91e3-c42edd133af9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:54.912697 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-47023d85-47c6-4443-91e3-c42edd133af9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:54.914214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-47023d85-47c6-4443-91e3-c42edd133af9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:54.915397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-47023d85-47c6-4443-91e3-c42edd133af9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.152408 Jul 21 22:03:54.915963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 263/522] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:54 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:55.932513 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2606a3c3-07ed-4881-9e07-7a9cf1abfb84 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:55.933114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2606a3c3-07ed-4881-9e07-7a9cf1abfb84 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:55.939972 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2606a3c3-07ed-4881-9e07-7a9cf1abfb84 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:55.940426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2606a3c3-07ed-4881-9e07-7a9cf1abfb84 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:55.941194 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2606a3c3-07ed-4881-9e07-7a9cf1abfb84 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:55.941632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2606a3c3-07ed-4881-9e07-7a9cf1abfb84 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:56.075255 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2606a3c3-07ed-4881-9e07-7a9cf1abfb84 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:56.088981 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2606a3c3-07ed-4881-9e07-7a9cf1abfb84 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:56.090504 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2606a3c3-07ed-4881-9e07-7a9cf1abfb84 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:56.091682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2606a3c3-07ed-4881-9e07-7a9cf1abfb84 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.163017 Jul 21 22:03:56.092427 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 260/523] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:55 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:57.109546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-90e50d03-03ac-45dd-b66b-5b9e98930a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:57.110152 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-90e50d03-03ac-45dd-b66b-5b9e98930a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:57.116713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-90e50d03-03ac-45dd-b66b-5b9e98930a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:57.117160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-90e50d03-03ac-45dd-b66b-5b9e98930a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:57.117920 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-90e50d03-03ac-45dd-b66b-5b9e98930a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:57.118353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-90e50d03-03ac-45dd-b66b-5b9e98930a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:57.244201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-90e50d03-03ac-45dd-b66b-5b9e98930a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:57.252930 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-90e50d03-03ac-45dd-b66b-5b9e98930a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:57.254440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-90e50d03-03ac-45dd-b66b-5b9e98930a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:57.255625 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-90e50d03-03ac-45dd-b66b-5b9e98930a90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.149970 Jul 21 22:03:57.256173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 264/524] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:57 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:58.274059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d31354c7-57cf-4724-839a-53ea46c666eb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:58.274600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d31354c7-57cf-4724-839a-53ea46c666eb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:58.281743 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d31354c7-57cf-4724-839a-53ea46c666eb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:58.282195 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d31354c7-57cf-4724-839a-53ea46c666eb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:58.282958 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d31354c7-57cf-4724-839a-53ea46c666eb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:58.283426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d31354c7-57cf-4724-839a-53ea46c666eb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:58.413486 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d31354c7-57cf-4724-839a-53ea46c666eb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:58.421761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d31354c7-57cf-4724-839a-53ea46c666eb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:58.423293 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d31354c7-57cf-4724-839a-53ea46c666eb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:58.424448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d31354c7-57cf-4724-839a-53ea46c666eb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.154297 Jul 21 22:03:58.425007 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 261/525] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:58 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:03:59.542269 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d1031c1d-2220-47ba-8244-f5618d152554 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:03:59.543602 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d1031c1d-2220-47ba-8244-f5618d152554 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:03:59.549655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d1031c1d-2220-47ba-8244-f5618d152554 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:59.550108 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d1031c1d-2220-47ba-8244-f5618d152554 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:59.550883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d1031c1d-2220-47ba-8244-f5618d152554 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:03:59.551352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d1031c1d-2220-47ba-8244-f5618d152554 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:03:59.684220 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d1031c1d-2220-47ba-8244-f5618d152554 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:59.692726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d1031c1d-2220-47ba-8244-f5618d152554 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:59.694238 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d1031c1d-2220-47ba-8244-f5618d152554 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:03:59.695476 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d1031c1d-2220-47ba-8244-f5618d152554 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.257098 Jul 21 22:03:59.695970 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 265/526] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:03:59 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:00.714265 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f4c30ec6-81cc-4c82-aed5-f9352c3832d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:00.714875 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f4c30ec6-81cc-4c82-aed5-f9352c3832d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:00.721474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f4c30ec6-81cc-4c82-aed5-f9352c3832d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:00.722027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f4c30ec6-81cc-4c82-aed5-f9352c3832d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:00.722837 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f4c30ec6-81cc-4c82-aed5-f9352c3832d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:00.723318 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f4c30ec6-81cc-4c82-aed5-f9352c3832d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:00.849488 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f4c30ec6-81cc-4c82-aed5-f9352c3832d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:00.858483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f4c30ec6-81cc-4c82-aed5-f9352c3832d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:00.860037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f4c30ec6-81cc-4c82-aed5-f9352c3832d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:00.861189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f4c30ec6-81cc-4c82-aed5-f9352c3832d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.151099 Jul 21 22:04:00.861751 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 262/527] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:00 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:01.879513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-60a779c7-05cb-4a21-95f5-ac095dc553ee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:01.880198 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-60a779c7-05cb-4a21-95f5-ac095dc553ee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:01.882513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=38 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:04:01.887903 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60a779c7-05cb-4a21-95f5-ac095dc553ee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:01.888353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60a779c7-05cb-4a21-95f5-ac095dc553ee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:01.889783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60a779c7-05cb-4a21-95f5-ac095dc553ee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:01.890222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60a779c7-05cb-4a21-95f5-ac095dc553ee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:02.019459 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-60a779c7-05cb-4a21-95f5-ac095dc553ee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:02.027774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-60a779c7-05cb-4a21-95f5-ac095dc553ee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:02.029289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-60a779c7-05cb-4a21-95f5-ac095dc553ee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:02.030434 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-60a779c7-05cb-4a21-95f5-ac095dc553ee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.154870 Jul 21 22:04:02.031034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 266/528] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:01 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:03.048647 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b26d4b9f-d4c5-4f4d-85b0-6381b179f464 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:03.049235 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b26d4b9f-d4c5-4f4d-85b0-6381b179f464 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:03.055670 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b26d4b9f-d4c5-4f4d-85b0-6381b179f464 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:03.056119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b26d4b9f-d4c5-4f4d-85b0-6381b179f464 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:03.056878 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b26d4b9f-d4c5-4f4d-85b0-6381b179f464 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:03.057312 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b26d4b9f-d4c5-4f4d-85b0-6381b179f464 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:03.182968 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b26d4b9f-d4c5-4f4d-85b0-6381b179f464 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:03.191964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b26d4b9f-d4c5-4f4d-85b0-6381b179f464 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:03.193487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b26d4b9f-d4c5-4f4d-85b0-6381b179f464 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:03.194637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b26d4b9f-d4c5-4f4d-85b0-6381b179f464 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.150170 Jul 21 22:04:03.195266 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 263/529] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:03 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:04.212906 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3623125e-2697-4cba-8602-28ed6f425a24 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:04.213551 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3623125e-2697-4cba-8602-28ed6f425a24 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:04.220722 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3623125e-2697-4cba-8602-28ed6f425a24 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:04.221173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3623125e-2697-4cba-8602-28ed6f425a24 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:04.221946 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3623125e-2697-4cba-8602-28ed6f425a24 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:04.222386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3623125e-2697-4cba-8602-28ed6f425a24 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:04.354854 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3623125e-2697-4cba-8602-28ed6f425a24 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:04.363140 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3623125e-2697-4cba-8602-28ed6f425a24 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:04.364652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3623125e-2697-4cba-8602-28ed6f425a24 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:04.365798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3623125e-2697-4cba-8602-28ed6f425a24 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.157040 Jul 21 22:04:04.366358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 267/530] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:04 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:05.383064 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f9ae3a0a-8f4e-4580-9a3c-385ab65f5d89 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:05.383670 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f9ae3a0a-8f4e-4580-9a3c-385ab65f5d89 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:05.390100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9ae3a0a-8f4e-4580-9a3c-385ab65f5d89 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:05.390548 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9ae3a0a-8f4e-4580-9a3c-385ab65f5d89 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:05.391346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9ae3a0a-8f4e-4580-9a3c-385ab65f5d89 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:05.391780 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9ae3a0a-8f4e-4580-9a3c-385ab65f5d89 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:05.520548 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f9ae3a0a-8f4e-4580-9a3c-385ab65f5d89 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:05.529484 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f9ae3a0a-8f4e-4580-9a3c-385ab65f5d89 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:05.530990 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f9ae3a0a-8f4e-4580-9a3c-385ab65f5d89 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:05.532157 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f9ae3a0a-8f4e-4580-9a3c-385ab65f5d89 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.152929 Jul 21 22:04:05.532716 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 264/531] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:05 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:06.550275 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9fc7768b-eed3-45d1-abca-627ead2d4f11 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:06.550910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9fc7768b-eed3-45d1-abca-627ead2d4f11 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:06.557995 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9fc7768b-eed3-45d1-abca-627ead2d4f11 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:06.558451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9fc7768b-eed3-45d1-abca-627ead2d4f11 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:06.559282 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9fc7768b-eed3-45d1-abca-627ead2d4f11 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:06.559722 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9fc7768b-eed3-45d1-abca-627ead2d4f11 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:06.687336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9fc7768b-eed3-45d1-abca-627ead2d4f11 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:06.695960 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9fc7768b-eed3-45d1-abca-627ead2d4f11 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:06.697491 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9fc7768b-eed3-45d1-abca-627ead2d4f11 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:06.698639 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9fc7768b-eed3-45d1-abca-627ead2d4f11 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.152478 Jul 21 22:04:06.699225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 268/532] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:06 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:07.716891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-df672058-f1b9-4692-8766-2f91529db362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:07.717548 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-df672058-f1b9-4692-8766-2f91529db362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:07.723737 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df672058-f1b9-4692-8766-2f91529db362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:07.724197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df672058-f1b9-4692-8766-2f91529db362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:07.724971 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df672058-f1b9-4692-8766-2f91529db362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:07.725412 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df672058-f1b9-4692-8766-2f91529db362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:07.728003 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:04:07.855852 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-df672058-f1b9-4692-8766-2f91529db362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:07.864942 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-df672058-f1b9-4692-8766-2f91529db362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:07.866434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-df672058-f1b9-4692-8766-2f91529db362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:07.867605 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-df672058-f1b9-4692-8766-2f91529db362 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.154845 Jul 21 22:04:07.868166 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 265/533] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:07 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:08.885738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0263aad7-56ef-4445-87e8-91e5f9de2ea0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:08.886345 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0263aad7-56ef-4445-87e8-91e5f9de2ea0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:08.892885 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0263aad7-56ef-4445-87e8-91e5f9de2ea0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:08.893332 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0263aad7-56ef-4445-87e8-91e5f9de2ea0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:08.894094 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0263aad7-56ef-4445-87e8-91e5f9de2ea0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:08.894527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0263aad7-56ef-4445-87e8-91e5f9de2ea0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:09.020495 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0263aad7-56ef-4445-87e8-91e5f9de2ea0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:09.028947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0263aad7-56ef-4445-87e8-91e5f9de2ea0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:09.030458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0263aad7-56ef-4445-87e8-91e5f9de2ea0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:09.031634 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0263aad7-56ef-4445-87e8-91e5f9de2ea0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.149870 Jul 21 22:04:09.032224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 269/534] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:08 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:10.049419 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4da0317a-83c7-46b0-8b95-43e836c4a414 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:10.050017 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4da0317a-83c7-46b0-8b95-43e836c4a414 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:10.056673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4da0317a-83c7-46b0-8b95-43e836c4a414 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:10.057127 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4da0317a-83c7-46b0-8b95-43e836c4a414 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:10.057897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4da0317a-83c7-46b0-8b95-43e836c4a414 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:10.058337 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4da0317a-83c7-46b0-8b95-43e836c4a414 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:10.189983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4da0317a-83c7-46b0-8b95-43e836c4a414 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:10.198523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4da0317a-83c7-46b0-8b95-43e836c4a414 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:10.200054 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4da0317a-83c7-46b0-8b95-43e836c4a414 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:10.201741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4da0317a-83c7-46b0-8b95-43e836c4a414 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.156310 Jul 21 22:04:10.202302 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 266/535] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:10 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:11.220294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9b54e3cd-4f79-4df9-9a39-adc95cd8e706 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:11.220898 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9b54e3cd-4f79-4df9-9a39-adc95cd8e706 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:11.227437 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b54e3cd-4f79-4df9-9a39-adc95cd8e706 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:11.227888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b54e3cd-4f79-4df9-9a39-adc95cd8e706 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:11.228646 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b54e3cd-4f79-4df9-9a39-adc95cd8e706 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:11.229078 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b54e3cd-4f79-4df9-9a39-adc95cd8e706 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:11.359623 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9b54e3cd-4f79-4df9-9a39-adc95cd8e706 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:11.367958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9b54e3cd-4f79-4df9-9a39-adc95cd8e706 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:11.369480 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9b54e3cd-4f79-4df9-9a39-adc95cd8e706 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:11.370633 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9b54e3cd-4f79-4df9-9a39-adc95cd8e706 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.154796 Jul 21 22:04:11.371210 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 270/536] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:11 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:12.388375 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-938a24bf-5213-4d7f-b4ee-ea0c97fba358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:12.388966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-938a24bf-5213-4d7f-b4ee-ea0c97fba358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:12.395423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-938a24bf-5213-4d7f-b4ee-ea0c97fba358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:12.395869 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-938a24bf-5213-4d7f-b4ee-ea0c97fba358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:12.396627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-938a24bf-5213-4d7f-b4ee-ea0c97fba358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:12.397063 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-938a24bf-5213-4d7f-b4ee-ea0c97fba358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:12.526573 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-938a24bf-5213-4d7f-b4ee-ea0c97fba358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:12.535569 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-938a24bf-5213-4d7f-b4ee-ea0c97fba358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:12.537075 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-938a24bf-5213-4d7f-b4ee-ea0c97fba358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:12.538214 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-938a24bf-5213-4d7f-b4ee-ea0c97fba358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.153688 Jul 21 22:04:12.538766 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 267/537] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:12 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:13.556331 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ec6d040f-1a47-4d53-8a2b-dba59f6053d6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:13.556938 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ec6d040f-1a47-4d53-8a2b-dba59f6053d6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:13.564192 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec6d040f-1a47-4d53-8a2b-dba59f6053d6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:13.564642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec6d040f-1a47-4d53-8a2b-dba59f6053d6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:13.565408 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec6d040f-1a47-4d53-8a2b-dba59f6053d6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:13.565840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec6d040f-1a47-4d53-8a2b-dba59f6053d6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:13.692489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ec6d040f-1a47-4d53-8a2b-dba59f6053d6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:13.700729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ec6d040f-1a47-4d53-8a2b-dba59f6053d6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:13.702269 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ec6d040f-1a47-4d53-8a2b-dba59f6053d6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:13.703440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ec6d040f-1a47-4d53-8a2b-dba59f6053d6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.150979 Jul 21 22:04:13.703993 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 271/538] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:13 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:14.722007 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6106bb7c-c859-4f34-bf7e-698193884be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:14.722616 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6106bb7c-c859-4f34-bf7e-698193884be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:14.729066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6106bb7c-c859-4f34-bf7e-698193884be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:14.729513 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6106bb7c-c859-4f34-bf7e-698193884be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:14.730272 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6106bb7c-c859-4f34-bf7e-698193884be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:14.730705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6106bb7c-c859-4f34-bf7e-698193884be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:14.855696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6106bb7c-c859-4f34-bf7e-698193884be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:14.864810 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6106bb7c-c859-4f34-bf7e-698193884be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:14.866307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6106bb7c-c859-4f34-bf7e-698193884be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:14.867475 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6106bb7c-c859-4f34-bf7e-698193884be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.149449 Jul 21 22:04:14.868033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 268/539] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:14 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:15.885828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b3f69118-7e1b-467f-b83e-1d668def3df2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:15.886473 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b3f69118-7e1b-467f-b83e-1d668def3df2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:15.893210 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3f69118-7e1b-467f-b83e-1d668def3df2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:15.893654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3f69118-7e1b-467f-b83e-1d668def3df2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:15.894410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3f69118-7e1b-467f-b83e-1d668def3df2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:15.894842 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3f69118-7e1b-467f-b83e-1d668def3df2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:15.898670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=75 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:04:16.026338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b3f69118-7e1b-467f-b83e-1d668def3df2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:16.034698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b3f69118-7e1b-467f-b83e-1d668def3df2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:16.036223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b3f69118-7e1b-467f-b83e-1d668def3df2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:16.037360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b3f69118-7e1b-467f-b83e-1d668def3df2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.155441 Jul 21 22:04:16.037914 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 272/540] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:15 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:17.054572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-19c7f918-8701-458e-a599-f4baf032d8b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:17.055206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-19c7f918-8701-458e-a599-f4baf032d8b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:17.061553 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19c7f918-8701-458e-a599-f4baf032d8b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:17.061999 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19c7f918-8701-458e-a599-f4baf032d8b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:17.062794 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19c7f918-8701-458e-a599-f4baf032d8b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:17.063250 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19c7f918-8701-458e-a599-f4baf032d8b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:17.190179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-19c7f918-8701-458e-a599-f4baf032d8b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:17.198596 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-19c7f918-8701-458e-a599-f4baf032d8b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:17.200633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-19c7f918-8701-458e-a599-f4baf032d8b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:17.201780 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-19c7f918-8701-458e-a599-f4baf032d8b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.151012 Jul 21 22:04:17.202339 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 269/541] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:17 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:18.220391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-73f92255-24dc-40a6-a730-7ba1f3c453ba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:18.220989 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-73f92255-24dc-40a6-a730-7ba1f3c453ba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:18.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73f92255-24dc-40a6-a730-7ba1f3c453ba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:18.227889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73f92255-24dc-40a6-a730-7ba1f3c453ba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:18.228658 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73f92255-24dc-40a6-a730-7ba1f3c453ba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:18.229097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73f92255-24dc-40a6-a730-7ba1f3c453ba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:18.387866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-73f92255-24dc-40a6-a730-7ba1f3c453ba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:18.396414 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-73f92255-24dc-40a6-a730-7ba1f3c453ba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:18.397925 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-73f92255-24dc-40a6-a730-7ba1f3c453ba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:18.399112 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-73f92255-24dc-40a6-a730-7ba1f3c453ba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.182622 Jul 21 22:04:18.399670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 273/542] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:18 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:19.417515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-202fbb07-367c-4ec4-8957-a85556d81277 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:19.418116 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-202fbb07-367c-4ec4-8957-a85556d81277 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:19.420967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=26 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:04:19.426196 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-202fbb07-367c-4ec4-8957-a85556d81277 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:19.426644 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-202fbb07-367c-4ec4-8957-a85556d81277 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:19.427436 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-202fbb07-367c-4ec4-8957-a85556d81277 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:19.427871 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-202fbb07-367c-4ec4-8957-a85556d81277 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:19.563318 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-202fbb07-367c-4ec4-8957-a85556d81277 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:19.571628 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-202fbb07-367c-4ec4-8957-a85556d81277 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:19.573123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-202fbb07-367c-4ec4-8957-a85556d81277 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:19.574263 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-202fbb07-367c-4ec4-8957-a85556d81277 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.160668 Jul 21 22:04:19.574822 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 270/543] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:19 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:19.587168 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:04:19.587890 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:04:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:04:20.447110 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bdbf9e22-e6da-4528-8ce1-0cdef3d81062 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:20.447617 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bdbf9e22-e6da-4528-8ce1-0cdef3d81062 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:20.454833 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bdbf9e22-e6da-4528-8ce1-0cdef3d81062 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:20.455322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bdbf9e22-e6da-4528-8ce1-0cdef3d81062 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:20.456079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bdbf9e22-e6da-4528-8ce1-0cdef3d81062 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:20.456516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bdbf9e22-e6da-4528-8ce1-0cdef3d81062 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:20.481142 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bdbf9e22-e6da-4528-8ce1-0cdef3d81062 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Going to try to terminate instance {{(pid=117979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:04:20.566771 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bdbf9e22-e6da-4528-8ce1-0cdef3d81062 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 204 len: 0 microversion: 2.1 time: 0.123225 Jul 21 22:04:20.567382 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 274/544] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:04:20 2022] DELETE /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:04:20.576277 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-42a53208-d54e-4d94-bec7-793c515d6e75 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:20.576926 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-42a53208-d54e-4d94-bec7-793c515d6e75 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:20.583588 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42a53208-d54e-4d94-bec7-793c515d6e75 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:20.584017 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42a53208-d54e-4d94-bec7-793c515d6e75 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:20.584777 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42a53208-d54e-4d94-bec7-793c515d6e75 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:20.585209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42a53208-d54e-4d94-bec7-793c515d6e75 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:20.592947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ae9c2935-076c-43ea-9357-c4ee8c0852fd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:20.593647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ae9c2935-076c-43ea-9357-c4ee8c0852fd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:20.599620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae9c2935-076c-43ea-9357-c4ee8c0852fd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:20.600073 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae9c2935-076c-43ea-9357-c4ee8c0852fd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:20.600849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae9c2935-076c-43ea-9357-c4ee8c0852fd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:20.601286 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae9c2935-076c-43ea-9357-c4ee8c0852fd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:20.781541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-42a53208-d54e-4d94-bec7-793c515d6e75 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:20.787892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ae9c2935-076c-43ea-9357-c4ee8c0852fd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:20.789035 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-42a53208-d54e-4d94-bec7-793c515d6e75 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1575 microversion: 2.1 time: 0.217394 Jul 21 22:04:20.789617 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 271/545] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:20 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1575 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:20.796820 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ae9c2935-076c-43ea-9357-c4ee8c0852fd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:20.798336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ae9c2935-076c-43ea-9357-c4ee8c0852fd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:20.799522 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ae9c2935-076c-43ea-9357-c4ee8c0852fd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.210780 Jul 21 22:04:20.800073 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 275/546] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:20 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:21.807205 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fe92297d-4cf2-4b77-a8be-fe0b912f2057 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:21.807821 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fe92297d-4cf2-4b77-a8be-fe0b912f2057 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:21.814908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fe92297d-4cf2-4b77-a8be-fe0b912f2057 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:21.815396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fe92297d-4cf2-4b77-a8be-fe0b912f2057 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:21.816170 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fe92297d-4cf2-4b77-a8be-fe0b912f2057 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:21.816610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fe92297d-4cf2-4b77-a8be-fe0b912f2057 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:21.818525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cd5d51d8-023e-4c46-acee-06c64f02b317 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:21.819159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cd5d51d8-023e-4c46-acee-06c64f02b317 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:21.825413 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd5d51d8-023e-4c46-acee-06c64f02b317 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:21.825861 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd5d51d8-023e-4c46-acee-06c64f02b317 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:21.827402 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd5d51d8-023e-4c46-acee-06c64f02b317 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:21.827834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd5d51d8-023e-4c46-acee-06c64f02b317 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:22.013489 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fe92297d-4cf2-4b77-a8be-fe0b912f2057 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:22.018077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-cd5d51d8-023e-4c46-acee-06c64f02b317 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:22.021853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fe92297d-4cf2-4b77-a8be-fe0b912f2057 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1575 microversion: 2.1 time: 0.218772 Jul 21 22:04:22.022430 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 272/547] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:21 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:22.026630 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-cd5d51d8-023e-4c46-acee-06c64f02b317 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:22.028406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-cd5d51d8-023e-4c46-acee-06c64f02b317 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:22.029635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cd5d51d8-023e-4c46-acee-06c64f02b317 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.215560 Jul 21 22:04:22.030332 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 276/548] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:21 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:23.038682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4189a408-0468-44aa-89c8-2987417fcb07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:23.039281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4189a408-0468-44aa-89c8-2987417fcb07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:23.045842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4189a408-0468-44aa-89c8-2987417fcb07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:23.046298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4189a408-0468-44aa-89c8-2987417fcb07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:23.047628 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4189a408-0468-44aa-89c8-2987417fcb07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:23.047628 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4189a408-0468-44aa-89c8-2987417fcb07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:23.048254 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8f709d68-c81b-4e8a-9489-463808ca7a60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:23.048937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8f709d68-c81b-4e8a-9489-463808ca7a60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:23.056023 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f709d68-c81b-4e8a-9489-463808ca7a60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:23.056480 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f709d68-c81b-4e8a-9489-463808ca7a60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:23.057257 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f709d68-c81b-4e8a-9489-463808ca7a60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:23.057694 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f709d68-c81b-4e8a-9489-463808ca7a60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:23.249978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4189a408-0468-44aa-89c8-2987417fcb07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:23.253386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8f709d68-c81b-4e8a-9489-463808ca7a60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:23.257717 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4189a408-0468-44aa-89c8-2987417fcb07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1575 microversion: 2.1 time: 0.222937 Jul 21 22:04:23.258291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 273/549] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:23 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1575 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:23.263037 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8f709d68-c81b-4e8a-9489-463808ca7a60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:23.265414 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8f709d68-c81b-4e8a-9489-463808ca7a60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:23.266833 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8f709d68-c81b-4e8a-9489-463808ca7a60 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.222514 Jul 21 22:04:23.267940 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 277/550] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:23 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:23.661084 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-5eb55c1c-0bfe-4170-a930-9c5daf4ce5fb req-05640989-8385-4652-abbb-798c303d4f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc368e51-a804-44e7-8341-b5a36c3173a5", "name": "network-vif-deleted", "tag": "ea05b6f6-1e21-4d99-948d-a0fa000d0aea"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:04:23.669668 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-5eb55c1c-0bfe-4170-a930-9c5daf4ce5fb req-05640989-8385-4652-abbb-798c303d4f0e service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:23.670687 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-5eb55c1c-0bfe-4170-a930-9c5daf4ce5fb req-05640989-8385-4652-abbb-798c303d4f0e service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:23.682664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-5eb55c1c-0bfe-4170-a930-9c5daf4ce5fb req-05640989-8385-4652-abbb-798c303d4f0e service nova] Creating event network-vif-deleted:ea05b6f6-1e21-4d99-948d-a0fa000d0aea for instance bc368e51-a804-44e7-8341-b5a36c3173a5 on hv-cinder-82002 Jul 21 22:04:23.688874 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-5eb55c1c-0bfe-4170-a930-9c5daf4ce5fb req-05640989-8385-4652-abbb-798c303d4f0e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131351 Jul 21 22:04:23.689577 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 274/551] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:04:24.275177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0595f709-1cb0-46cb-86f8-ccccac66cd1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:24.275880 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0595f709-1cb0-46cb-86f8-ccccac66cd1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:24.284386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0595f709-1cb0-46cb-86f8-ccccac66cd1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:24.285299 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0595f709-1cb0-46cb-86f8-ccccac66cd1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:24.286089 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0595f709-1cb0-46cb-86f8-ccccac66cd1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:24.286971 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0595f709-1cb0-46cb-86f8-ccccac66cd1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:24.288245 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-88f2ac6a-3b30-4077-9f87-46bebb30f6c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:24.289048 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-88f2ac6a-3b30-4077-9f87-46bebb30f6c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:24.297910 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-88f2ac6a-3b30-4077-9f87-46bebb30f6c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:24.298699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-88f2ac6a-3b30-4077-9f87-46bebb30f6c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:24.299772 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-88f2ac6a-3b30-4077-9f87-46bebb30f6c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:24.300431 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-88f2ac6a-3b30-4077-9f87-46bebb30f6c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:24.365590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0595f709-1cb0-46cb-86f8-ccccac66cd1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:24.374135 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0595f709-1cb0-46cb-86f8-ccccac66cd1f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.102863 Jul 21 22:04:24.374714 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 278/552] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:24 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:24.487907 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-88f2ac6a-3b30-4077-9f87-46bebb30f6c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:24.497298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-88f2ac6a-3b30-4077-9f87-46bebb30f6c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:24.499203 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-88f2ac6a-3b30-4077-9f87-46bebb30f6c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:24.500364 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-88f2ac6a-3b30-4077-9f87-46bebb30f6c9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.218178 Jul 21 22:04:24.500924 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 275/553] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:24 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:25.390647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-31de3104-d432-4a47-b6e3-346137636b97 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:25.391311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-31de3104-d432-4a47-b6e3-346137636b97 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:25.397858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31de3104-d432-4a47-b6e3-346137636b97 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:25.398302 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31de3104-d432-4a47-b6e3-346137636b97 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:25.399105 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31de3104-d432-4a47-b6e3-346137636b97 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:25.399538 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31de3104-d432-4a47-b6e3-346137636b97 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:25.465511 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-31de3104-d432-4a47-b6e3-346137636b97 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:25.473624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-31de3104-d432-4a47-b6e3-346137636b97 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.086750 Jul 21 22:04:25.474197 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 279/554] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:25 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:25.517747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3734aa1b-c7fe-44d3-b4c1-47d76c49c443 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:25.518361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3734aa1b-c7fe-44d3-b4c1-47d76c49c443 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:25.525019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3734aa1b-c7fe-44d3-b4c1-47d76c49c443 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:25.525466 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3734aa1b-c7fe-44d3-b4c1-47d76c49c443 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:25.526237 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3734aa1b-c7fe-44d3-b4c1-47d76c49c443 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:25.526670 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3734aa1b-c7fe-44d3-b4c1-47d76c49c443 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:25.656719 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3734aa1b-c7fe-44d3-b4c1-47d76c49c443 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:25.665513 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3734aa1b-c7fe-44d3-b4c1-47d76c49c443 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:25.667185 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3734aa1b-c7fe-44d3-b4c1-47d76c49c443 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:25.668335 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3734aa1b-c7fe-44d3-b4c1-47d76c49c443 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.154596 Jul 21 22:04:25.668895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 276/555] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:25 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:26.490606 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-73b1be39-9eb5-4d85-aab9-b50f771b8c7f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:26.491249 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-73b1be39-9eb5-4d85-aab9-b50f771b8c7f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:26.497643 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73b1be39-9eb5-4d85-aab9-b50f771b8c7f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:26.498091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73b1be39-9eb5-4d85-aab9-b50f771b8c7f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:26.499445 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73b1be39-9eb5-4d85-aab9-b50f771b8c7f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:26.499883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73b1be39-9eb5-4d85-aab9-b50f771b8c7f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:26.559485 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-73b1be39-9eb5-4d85-aab9-b50f771b8c7f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:26.567396 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-73b1be39-9eb5-4d85-aab9-b50f771b8c7f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080526 Jul 21 22:04:26.567959 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 280/556] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:26 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:26.686960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a2b6defc-1e0e-4721-9685-128b352893d2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:26.687672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a2b6defc-1e0e-4721-9685-128b352893d2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:26.694850 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a2b6defc-1e0e-4721-9685-128b352893d2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:26.695351 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a2b6defc-1e0e-4721-9685-128b352893d2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:26.696131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a2b6defc-1e0e-4721-9685-128b352893d2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:26.696567 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a2b6defc-1e0e-4721-9685-128b352893d2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:26.825197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a2b6defc-1e0e-4721-9685-128b352893d2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:26.833495 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a2b6defc-1e0e-4721-9685-128b352893d2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:26.835101 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a2b6defc-1e0e-4721-9685-128b352893d2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:26.836431 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a2b6defc-1e0e-4721-9685-128b352893d2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.153899 Jul 21 22:04:26.837000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 277/557] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:26 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:27.584590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2f8506d9-e4ed-4adb-88b7-68017be7607a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:27.585202 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2f8506d9-e4ed-4adb-88b7-68017be7607a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:27.591928 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2f8506d9-e4ed-4adb-88b7-68017be7607a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:27.593000 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2f8506d9-e4ed-4adb-88b7-68017be7607a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:27.593763 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2f8506d9-e4ed-4adb-88b7-68017be7607a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:27.594200 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2f8506d9-e4ed-4adb-88b7-68017be7607a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:27.654418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2f8506d9-e4ed-4adb-88b7-68017be7607a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:27.663829 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2f8506d9-e4ed-4adb-88b7-68017be7607a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083093 Jul 21 22:04:27.664399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 281/558] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:27 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:27.855033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a273716a-9cea-4600-9218-67be5ff44b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:27.855581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a273716a-9cea-4600-9218-67be5ff44b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:27.862628 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a273716a-9cea-4600-9218-67be5ff44b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:27.863118 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a273716a-9cea-4600-9218-67be5ff44b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:27.863886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a273716a-9cea-4600-9218-67be5ff44b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:27.864330 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a273716a-9cea-4600-9218-67be5ff44b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:27.989727 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a273716a-9cea-4600-9218-67be5ff44b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:27.997967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a273716a-9cea-4600-9218-67be5ff44b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:27.999571 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a273716a-9cea-4600-9218-67be5ff44b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:28.000716 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a273716a-9cea-4600-9218-67be5ff44b73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.149659 Jul 21 22:04:28.001280 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 278/559] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:27 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:28.680545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-21ec85b7-c353-4362-b7b0-8ba269dbb9c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:28.681156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-21ec85b7-c353-4362-b7b0-8ba269dbb9c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:28.688208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-21ec85b7-c353-4362-b7b0-8ba269dbb9c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:28.688662 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-21ec85b7-c353-4362-b7b0-8ba269dbb9c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:28.689432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-21ec85b7-c353-4362-b7b0-8ba269dbb9c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:28.689867 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-21ec85b7-c353-4362-b7b0-8ba269dbb9c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:28.752756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-21ec85b7-c353-4362-b7b0-8ba269dbb9c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:28.760175 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-21ec85b7-c353-4362-b7b0-8ba269dbb9c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083612 Jul 21 22:04:28.760741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 282/560] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:28 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:29.019022 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ddf47227-ed3f-4099-9465-2ed11a79bdad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:29.019565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ddf47227-ed3f-4099-9465-2ed11a79bdad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:29.026127 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ddf47227-ed3f-4099-9465-2ed11a79bdad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:29.026574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ddf47227-ed3f-4099-9465-2ed11a79bdad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:29.027369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ddf47227-ed3f-4099-9465-2ed11a79bdad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:29.027803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ddf47227-ed3f-4099-9465-2ed11a79bdad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:29.155730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ddf47227-ed3f-4099-9465-2ed11a79bdad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:29.163918 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ddf47227-ed3f-4099-9465-2ed11a79bdad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:29.165417 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ddf47227-ed3f-4099-9465-2ed11a79bdad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:29.166551 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ddf47227-ed3f-4099-9465-2ed11a79bdad tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.151480 Jul 21 22:04:29.167137 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 279/561] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:29 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:29.777628 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-208002a4-a19d-448b-b95d-bba57ed6330c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:29.778159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-208002a4-a19d-448b-b95d-bba57ed6330c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:29.784692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-208002a4-a19d-448b-b95d-bba57ed6330c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:29.785142 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-208002a4-a19d-448b-b95d-bba57ed6330c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:29.785909 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-208002a4-a19d-448b-b95d-bba57ed6330c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:29.786346 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-208002a4-a19d-448b-b95d-bba57ed6330c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:29.846673 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-208002a4-a19d-448b-b95d-bba57ed6330c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:29.853947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-208002a4-a19d-448b-b95d-bba57ed6330c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080265 Jul 21 22:04:29.854505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 283/562] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:29 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:30.185082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cd38199b-924b-4368-b1f6-af8a7347925b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:30.185717 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cd38199b-924b-4368-b1f6-af8a7347925b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:30.192145 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd38199b-924b-4368-b1f6-af8a7347925b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:30.192592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd38199b-924b-4368-b1f6-af8a7347925b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:30.193346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd38199b-924b-4368-b1f6-af8a7347925b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:30.193779 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd38199b-924b-4368-b1f6-af8a7347925b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:30.322919 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cd38199b-924b-4368-b1f6-af8a7347925b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:30.334200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cd38199b-924b-4368-b1f6-af8a7347925b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:30.335774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cd38199b-924b-4368-b1f6-af8a7347925b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:30.336942 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cd38199b-924b-4368-b1f6-af8a7347925b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.155729 Jul 21 22:04:30.337774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 280/563] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:30 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:30.871405 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ccf76f19-5b46-4f74-a455-d92f83b93651 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:30.872007 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ccf76f19-5b46-4f74-a455-d92f83b93651 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:30.879069 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccf76f19-5b46-4f74-a455-d92f83b93651 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:30.879524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccf76f19-5b46-4f74-a455-d92f83b93651 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:30.880291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccf76f19-5b46-4f74-a455-d92f83b93651 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:30.880732 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccf76f19-5b46-4f74-a455-d92f83b93651 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:30.940734 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ccf76f19-5b46-4f74-a455-d92f83b93651 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:30.948060 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ccf76f19-5b46-4f74-a455-d92f83b93651 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080569 Jul 21 22:04:30.948632 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 284/564] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:30 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:31.356855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4321ea7f-dadf-4c0b-973c-735b3df56e63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:31.357469 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4321ea7f-dadf-4c0b-973c-735b3df56e63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:31.364688 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4321ea7f-dadf-4c0b-973c-735b3df56e63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:31.365148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4321ea7f-dadf-4c0b-973c-735b3df56e63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:31.365925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4321ea7f-dadf-4c0b-973c-735b3df56e63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:31.366364 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4321ea7f-dadf-4c0b-973c-735b3df56e63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:31.492949 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4321ea7f-dadf-4c0b-973c-735b3df56e63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:31.501911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4321ea7f-dadf-4c0b-973c-735b3df56e63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:31.503445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4321ea7f-dadf-4c0b-973c-735b3df56e63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:31.504587 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4321ea7f-dadf-4c0b-973c-735b3df56e63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.151612 Jul 21 22:04:31.505143 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 281/565] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:31 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:31.965810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6fc3325e-3902-4bef-bb62-261b48f7e970 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:31.966342 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6fc3325e-3902-4bef-bb62-261b48f7e970 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:31.969366 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:04:31.975846 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6fc3325e-3902-4bef-bb62-261b48f7e970 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:31.976306 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6fc3325e-3902-4bef-bb62-261b48f7e970 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:31.977069 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6fc3325e-3902-4bef-bb62-261b48f7e970 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:31.977532 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6fc3325e-3902-4bef-bb62-261b48f7e970 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:32.042538 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6fc3325e-3902-4bef-bb62-261b48f7e970 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:32.049944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6fc3325e-3902-4bef-bb62-261b48f7e970 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.088480 Jul 21 22:04:32.050497 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 285/566] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:31 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:32.522818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8f582d35-b53b-42a5-9b80-3cdf62506bc1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:32.523448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8f582d35-b53b-42a5-9b80-3cdf62506bc1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:32.529906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f582d35-b53b-42a5-9b80-3cdf62506bc1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:32.530352 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f582d35-b53b-42a5-9b80-3cdf62506bc1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:32.531184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f582d35-b53b-42a5-9b80-3cdf62506bc1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:32.531618 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f582d35-b53b-42a5-9b80-3cdf62506bc1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:32.545933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:04:32.671859 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8f582d35-b53b-42a5-9b80-3cdf62506bc1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:32.683334 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8f582d35-b53b-42a5-9b80-3cdf62506bc1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:32.684854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8f582d35-b53b-42a5-9b80-3cdf62506bc1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:32.687849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8f582d35-b53b-42a5-9b80-3cdf62506bc1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.168262 Jul 21 22:04:32.688419 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 282/567] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:32 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:33.065665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5b51a98d-b374-4205-88cb-728e277afd80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:33.066255 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5b51a98d-b374-4205-88cb-728e277afd80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:33.072720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b51a98d-b374-4205-88cb-728e277afd80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:33.073164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b51a98d-b374-4205-88cb-728e277afd80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:33.073921 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b51a98d-b374-4205-88cb-728e277afd80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:33.074351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b51a98d-b374-4205-88cb-728e277afd80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:33.138757 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5b51a98d-b374-4205-88cb-728e277afd80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:33.146130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5b51a98d-b374-4205-88cb-728e277afd80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.084373 Jul 21 22:04:33.146691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 286/568] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:33 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:33.707681 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-abae0ed6-a8a6-400b-b1d6-105ff9301312 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:33.708290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-abae0ed6-a8a6-400b-b1d6-105ff9301312 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:33.715305 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-abae0ed6-a8a6-400b-b1d6-105ff9301312 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:33.715760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-abae0ed6-a8a6-400b-b1d6-105ff9301312 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:33.716528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-abae0ed6-a8a6-400b-b1d6-105ff9301312 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:33.716964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-abae0ed6-a8a6-400b-b1d6-105ff9301312 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:33.846067 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-abae0ed6-a8a6-400b-b1d6-105ff9301312 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:33.854427 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-abae0ed6-a8a6-400b-b1d6-105ff9301312 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:33.855952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-abae0ed6-a8a6-400b-b1d6-105ff9301312 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:33.857086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-abae0ed6-a8a6-400b-b1d6-105ff9301312 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.153298 Jul 21 22:04:33.857645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 283/569] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:33 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:34.163234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-af897352-642b-4218-a364-5bc0bd6394c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:34.163840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-af897352-642b-4218-a364-5bc0bd6394c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:34.170243 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af897352-642b-4218-a364-5bc0bd6394c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:34.170687 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af897352-642b-4218-a364-5bc0bd6394c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:34.171970 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af897352-642b-4218-a364-5bc0bd6394c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:34.172399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af897352-642b-4218-a364-5bc0bd6394c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:34.174894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:04:34.235683 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-af897352-642b-4218-a364-5bc0bd6394c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:34.242958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-af897352-642b-4218-a364-5bc0bd6394c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083583 Jul 21 22:04:34.243534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 287/570] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:34 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:34.875230 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-48395baa-2f86-40b3-9720-d7267105147c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:34.876367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-48395baa-2f86-40b3-9720-d7267105147c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:34.882824 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48395baa-2f86-40b3-9720-d7267105147c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:34.883309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48395baa-2f86-40b3-9720-d7267105147c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:34.884072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48395baa-2f86-40b3-9720-d7267105147c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:34.884507 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48395baa-2f86-40b3-9720-d7267105147c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:35.010776 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-48395baa-2f86-40b3-9720-d7267105147c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:35.019903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-48395baa-2f86-40b3-9720-d7267105147c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:35.021417 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-48395baa-2f86-40b3-9720-d7267105147c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:35.022564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-48395baa-2f86-40b3-9720-d7267105147c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.151325 Jul 21 22:04:35.023145 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 284/571] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:34 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:35.260030 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-43754233-45da-4bc9-9c12-057856b23118 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:35.260645 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-43754233-45da-4bc9-9c12-057856b23118 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:35.267168 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-43754233-45da-4bc9-9c12-057856b23118 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:35.267622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-43754233-45da-4bc9-9c12-057856b23118 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:35.268424 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-43754233-45da-4bc9-9c12-057856b23118 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:35.268864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-43754233-45da-4bc9-9c12-057856b23118 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:35.332125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-43754233-45da-4bc9-9c12-057856b23118 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:35.339812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-43754233-45da-4bc9-9c12-057856b23118 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083619 Jul 21 22:04:35.340373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 288/572] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:35 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:36.040601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-919b722e-7662-44da-8eaa-ec016d1faa14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:36.041128 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-919b722e-7662-44da-8eaa-ec016d1faa14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:36.047888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-919b722e-7662-44da-8eaa-ec016d1faa14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:36.048338 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-919b722e-7662-44da-8eaa-ec016d1faa14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:36.049112 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-919b722e-7662-44da-8eaa-ec016d1faa14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:36.049545 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-919b722e-7662-44da-8eaa-ec016d1faa14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:36.179587 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-919b722e-7662-44da-8eaa-ec016d1faa14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:36.188340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-919b722e-7662-44da-8eaa-ec016d1faa14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:36.189841 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-919b722e-7662-44da-8eaa-ec016d1faa14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:36.190987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-919b722e-7662-44da-8eaa-ec016d1faa14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.154363 Jul 21 22:04:36.191639 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 285/573] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:36 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:36.356679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c985ca68-7019-4228-abe3-f21da774578e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:36.357212 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c985ca68-7019-4228-abe3-f21da774578e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:36.364141 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c985ca68-7019-4228-abe3-f21da774578e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:36.364593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c985ca68-7019-4228-abe3-f21da774578e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:36.365349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c985ca68-7019-4228-abe3-f21da774578e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:36.365783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c985ca68-7019-4228-abe3-f21da774578e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:36.425584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c985ca68-7019-4228-abe3-f21da774578e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:36.432875 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c985ca68-7019-4228-abe3-f21da774578e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080054 Jul 21 22:04:36.433428 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 289/574] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:36 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:37.209840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-19b1cadb-cee3-47a8-9449-1fcf8a5d1b62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:37.210500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-19b1cadb-cee3-47a8-9449-1fcf8a5d1b62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:37.216869 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19b1cadb-cee3-47a8-9449-1fcf8a5d1b62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:37.217320 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19b1cadb-cee3-47a8-9449-1fcf8a5d1b62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:37.218086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19b1cadb-cee3-47a8-9449-1fcf8a5d1b62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:37.218520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19b1cadb-cee3-47a8-9449-1fcf8a5d1b62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:37.349083 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-19b1cadb-cee3-47a8-9449-1fcf8a5d1b62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:37.357334 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-19b1cadb-cee3-47a8-9449-1fcf8a5d1b62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:37.358821 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-19b1cadb-cee3-47a8-9449-1fcf8a5d1b62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:37.360029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-19b1cadb-cee3-47a8-9449-1fcf8a5d1b62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.154263 Jul 21 22:04:37.360581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 286/575] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:37 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:37.451062 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-043787b5-e919-48a2-bc0b-bdba5b323d0b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:37.451673 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-043787b5-e919-48a2-bc0b-bdba5b323d0b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:37.458641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-043787b5-e919-48a2-bc0b-bdba5b323d0b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:37.459124 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-043787b5-e919-48a2-bc0b-bdba5b323d0b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:37.459936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-043787b5-e919-48a2-bc0b-bdba5b323d0b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:37.460317 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-043787b5-e919-48a2-bc0b-bdba5b323d0b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:37.521277 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-043787b5-e919-48a2-bc0b-bdba5b323d0b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:37.528607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-043787b5-e919-48a2-bc0b-bdba5b323d0b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081394 Jul 21 22:04:37.529173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 290/576] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:37 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:38.378019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1fea4791-d743-4ac6-a33c-acec0b677093 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:38.378560 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1fea4791-d743-4ac6-a33c-acec0b677093 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:38.385041 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fea4791-d743-4ac6-a33c-acec0b677093 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:38.385521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fea4791-d743-4ac6-a33c-acec0b677093 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:38.386274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fea4791-d743-4ac6-a33c-acec0b677093 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:38.386708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fea4791-d743-4ac6-a33c-acec0b677093 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:38.516282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1fea4791-d743-4ac6-a33c-acec0b677093 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:38.524632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1fea4791-d743-4ac6-a33c-acec0b677093 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:38.526135 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1fea4791-d743-4ac6-a33c-acec0b677093 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:38.527373 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1fea4791-d743-4ac6-a33c-acec0b677093 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.153378 Jul 21 22:04:38.527936 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 287/577] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:38 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:38.543979 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-04eb627f-fac2-4689-bd31-cf1c8c1f3216 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:38.544593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-04eb627f-fac2-4689-bd31-cf1c8c1f3216 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:38.551768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04eb627f-fac2-4689-bd31-cf1c8c1f3216 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:38.552220 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04eb627f-fac2-4689-bd31-cf1c8c1f3216 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:38.552987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04eb627f-fac2-4689-bd31-cf1c8c1f3216 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:38.553426 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04eb627f-fac2-4689-bd31-cf1c8c1f3216 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:38.618596 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-04eb627f-fac2-4689-bd31-cf1c8c1f3216 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:38.626034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-04eb627f-fac2-4689-bd31-cf1c8c1f3216 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.085913 Jul 21 22:04:38.626598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 291/578] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:38 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:39.545980 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3a38a826-39af-453f-9c5f-ae244f280321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:39.546587 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3a38a826-39af-453f-9c5f-ae244f280321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:39.553590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a38a826-39af-453f-9c5f-ae244f280321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:39.554046 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a38a826-39af-453f-9c5f-ae244f280321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:39.554816 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a38a826-39af-453f-9c5f-ae244f280321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:39.555280 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a38a826-39af-453f-9c5f-ae244f280321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:39.641395 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-11c56510-d96f-43d8-a1fa-ae772d04a9ed tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:39.642001 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-11c56510-d96f-43d8-a1fa-ae772d04a9ed tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:39.648441 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-11c56510-d96f-43d8-a1fa-ae772d04a9ed tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:39.648894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-11c56510-d96f-43d8-a1fa-ae772d04a9ed tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:39.649669 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-11c56510-d96f-43d8-a1fa-ae772d04a9ed tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:39.650105 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-11c56510-d96f-43d8-a1fa-ae772d04a9ed tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:39.681765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3a38a826-39af-453f-9c5f-ae244f280321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:39.690847 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3a38a826-39af-453f-9c5f-ae244f280321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:39.692406 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3a38a826-39af-453f-9c5f-ae244f280321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:39.693579 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3a38a826-39af-453f-9c5f-ae244f280321 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.151491 Jul 21 22:04:39.694143 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 288/579] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:39 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:39.710492 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-11c56510-d96f-43d8-a1fa-ae772d04a9ed tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:39.718543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-11c56510-d96f-43d8-a1fa-ae772d04a9ed tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080926 Jul 21 22:04:39.719749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 292/580] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:39 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:40.711810 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-67063034-278b-4075-aaa8-2ed7ad4b0419 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:40.712667 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-67063034-278b-4075-aaa8-2ed7ad4b0419 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:40.719084 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67063034-278b-4075-aaa8-2ed7ad4b0419 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:40.719529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67063034-278b-4075-aaa8-2ed7ad4b0419 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:40.720294 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67063034-278b-4075-aaa8-2ed7ad4b0419 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:40.720732 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67063034-278b-4075-aaa8-2ed7ad4b0419 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:40.735489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6084425a-cbed-4632-b5c6-2eaffeebf34e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:40.736014 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6084425a-cbed-4632-b5c6-2eaffeebf34e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:40.742396 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6084425a-cbed-4632-b5c6-2eaffeebf34e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:40.742849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6084425a-cbed-4632-b5c6-2eaffeebf34e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:40.743653 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6084425a-cbed-4632-b5c6-2eaffeebf34e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:40.744088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6084425a-cbed-4632-b5c6-2eaffeebf34e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:41.037800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6084425a-cbed-4632-b5c6-2eaffeebf34e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:41.045264 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6084425a-cbed-4632-b5c6-2eaffeebf34e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.313836 Jul 21 22:04:41.045817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 293/581] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:40 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:41.094765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-67063034-278b-4075-aaa8-2ed7ad4b0419 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:41.103145 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-67063034-278b-4075-aaa8-2ed7ad4b0419 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:41.104647 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-67063034-278b-4075-aaa8-2ed7ad4b0419 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:41.105790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-67063034-278b-4075-aaa8-2ed7ad4b0419 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.397975 Jul 21 22:04:41.106351 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 289/582] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:40 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:42.061674 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-abee5589-dfa4-4bff-b500-6e12808e2d96 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:42.062283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-abee5589-dfa4-4bff-b500-6e12808e2d96 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:42.069415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-abee5589-dfa4-4bff-b500-6e12808e2d96 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:42.069868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-abee5589-dfa4-4bff-b500-6e12808e2d96 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:42.070632 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-abee5589-dfa4-4bff-b500-6e12808e2d96 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:42.071101 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-abee5589-dfa4-4bff-b500-6e12808e2d96 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:42.123597 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5263e74e-2a58-41a4-853f-a400ea24b734 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:42.124209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5263e74e-2a58-41a4-853f-a400ea24b734 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:42.131460 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5263e74e-2a58-41a4-853f-a400ea24b734 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:42.131604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-abee5589-dfa4-4bff-b500-6e12808e2d96 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:42.131916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5263e74e-2a58-41a4-853f-a400ea24b734 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:42.132689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5263e74e-2a58-41a4-853f-a400ea24b734 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:42.133130 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5263e74e-2a58-41a4-853f-a400ea24b734 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:42.138876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-abee5589-dfa4-4bff-b500-6e12808e2d96 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081007 Jul 21 22:04:42.139461 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 294/583] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:42 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:42.261099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5263e74e-2a58-41a4-853f-a400ea24b734 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:42.277759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5263e74e-2a58-41a4-853f-a400ea24b734 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:42.281002 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5263e74e-2a58-41a4-853f-a400ea24b734 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:42.282511 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5263e74e-2a58-41a4-853f-a400ea24b734 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.162608 Jul 21 22:04:42.283032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 290/584] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:42 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:43.156074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2a6a7d26-13da-4e94-8422-0195ffc843ce tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:43.156676 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2a6a7d26-13da-4e94-8422-0195ffc843ce tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:43.163978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a6a7d26-13da-4e94-8422-0195ffc843ce tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:43.164433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a6a7d26-13da-4e94-8422-0195ffc843ce tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:43.165209 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a6a7d26-13da-4e94-8422-0195ffc843ce tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:43.165647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a6a7d26-13da-4e94-8422-0195ffc843ce tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:43.226968 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2a6a7d26-13da-4e94-8422-0195ffc843ce tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:43.234520 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2a6a7d26-13da-4e94-8422-0195ffc843ce tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082299 Jul 21 22:04:43.235102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 295/585] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:43 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:43.300759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d051f3c4-03a9-4064-9839-2c1174804d19 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:43.301372 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d051f3c4-03a9-4064-9839-2c1174804d19 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:43.307833 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d051f3c4-03a9-4064-9839-2c1174804d19 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:43.308288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d051f3c4-03a9-4064-9839-2c1174804d19 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:43.309059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d051f3c4-03a9-4064-9839-2c1174804d19 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:43.309504 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d051f3c4-03a9-4064-9839-2c1174804d19 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:43.435048 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d051f3c4-03a9-4064-9839-2c1174804d19 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:43.443901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d051f3c4-03a9-4064-9839-2c1174804d19 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:43.445448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d051f3c4-03a9-4064-9839-2c1174804d19 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:43.446599 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d051f3c4-03a9-4064-9839-2c1174804d19 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.149925 Jul 21 22:04:43.447182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 291/586] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:43 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:04:43.839971 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-55c5df51-ad61-4db2-8671-1ac396101fff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:43.840466 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-55c5df51-ad61-4db2-8671-1ac396101fff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:43.846312 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55c5df51-ad61-4db2-8671-1ac396101fff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:43.846758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55c5df51-ad61-4db2-8671-1ac396101fff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:43.847559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55c5df51-ad61-4db2-8671-1ac396101fff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:43.847995 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-55c5df51-ad61-4db2-8671-1ac396101fff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:44.251107 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d11e29a9-37a0-409f-aeb2-9a3858762b54 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:44.251643 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d11e29a9-37a0-409f-aeb2-9a3858762b54 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:44.257577 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d11e29a9-37a0-409f-aeb2-9a3858762b54 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:44.258020 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d11e29a9-37a0-409f-aeb2-9a3858762b54 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:44.258777 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d11e29a9-37a0-409f-aeb2-9a3858762b54 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:44.259324 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d11e29a9-37a0-409f-aeb2-9a3858762b54 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:44.320509 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d11e29a9-37a0-409f-aeb2-9a3858762b54 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:44.327950 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d11e29a9-37a0-409f-aeb2-9a3858762b54 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080839 Jul 21 22:04:44.328516 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 292/587] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:44 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:44.465645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fb1e726b-56c5-4d4d-b0d2-97b0b30bf430 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:44.466250 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fb1e726b-56c5-4d4d-b0d2-97b0b30bf430 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:44.472775 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb1e726b-56c5-4d4d-b0d2-97b0b30bf430 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:44.473231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb1e726b-56c5-4d4d-b0d2-97b0b30bf430 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:44.474002 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb1e726b-56c5-4d4d-b0d2-97b0b30bf430 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:44.474441 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb1e726b-56c5-4d4d-b0d2-97b0b30bf430 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:44.603801 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fb1e726b-56c5-4d4d-b0d2-97b0b30bf430 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:44.612188 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fb1e726b-56c5-4d4d-b0d2-97b0b30bf430 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:44.613707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fb1e726b-56c5-4d4d-b0d2-97b0b30bf430 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:44.614864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fb1e726b-56c5-4d4d-b0d2-97b0b30bf430 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.153306 Jul 21 22:04:44.615468 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 293/588] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:44 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:45.344993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a118617a-1f4b-4069-a183-f72d133d54df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:45.345608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a118617a-1f4b-4069-a183-f72d133d54df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:45.352031 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a118617a-1f4b-4069-a183-f72d133d54df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:45.352491 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a118617a-1f4b-4069-a183-f72d133d54df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:45.353271 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a118617a-1f4b-4069-a183-f72d133d54df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:45.353712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a118617a-1f4b-4069-a183-f72d133d54df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:45.415223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a118617a-1f4b-4069-a183-f72d133d54df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:45.425438 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a118617a-1f4b-4069-a183-f72d133d54df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.084435 Jul 21 22:04:45.426032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 294/589] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:45 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:45.633157 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f23d733b-4312-497b-b578-d818bf8bfd7c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:45.633765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f23d733b-4312-497b-b578-d818bf8bfd7c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:45.639720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f23d733b-4312-497b-b578-d818bf8bfd7c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:45.640165 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f23d733b-4312-497b-b578-d818bf8bfd7c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:45.640930 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f23d733b-4312-497b-b578-d818bf8bfd7c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:45.641412 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f23d733b-4312-497b-b578-d818bf8bfd7c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:45.772871 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f23d733b-4312-497b-b578-d818bf8bfd7c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:45.781456 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f23d733b-4312-497b-b578-d818bf8bfd7c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:45.783598 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f23d733b-4312-497b-b578-d818bf8bfd7c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:45.784782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f23d733b-4312-497b-b578-d818bf8bfd7c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.155512 Jul 21 22:04:45.785361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 295/590] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:45 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:46.442550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-672d2bc1-09be-4d1e-b50e-063018b9d762 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:46.443224 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-672d2bc1-09be-4d1e-b50e-063018b9d762 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:46.449625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-672d2bc1-09be-4d1e-b50e-063018b9d762 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:46.450076 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-672d2bc1-09be-4d1e-b50e-063018b9d762 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:46.450842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-672d2bc1-09be-4d1e-b50e-063018b9d762 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:46.451311 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-672d2bc1-09be-4d1e-b50e-063018b9d762 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:46.512586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-672d2bc1-09be-4d1e-b50e-063018b9d762 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:46.520758 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-672d2bc1-09be-4d1e-b50e-063018b9d762 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082532 Jul 21 22:04:46.521326 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 296/591] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:46 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:46.803764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-441e9f94-abad-4cad-9755-53bf04ca061f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:46.804291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-441e9f94-abad-4cad-9755-53bf04ca061f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:46.810314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-441e9f94-abad-4cad-9755-53bf04ca061f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:46.810759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-441e9f94-abad-4cad-9755-53bf04ca061f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:46.811558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-441e9f94-abad-4cad-9755-53bf04ca061f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:46.813492 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-441e9f94-abad-4cad-9755-53bf04ca061f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:46.940150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-441e9f94-abad-4cad-9755-53bf04ca061f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:46.948490 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-441e9f94-abad-4cad-9755-53bf04ca061f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:46.950005 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-441e9f94-abad-4cad-9755-53bf04ca061f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:46.951247 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-441e9f94-abad-4cad-9755-53bf04ca061f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.151386 Jul 21 22:04:46.951813 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 297/592] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:46 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:47.538644 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3a403414-a46d-485e-a539-59c739821cc8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:47.539369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3a403414-a46d-485e-a539-59c739821cc8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:47.546034 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a403414-a46d-485e-a539-59c739821cc8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:47.546490 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a403414-a46d-485e-a539-59c739821cc8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:47.547286 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a403414-a46d-485e-a539-59c739821cc8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:47.547763 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a403414-a46d-485e-a539-59c739821cc8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:47.611184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3a403414-a46d-485e-a539-59c739821cc8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:47.618671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3a403414-a46d-485e-a539-59c739821cc8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083922 Jul 21 22:04:47.619282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 298/593] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:47 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:47.970047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1ec9bb16-e963-4151-9e4f-a4841de32f96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:47.970582 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1ec9bb16-e963-4151-9e4f-a4841de32f96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:47.976501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ec9bb16-e963-4151-9e4f-a4841de32f96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:47.976948 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ec9bb16-e963-4151-9e4f-a4841de32f96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:47.977705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ec9bb16-e963-4151-9e4f-a4841de32f96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:47.978138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ec9bb16-e963-4151-9e4f-a4841de32f96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:47.981981 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:04:48.105795 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1ec9bb16-e963-4151-9e4f-a4841de32f96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:48.114262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1ec9bb16-e963-4151-9e4f-a4841de32f96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:48.115825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1ec9bb16-e963-4151-9e4f-a4841de32f96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:48.117003 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1ec9bb16-e963-4151-9e4f-a4841de32f96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.150941 Jul 21 22:04:48.117575 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 299/594] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:47 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:48.634520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-136ed775-6c2c-43e0-b35b-fdddf6cf72d7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:48.635179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-136ed775-6c2c-43e0-b35b-fdddf6cf72d7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:48.641472 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-136ed775-6c2c-43e0-b35b-fdddf6cf72d7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:48.641918 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-136ed775-6c2c-43e0-b35b-fdddf6cf72d7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:48.642675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-136ed775-6c2c-43e0-b35b-fdddf6cf72d7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:48.643138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-136ed775-6c2c-43e0-b35b-fdddf6cf72d7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:48.703498 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-136ed775-6c2c-43e0-b35b-fdddf6cf72d7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:48.710945 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-136ed775-6c2c-43e0-b35b-fdddf6cf72d7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080363 Jul 21 22:04:48.711541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 300/595] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:48 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:49.136522 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-46ce72f8-d6d4-450f-ae80-c6179e7bb2f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:49.137159 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-46ce72f8-d6d4-450f-ae80-c6179e7bb2f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:49.143717 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-46ce72f8-d6d4-450f-ae80-c6179e7bb2f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:49.144169 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-46ce72f8-d6d4-450f-ae80-c6179e7bb2f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:49.144935 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-46ce72f8-d6d4-450f-ae80-c6179e7bb2f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:49.145535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-46ce72f8-d6d4-450f-ae80-c6179e7bb2f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:49.282988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-46ce72f8-d6d4-450f-ae80-c6179e7bb2f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:49.291879 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-46ce72f8-d6d4-450f-ae80-c6179e7bb2f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:49.293396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-46ce72f8-d6d4-450f-ae80-c6179e7bb2f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:49.294546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-46ce72f8-d6d4-450f-ae80-c6179e7bb2f6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.161921 Jul 21 22:04:49.295138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 301/596] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:49 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:49.729528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-362d98ab-860b-46bc-aa32-f877f9192cae tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:49.730140 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-362d98ab-860b-46bc-aa32-f877f9192cae tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:49.732479 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=64 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:04:49.741329 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-362d98ab-860b-46bc-aa32-f877f9192cae tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:49.741701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-362d98ab-860b-46bc-aa32-f877f9192cae tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:49.742487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-362d98ab-860b-46bc-aa32-f877f9192cae tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:49.742932 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-362d98ab-860b-46bc-aa32-f877f9192cae tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:49.806964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-362d98ab-860b-46bc-aa32-f877f9192cae tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:49.814440 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-362d98ab-860b-46bc-aa32-f877f9192cae tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.088782 Jul 21 22:04:49.815018 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 302/597] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:49 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:50.312597 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3274e89b-ee1c-4e0f-9cb4-204eb87ec71a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:50.313208 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3274e89b-ee1c-4e0f-9cb4-204eb87ec71a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:50.319220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3274e89b-ee1c-4e0f-9cb4-204eb87ec71a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:50.319689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3274e89b-ee1c-4e0f-9cb4-204eb87ec71a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:50.320435 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3274e89b-ee1c-4e0f-9cb4-204eb87ec71a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:50.320871 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3274e89b-ee1c-4e0f-9cb4-204eb87ec71a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:50.445616 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3274e89b-ee1c-4e0f-9cb4-204eb87ec71a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:50.453873 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3274e89b-ee1c-4e0f-9cb4-204eb87ec71a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:50.455426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3274e89b-ee1c-4e0f-9cb4-204eb87ec71a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:50.456584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3274e89b-ee1c-4e0f-9cb4-204eb87ec71a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.147928 Jul 21 22:04:50.457283 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 303/598] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:50 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:50.830830 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-870f534b-7eb2-40d3-8b34-3b3355ae0ce4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:50.832047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-870f534b-7eb2-40d3-8b34-3b3355ae0ce4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:50.838775 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-870f534b-7eb2-40d3-8b34-3b3355ae0ce4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:50.839263 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-870f534b-7eb2-40d3-8b34-3b3355ae0ce4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:50.840022 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-870f534b-7eb2-40d3-8b34-3b3355ae0ce4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:50.840455 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-870f534b-7eb2-40d3-8b34-3b3355ae0ce4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:50.901146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-870f534b-7eb2-40d3-8b34-3b3355ae0ce4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:50.908547 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-870f534b-7eb2-40d3-8b34-3b3355ae0ce4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081553 Jul 21 22:04:50.909111 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 304/599] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:50 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:51.475266 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2a32134c-6624-4389-bedf-67cb4dc1013c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:51.475870 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2a32134c-6624-4389-bedf-67cb4dc1013c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:51.481945 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2a32134c-6624-4389-bedf-67cb4dc1013c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:51.482391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2a32134c-6624-4389-bedf-67cb4dc1013c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:51.483560 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2a32134c-6624-4389-bedf-67cb4dc1013c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:51.483662 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2a32134c-6624-4389-bedf-67cb4dc1013c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:51.615698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2a32134c-6624-4389-bedf-67cb4dc1013c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:51.623974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2a32134c-6624-4389-bedf-67cb4dc1013c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:51.625577 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2a32134c-6624-4389-bedf-67cb4dc1013c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:51.626714 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2a32134c-6624-4389-bedf-67cb4dc1013c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.155382 Jul 21 22:04:51.627315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 305/600] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:51 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:51.925874 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e96b1e2e-6a2d-42b5-80a0-b3c8a3862da5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:51.926586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e96b1e2e-6a2d-42b5-80a0-b3c8a3862da5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:51.933053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e96b1e2e-6a2d-42b5-80a0-b3c8a3862da5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:51.933497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e96b1e2e-6a2d-42b5-80a0-b3c8a3862da5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:51.934267 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e96b1e2e-6a2d-42b5-80a0-b3c8a3862da5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:51.934701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e96b1e2e-6a2d-42b5-80a0-b3c8a3862da5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:51.995975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e96b1e2e-6a2d-42b5-80a0-b3c8a3862da5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:52.003393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e96b1e2e-6a2d-42b5-80a0-b3c8a3862da5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082078 Jul 21 22:04:52.003969 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 306/601] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:51 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:52.645808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-722bb364-3105-4482-9f00-17e5f6c13838 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:52.646403 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-722bb364-3105-4482-9f00-17e5f6c13838 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:52.652463 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-722bb364-3105-4482-9f00-17e5f6c13838 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:52.652916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-722bb364-3105-4482-9f00-17e5f6c13838 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:52.653671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-722bb364-3105-4482-9f00-17e5f6c13838 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:52.654103 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-722bb364-3105-4482-9f00-17e5f6c13838 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:52.782778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-722bb364-3105-4482-9f00-17e5f6c13838 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:52.791032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-722bb364-3105-4482-9f00-17e5f6c13838 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:52.792525 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-722bb364-3105-4482-9f00-17e5f6c13838 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:52.793663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-722bb364-3105-4482-9f00-17e5f6c13838 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.152306 Jul 21 22:04:52.794214 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 307/602] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:52 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:53.019895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-18cc53f1-6a14-4497-95d2-78b2d932cc05 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:53.020566 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-18cc53f1-6a14-4497-95d2-78b2d932cc05 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:53.026924 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18cc53f1-6a14-4497-95d2-78b2d932cc05 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:53.027402 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18cc53f1-6a14-4497-95d2-78b2d932cc05 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:53.028160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18cc53f1-6a14-4497-95d2-78b2d932cc05 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:53.028595 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18cc53f1-6a14-4497-95d2-78b2d932cc05 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:53.088312 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-18cc53f1-6a14-4497-95d2-78b2d932cc05 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:53.095739 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-18cc53f1-6a14-4497-95d2-78b2d932cc05 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079770 Jul 21 22:04:53.096298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 308/603] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:53 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:53.812886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-87546896-11f1-45af-b543-032d5edd1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:53.813481 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-87546896-11f1-45af-b543-032d5edd1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:53.819554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-87546896-11f1-45af-b543-032d5edd1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:53.820002 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-87546896-11f1-45af-b543-032d5edd1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:53.820759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-87546896-11f1-45af-b543-032d5edd1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:53.821189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-87546896-11f1-45af-b543-032d5edd1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:53.843785 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=23 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:04:53.905449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=57 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:04:53.949223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-87546896-11f1-45af-b543-032d5edd1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:53.958294 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-87546896-11f1-45af-b543-032d5edd1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:53.959819 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-87546896-11f1-45af-b543-032d5edd1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:53.960969 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-87546896-11f1-45af-b543-032d5edd1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.151941 Jul 21 22:04:53.961520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 309/604] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:53 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:54.111772 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-41a157dc-0726-4d37-89a2-461be55c0839 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:54.112396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-41a157dc-0726-4d37-89a2-461be55c0839 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:54.118686 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41a157dc-0726-4d37-89a2-461be55c0839 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:54.119168 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41a157dc-0726-4d37-89a2-461be55c0839 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:54.119936 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41a157dc-0726-4d37-89a2-461be55c0839 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:54.120374 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41a157dc-0726-4d37-89a2-461be55c0839 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:54.180161 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-41a157dc-0726-4d37-89a2-461be55c0839 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:54.187504 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-41a157dc-0726-4d37-89a2-461be55c0839 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079413 Jul 21 22:04:54.188070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 310/605] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:54 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:54.978419 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8d55aa6b-42ad-4976-ba40-5b6cfcff6fc5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:54.979045 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8d55aa6b-42ad-4976-ba40-5b6cfcff6fc5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:54.985066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8d55aa6b-42ad-4976-ba40-5b6cfcff6fc5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:54.985510 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8d55aa6b-42ad-4976-ba40-5b6cfcff6fc5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:54.986264 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8d55aa6b-42ad-4976-ba40-5b6cfcff6fc5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:54.986696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8d55aa6b-42ad-4976-ba40-5b6cfcff6fc5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:55.117503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8d55aa6b-42ad-4976-ba40-5b6cfcff6fc5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:55.126348 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8d55aa6b-42ad-4976-ba40-5b6cfcff6fc5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:55.127888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8d55aa6b-42ad-4976-ba40-5b6cfcff6fc5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:55.129038 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8d55aa6b-42ad-4976-ba40-5b6cfcff6fc5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.154486 Jul 21 22:04:55.129594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 311/606] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:54 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:55.203861 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b4a28473-9a6f-438f-8ca0-26f416a3157b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:55.204461 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b4a28473-9a6f-438f-8ca0-26f416a3157b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:55.210779 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b4a28473-9a6f-438f-8ca0-26f416a3157b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:55.211260 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b4a28473-9a6f-438f-8ca0-26f416a3157b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:55.212298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b4a28473-9a6f-438f-8ca0-26f416a3157b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:55.212733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b4a28473-9a6f-438f-8ca0-26f416a3157b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:55.271793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b4a28473-9a6f-438f-8ca0-26f416a3157b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:55.280206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b4a28473-9a6f-438f-8ca0-26f416a3157b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079864 Jul 21 22:04:55.280767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 312/607] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:55 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:04:56.147470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1c5312b1-da62-4566-b4f1-d44bcf911be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:56.148568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1c5312b1-da62-4566-b4f1-d44bcf911be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:56.154958 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1c5312b1-da62-4566-b4f1-d44bcf911be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:56.155434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1c5312b1-da62-4566-b4f1-d44bcf911be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:56.156190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1c5312b1-da62-4566-b4f1-d44bcf911be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:56.156627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1c5312b1-da62-4566-b4f1-d44bcf911be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:56.301625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1c5312b1-da62-4566-b4f1-d44bcf911be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:56.309938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1c5312b1-da62-4566-b4f1-d44bcf911be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:56.311474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1c5312b1-da62-4566-b4f1-d44bcf911be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:56.312649 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1c5312b1-da62-4566-b4f1-d44bcf911be4 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.169033 Jul 21 22:04:56.313197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 313/608] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:56 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:56.317478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-22123734-d7cd-48d6-bb6f-2f18c80b772a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:56.318072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-22123734-d7cd-48d6-bb6f-2f18c80b772a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:56.323648 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22123734-d7cd-48d6-bb6f-2f18c80b772a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:56.324101 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22123734-d7cd-48d6-bb6f-2f18c80b772a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:56.324872 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22123734-d7cd-48d6-bb6f-2f18c80b772a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:56.325312 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22123734-d7cd-48d6-bb6f-2f18c80b772a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:56.384868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-22123734-d7cd-48d6-bb6f-2f18c80b772a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:56.392293 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-22123734-d7cd-48d6-bb6f-2f18c80b772a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078182 Jul 21 22:04:56.392863 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 314/609] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:56 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:57.330424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-537cde20-7f49-497d-b9b8-81e0eba957e3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:57.331160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-537cde20-7f49-497d-b9b8-81e0eba957e3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:57.337791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-537cde20-7f49-497d-b9b8-81e0eba957e3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:57.338243 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-537cde20-7f49-497d-b9b8-81e0eba957e3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:57.339039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-537cde20-7f49-497d-b9b8-81e0eba957e3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:57.339471 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-537cde20-7f49-497d-b9b8-81e0eba957e3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:57.465899 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-537cde20-7f49-497d-b9b8-81e0eba957e3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:57.467692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:04:57.475475 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-537cde20-7f49-497d-b9b8-81e0eba957e3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:57.477644 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-537cde20-7f49-497d-b9b8-81e0eba957e3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:57.478847 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-537cde20-7f49-497d-b9b8-81e0eba957e3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.152307 Jul 21 22:04:57.479461 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 315/610] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:57 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:57.483944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e9b9f5dd-b0dd-4bcf-a625-6c472184548b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:57.484554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e9b9f5dd-b0dd-4bcf-a625-6c472184548b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:57.490331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9b9f5dd-b0dd-4bcf-a625-6c472184548b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:57.490781 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9b9f5dd-b0dd-4bcf-a625-6c472184548b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:57.492244 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9b9f5dd-b0dd-4bcf-a625-6c472184548b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:57.492682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9b9f5dd-b0dd-4bcf-a625-6c472184548b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:57.551704 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9b9f5dd-b0dd-4bcf-a625-6c472184548b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:57.559709 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e9b9f5dd-b0dd-4bcf-a625-6c472184548b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079311 Jul 21 22:04:57.560286 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 316/611] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:57 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:58.496807 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5aa5705e-5d73-433a-8aca-d1ed94825d21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:58.497415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5aa5705e-5d73-433a-8aca-d1ed94825d21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:58.504039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aa5705e-5d73-433a-8aca-d1ed94825d21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:58.504531 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aa5705e-5d73-433a-8aca-d1ed94825d21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:58.505334 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aa5705e-5d73-433a-8aca-d1ed94825d21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:58.505772 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aa5705e-5d73-433a-8aca-d1ed94825d21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:58.653228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5aa5705e-5d73-433a-8aca-d1ed94825d21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:58.661559 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5aa5705e-5d73-433a-8aca-d1ed94825d21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:58.663566 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5aa5705e-5d73-433a-8aca-d1ed94825d21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:58.664709 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5aa5705e-5d73-433a-8aca-d1ed94825d21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.171769 Jul 21 22:04:58.665269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 317/612] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:04:58 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:04:58.669740 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d9d567ed-975e-467f-aa54-233e0cf0a01f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:58.670328 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d9d567ed-975e-467f-aa54-233e0cf0a01f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:58.676056 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9d567ed-975e-467f-aa54-233e0cf0a01f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:58.676487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9d567ed-975e-467f-aa54-233e0cf0a01f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:58.677241 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9d567ed-975e-467f-aa54-233e0cf0a01f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:58.677675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9d567ed-975e-467f-aa54-233e0cf0a01f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:58.737797 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d9d567ed-975e-467f-aa54-233e0cf0a01f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:04:58.745862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d9d567ed-975e-467f-aa54-233e0cf0a01f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079680 Jul 21 22:04:58.746443 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 318/613] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:04:58 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:04:58.798825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-56c164ee-0d1a-4fa0-bed5-ff752c4c89ec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:04:58.799354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-56c164ee-0d1a-4fa0-bed5-ff752c4c89ec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:58.805908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56c164ee-0d1a-4fa0-bed5-ff752c4c89ec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:58.806360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56c164ee-0d1a-4fa0-bed5-ff752c4c89ec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:58.807150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56c164ee-0d1a-4fa0-bed5-ff752c4c89ec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:58.807592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56c164ee-0d1a-4fa0-bed5-ff752c4c89ec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:58.829954 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-56c164ee-0d1a-4fa0-bed5-ff752c4c89ec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f/ips" status: 200 len: 149 microversion: 2.1 time: 0.082527 Jul 21 22:04:58.830500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 319/614] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 22:04:58 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f/ips => generated 149 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:04:58.840568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1d5e3e85-65dd-4157-9381-1540b980c834 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e833a0d1-aafb-4650-b1f4-e369f36f1edb"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:04:58.841710 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1d5e3e85-65dd-4157-9381-1540b980c834 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:04:58.847428 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d5e3e85-65dd-4157-9381-1540b980c834 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:58.847883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d5e3e85-65dd-4157-9381-1540b980c834 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:04:58.848642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d5e3e85-65dd-4157-9381-1540b980c834 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:04:58.849081 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d5e3e85-65dd-4157-9381-1540b980c834 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:08.845512 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=37 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:05:08.867601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=27 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:05:21.392119 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.objects.instance [None req-55c5df51-ad61-4db2-8671-1ac396101fff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lazy-loading 'services' on Instance uuid 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f {{(pid=117979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:05:21.433072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-1d5e3e85-65dd-4157-9381-1540b980c834 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] HTTP exception thrown: Invalid volume: volume e833a0d1-aafb-4650-b1f4-e369f36f1edb is already attached to instances: 7365f289-299d-4d2d-ba74-1ca18cf88e06 Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1d5e3e85-65dd-4157-9381-1540b980c834 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Request method failure captured: Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: POST /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f/os-volume_attachments HTTP/1.1 Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 74 Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwq5cO8Iqs9BNx6Mzryp9hZtqim1vH8HuegCxrBuP4XGTqM74Ohh4WW_J2xt7YkUUdtgarY1MbMXrA_UelMtrho4YuwAwHA1g3NEpX3Am91Bsh0TFHZTsHViUUwnnQ3b29fzazVBCaTklKontb6LNgtPxGazR2DvDr1xBxhj2kB17I Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:05:21.434944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:05:21.436558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47878d7ed9cb49adba1f84a2ffb2deda", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:05:21.436558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:05:21.436558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:05:21.436558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:05:21.436558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:05:21.436558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:05:21.436558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:05:21.436558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 73f068abea75404fb2829065a674aee4 Jul 21 22:05:21.436558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:05:21.436558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Jul 21 22:05:21.436558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {"volumeAttachment": {"volumeId": "e833a0d1-aafb-4650-b1f4-e369f36f1edb"}} Jul 21 22:05:21.436558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Invalid volume: volume e833a0d1-aafb-4650-b1f4-e369f36f1edb is already attached to instances: 7365f289-299d-4d2d-ba74-1ca18cf88e06 Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'server_id': 'c8cef302-505a-45dc-9113-668fb800106f', 'body': {'volumeAttachment': {'volumeId': 'e833a0d1-aafb-4650-b1f4-e369f36f1edb'}}} Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e833a0d1-aafb-4650-b1f4-e369f36f1edb is already attached to instances: 7365f289-299d-4d2d-ba74-1ca18cf88e06 Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:05:21.437526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e833a0d1-aafb-4650-b1f4-e369f36f1edb is already attached to instances: 7365f289-299d-4d2d-ba74-1ca18cf88e06 Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:05:21.439121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:05:21.440633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:05:21.440633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:05:21.440633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:05:21.440633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e833a0d1-aafb-4650-b1f4-e369f36f1edb is already attached to instances: 7365f289-299d-4d2d-ba74-1ca18cf88e06 Jul 21 22:05:21.440633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:05:21.440633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1d5e3e85-65dd-4157-9381-1540b980c834 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Returning 400 to user: Invalid volume: volume e833a0d1-aafb-4650-b1f4-e369f36f1edb is already attached to instances: 7365f289-299d-4d2d-ba74-1ca18cf88e06 {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:05:21.440633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1d5e3e85-65dd-4157-9381-1540b980c834 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "POST /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 22.601732 Jul 21 22:05:21.441380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 320/615] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 22:04:58 2022] POST /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f/os-volume_attachments => generated 174 bytes in 22604 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 22:05:21.446610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3c598778-a296-4ff6-bbdf-5447b221efca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:21.447440 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3c598778-a296-4ff6-bbdf-5447b221efca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:21.453906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c598778-a296-4ff6-bbdf-5447b221efca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:21.454372 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c598778-a296-4ff6-bbdf-5447b221efca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:21.455382 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c598778-a296-4ff6-bbdf-5447b221efca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:21.455626 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c598778-a296-4ff6-bbdf-5447b221efca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:21.587898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3c598778-a296-4ff6-bbdf-5447b221efca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:21.596173 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3c598778-a296-4ff6-bbdf-5447b221efca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:21.597683 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3c598778-a296-4ff6-bbdf-5447b221efca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:21.598829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3c598778-a296-4ff6-bbdf-5447b221efca tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.156537 Jul 21 22:05:21.599410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 321/616] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:21 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:05:21.700376 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-52109b1b-1964-479a-9d30-5669fb07778d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:21.700992 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-52109b1b-1964-479a-9d30-5669fb07778d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:21.706914 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52109b1b-1964-479a-9d30-5669fb07778d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:21.707395 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52109b1b-1964-479a-9d30-5669fb07778d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:21.708164 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52109b1b-1964-479a-9d30-5669fb07778d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:21.708609 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52109b1b-1964-479a-9d30-5669fb07778d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:21.769198 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-52109b1b-1964-479a-9d30-5669fb07778d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:21.777123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-52109b1b-1964-479a-9d30-5669fb07778d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.176709 Jul 21 22:05:21.777685 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 322/617] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:21 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:21.782112 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a6417506-3c67-4392-991b-804958a1d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:21.782602 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a6417506-3c67-4392-991b-804958a1d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:21.788948 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6417506-3c67-4392-991b-804958a1d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:21.789409 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6417506-3c67-4392-991b-804958a1d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:21.790188 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6417506-3c67-4392-991b-804958a1d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:21.790637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6417506-3c67-4392-991b-804958a1d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:21.815660 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a6417506-3c67-4392-991b-804958a1d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:05:21.888714 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a6417506-3c67-4392-991b-804958a1d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 204 len: 0 microversion: 2.1 time: 0.109826 Jul 21 22:05:21.889397 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 323/618] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:05:21 2022] DELETE /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:05:21.897678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-17400db3-ab5f-4763-80dd-9afb56b2b2e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:21.898372 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-17400db3-ab5f-4763-80dd-9afb56b2b2e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:21.904248 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-17400db3-ab5f-4763-80dd-9afb56b2b2e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:21.904700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-17400db3-ab5f-4763-80dd-9afb56b2b2e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:21.905465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-17400db3-ab5f-4763-80dd-9afb56b2b2e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:21.905902 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-17400db3-ab5f-4763-80dd-9afb56b2b2e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:22.033314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-17400db3-ab5f-4763-80dd-9afb56b2b2e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:22.041391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-17400db3-ab5f-4763-80dd-9afb56b2b2e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1681 microversion: 2.1 time: 0.147741 Jul 21 22:05:22.041967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 324/619] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:21 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:05:22.617718 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e9730702-d7e4-4cdb-bc6a-fd574d9f9fc0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:22.618342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e9730702-d7e4-4cdb-bc6a-fd574d9f9fc0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:22.625056 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9730702-d7e4-4cdb-bc6a-fd574d9f9fc0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:22.625501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9730702-d7e4-4cdb-bc6a-fd574d9f9fc0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:22.626261 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9730702-d7e4-4cdb-bc6a-fd574d9f9fc0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:22.626699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9730702-d7e4-4cdb-bc6a-fd574d9f9fc0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:22.758678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9730702-d7e4-4cdb-bc6a-fd574d9f9fc0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:22.767031 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9730702-d7e4-4cdb-bc6a-fd574d9f9fc0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:22.768529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9730702-d7e4-4cdb-bc6a-fd574d9f9fc0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:22.769664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e9730702-d7e4-4cdb-bc6a-fd574d9f9fc0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.156354 Jul 21 22:05:22.770249 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 325/620] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:22 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:22.793353 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-18357772-94b1-44a6-95ad-da8f7847c871 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:22.793951 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-18357772-94b1-44a6-95ad-da8f7847c871 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:22.799665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18357772-94b1-44a6-95ad-da8f7847c871 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:22.800139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18357772-94b1-44a6-95ad-da8f7847c871 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:22.800897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18357772-94b1-44a6-95ad-da8f7847c871 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:22.801328 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18357772-94b1-44a6-95ad-da8f7847c871 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:22.861100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-18357772-94b1-44a6-95ad-da8f7847c871 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:22.869141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-18357772-94b1-44a6-95ad-da8f7847c871 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079200 Jul 21 22:05:22.869702 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 326/621] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:22 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:05:23.059274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-65b2395d-b5c4-41bc-96e0-c77f69c89367 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:23.059842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-65b2395d-b5c4-41bc-96e0-c77f69c89367 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:23.065758 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-65b2395d-b5c4-41bc-96e0-c77f69c89367 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:23.066218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-65b2395d-b5c4-41bc-96e0-c77f69c89367 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:23.066987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-65b2395d-b5c4-41bc-96e0-c77f69c89367 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:23.067451 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-65b2395d-b5c4-41bc-96e0-c77f69c89367 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:23.194694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-65b2395d-b5c4-41bc-96e0-c77f69c89367 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:23.202178 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-65b2395d-b5c4-41bc-96e0-c77f69c89367 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1681 microversion: 2.1 time: 0.146748 Jul 21 22:05:23.202742 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 327/622] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:23 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:05:23.788507 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c3b1f0ee-d366-44a3-b25e-39afde17bd34 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:23.789121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c3b1f0ee-d366-44a3-b25e-39afde17bd34 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:23.795470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c3b1f0ee-d366-44a3-b25e-39afde17bd34 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:23.795925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c3b1f0ee-d366-44a3-b25e-39afde17bd34 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:23.796698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c3b1f0ee-d366-44a3-b25e-39afde17bd34 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:23.797140 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c3b1f0ee-d366-44a3-b25e-39afde17bd34 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:23.937886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c3b1f0ee-d366-44a3-b25e-39afde17bd34 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:23.947216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c3b1f0ee-d366-44a3-b25e-39afde17bd34 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:23.948858 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c3b1f0ee-d366-44a3-b25e-39afde17bd34 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:23.950031 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c3b1f0ee-d366-44a3-b25e-39afde17bd34 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.166039 Jul 21 22:05:23.950656 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 328/623] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:23 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:23.955623 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-85e248a9-d905-46dc-8c30-0fd4c4aba3f4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:23.956316 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-85e248a9-d905-46dc-8c30-0fd4c4aba3f4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:23.963989 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-85e248a9-d905-46dc-8c30-0fd4c4aba3f4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:23.964457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-85e248a9-d905-46dc-8c30-0fd4c4aba3f4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:23.965392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-85e248a9-d905-46dc-8c30-0fd4c4aba3f4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:23.965836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-85e248a9-d905-46dc-8c30-0fd4c4aba3f4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:24.029407 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-85e248a9-d905-46dc-8c30-0fd4c4aba3f4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:24.037226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-85e248a9-d905-46dc-8c30-0fd4c4aba3f4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.085532 Jul 21 22:05:24.038561 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 329/624] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:23 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:24.220024 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2bab1b52-4ef1-4aa2-9097-a51717b50bde tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:24.220544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2bab1b52-4ef1-4aa2-9097-a51717b50bde tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:24.227562 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2bab1b52-4ef1-4aa2-9097-a51717b50bde tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:24.228017 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2bab1b52-4ef1-4aa2-9097-a51717b50bde tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:24.228797 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2bab1b52-4ef1-4aa2-9097-a51717b50bde tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:24.229231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2bab1b52-4ef1-4aa2-9097-a51717b50bde tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:24.359090 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2bab1b52-4ef1-4aa2-9097-a51717b50bde tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:24.367405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2bab1b52-4ef1-4aa2-9097-a51717b50bde tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 200 len: 1681 microversion: 2.1 time: 0.151307 Jul 21 22:05:24.369183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 330/625] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:24 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:24.678063 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-0391c512-fa75-44bb-b556-bebc3e3c4d34 req-0068d190-2c14-45ab-84c2-e360ae61cc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8cef302-505a-45dc-9113-668fb800106f", "name": "network-vif-deleted", "tag": "3d6fb7ed-a22e-4f29-96c2-6e75f44500d5"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:05:24.686880 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-0391c512-fa75-44bb-b556-bebc3e3c4d34 req-0068d190-2c14-45ab-84c2-e360ae61cc0b service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:24.687383 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-0391c512-fa75-44bb-b556-bebc3e3c4d34 req-0068d190-2c14-45ab-84c2-e360ae61cc0b service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:24.699420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-0391c512-fa75-44bb-b556-bebc3e3c4d34 req-0068d190-2c14-45ab-84c2-e360ae61cc0b service nova] Creating event network-vif-deleted:3d6fb7ed-a22e-4f29-96c2-6e75f44500d5 for instance c8cef302-505a-45dc-9113-668fb800106f on hv-cinder-82002 Jul 21 22:05:24.704696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-0391c512-fa75-44bb-b556-bebc3e3c4d34 req-0068d190-2c14-45ab-84c2-e360ae61cc0b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030699 Jul 21 22:05:24.705320 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 331/626] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:05:24.970857 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0d6d8b9e-d82a-45d3-aba0-4f0b109a3da9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:24.971583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0d6d8b9e-d82a-45d3-aba0-4f0b109a3da9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:24.978205 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d6d8b9e-d82a-45d3-aba0-4f0b109a3da9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:24.978651 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d6d8b9e-d82a-45d3-aba0-4f0b109a3da9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:24.979437 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d6d8b9e-d82a-45d3-aba0-4f0b109a3da9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:24.979872 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d6d8b9e-d82a-45d3-aba0-4f0b109a3da9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:25.114939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0d6d8b9e-d82a-45d3-aba0-4f0b109a3da9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:25.124883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0d6d8b9e-d82a-45d3-aba0-4f0b109a3da9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:25.126672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0d6d8b9e-d82a-45d3-aba0-4f0b109a3da9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:25.127896 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0d6d8b9e-d82a-45d3-aba0-4f0b109a3da9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.162160 Jul 21 22:05:25.128416 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 332/627] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:24 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:25.132874 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-95b72ca0-7e58-4413-8495-9cc4eb7af4d6 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:25.133477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-95b72ca0-7e58-4413-8495-9cc4eb7af4d6 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:25.139314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95b72ca0-7e58-4413-8495-9cc4eb7af4d6 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:25.139768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95b72ca0-7e58-4413-8495-9cc4eb7af4d6 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:25.140535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95b72ca0-7e58-4413-8495-9cc4eb7af4d6 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:25.140972 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95b72ca0-7e58-4413-8495-9cc4eb7af4d6 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:25.205590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-95b72ca0-7e58-4413-8495-9cc4eb7af4d6 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:25.215060 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-95b72ca0-7e58-4413-8495-9cc4eb7af4d6 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.085599 Jul 21 22:05:25.224507 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 333/628] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:25 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:25.385591 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-04b1fb3b-eee9-4927-aaa6-56331cee436a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:25.386265 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-04b1fb3b-eee9-4927-aaa6-56331cee436a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:25.392642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-04b1fb3b-eee9-4927-aaa6-56331cee436a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:25.392959 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-04b1fb3b-eee9-4927-aaa6-56331cee436a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:25.393742 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-04b1fb3b-eee9-4927-aaa6-56331cee436a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:25.394182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-04b1fb3b-eee9-4927-aaa6-56331cee436a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:25.410680 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-04b1fb3b-eee9-4927-aaa6-56331cee436a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] HTTP exception thrown: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-04b1fb3b-eee9-4927-aaa6-56331cee436a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Request method failure captured: Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f HTTP/1.1 Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwq5cO8Iqs9BNx6Mzryp9hZtqim1vH8HuegCxrBuP4XGTqM74Ohh4WW_J2xt7YkUUdtgarY1MbMXrA_UelMtrho4YuwAwHA1g3NEpX3Am91Bsh0TFHZTsHViUUwnnQ3b29fzazVBCaTklKontb6LNgtPxGazR2DvDr1xBxhj2kB17I Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:05:25.412367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:05:25.414544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47878d7ed9cb49adba1f84a2ffb2deda", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:05:25.414544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:05:25.414544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:05:25.414544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:05:25.414544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:05:25.414544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:05:25.414544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:05:25.414544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 73f068abea75404fb2829065a674aee4 Jul 21 22:05:25.414544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:05:25.414544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:05:25.414544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:05:25.414544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': 'c8cef302-505a-45dc-9113-668fb800106f'} Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:05:25.415480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:05:25.416774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:05:25.418086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-04b1fb3b-eee9-4927-aaa6-56331cee436a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Returning 404 to user: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:05:25.418086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-04b1fb3b-eee9-4927-aaa6-56331cee436a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 404 len: 111 microversion: 2.1 time: 0.032809 Jul 21 22:05:25.418086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 334/629] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:25 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:05:25.423782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-550e4a5c-8921-45dc-bbf4-a6be045306a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '.version_select at 0x7faca1ec6dc0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:25.444144 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-550e4a5c-8921-45dc-bbf4-a6be045306a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330530345" status: 202 len: 0 microversion: 2.1 time: 0.024045 Jul 21 22:05:25.444881 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 335/630] 10.222.0.44 () {58 vars in 1220 bytes} [Thu Jul 21 22:05:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330530345 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:05:26.147700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7d4d0a41-a225-40b4-b205-63ba62fa5d8c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:26.148391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7d4d0a41-a225-40b4-b205-63ba62fa5d8c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:26.155151 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7d4d0a41-a225-40b4-b205-63ba62fa5d8c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:26.155608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7d4d0a41-a225-40b4-b205-63ba62fa5d8c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:26.156394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7d4d0a41-a225-40b4-b205-63ba62fa5d8c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:26.156814 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7d4d0a41-a225-40b4-b205-63ba62fa5d8c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:26.284829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7d4d0a41-a225-40b4-b205-63ba62fa5d8c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:26.293139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7d4d0a41-a225-40b4-b205-63ba62fa5d8c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:26.294712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7d4d0a41-a225-40b4-b205-63ba62fa5d8c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:26.295895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7d4d0a41-a225-40b4-b205-63ba62fa5d8c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.152654 Jul 21 22:05:26.296447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 336/631] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:26 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:26.300793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-48e3c4f3-d797-4cf8-8900-10c027e5b819 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:26.301390 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-48e3c4f3-d797-4cf8-8900-10c027e5b819 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:26.307449 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48e3c4f3-d797-4cf8-8900-10c027e5b819 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:26.307909 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48e3c4f3-d797-4cf8-8900-10c027e5b819 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:26.308674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48e3c4f3-d797-4cf8-8900-10c027e5b819 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:26.309111 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48e3c4f3-d797-4cf8-8900-10c027e5b819 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:26.368768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-48e3c4f3-d797-4cf8-8900-10c027e5b819 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:26.372253 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:05:26.377136 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-48e3c4f3-d797-4cf8-8900-10c027e5b819 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079766 Jul 21 22:05:26.377698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 337/632] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:26 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:27.314658 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4444c76d-cf0b-4db9-920f-6f43b5cae014 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:27.315344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4444c76d-cf0b-4db9-920f-6f43b5cae014 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:27.323154 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4444c76d-cf0b-4db9-920f-6f43b5cae014 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:27.323614 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4444c76d-cf0b-4db9-920f-6f43b5cae014 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:27.324397 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4444c76d-cf0b-4db9-920f-6f43b5cae014 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:27.324841 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4444c76d-cf0b-4db9-920f-6f43b5cae014 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:27.458716 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4444c76d-cf0b-4db9-920f-6f43b5cae014 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:27.467577 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4444c76d-cf0b-4db9-920f-6f43b5cae014 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:27.469037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4444c76d-cf0b-4db9-920f-6f43b5cae014 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:27.470195 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4444c76d-cf0b-4db9-920f-6f43b5cae014 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.160446 Jul 21 22:05:27.470752 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 338/633] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:27 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:27.475065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cb7f2ce5-3f46-4d78-af93-1f773927778b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:27.475679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cb7f2ce5-3f46-4d78-af93-1f773927778b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:27.482101 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cb7f2ce5-3f46-4d78-af93-1f773927778b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:27.482558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cb7f2ce5-3f46-4d78-af93-1f773927778b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:27.483673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cb7f2ce5-3f46-4d78-af93-1f773927778b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:27.483782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cb7f2ce5-3f46-4d78-af93-1f773927778b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:27.544319 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cb7f2ce5-3f46-4d78-af93-1f773927778b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:27.551750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cb7f2ce5-3f46-4d78-af93-1f773927778b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080041 Jul 21 22:05:27.552324 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 339/634] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:27 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:28.488909 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bcd38a4a-1991-4fd8-be7b-03b5980600b0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:28.489553 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bcd38a4a-1991-4fd8-be7b-03b5980600b0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:28.496568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bcd38a4a-1991-4fd8-be7b-03b5980600b0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:28.497020 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bcd38a4a-1991-4fd8-be7b-03b5980600b0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:28.497790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bcd38a4a-1991-4fd8-be7b-03b5980600b0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:28.498232 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bcd38a4a-1991-4fd8-be7b-03b5980600b0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:28.625827 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bcd38a4a-1991-4fd8-be7b-03b5980600b0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:28.634179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bcd38a4a-1991-4fd8-be7b-03b5980600b0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:28.635728 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bcd38a4a-1991-4fd8-be7b-03b5980600b0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:28.636891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bcd38a4a-1991-4fd8-be7b-03b5980600b0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.151865 Jul 21 22:05:28.637454 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 340/635] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:28 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:28.641717 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-68afc2b6-d207-4b3b-8407-4fe3433ca832 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:28.642321 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-68afc2b6-d207-4b3b-8407-4fe3433ca832 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:28.647939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68afc2b6-d207-4b3b-8407-4fe3433ca832 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:28.648396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68afc2b6-d207-4b3b-8407-4fe3433ca832 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:28.649165 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68afc2b6-d207-4b3b-8407-4fe3433ca832 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:28.649606 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68afc2b6-d207-4b3b-8407-4fe3433ca832 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:28.719886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-68afc2b6-d207-4b3b-8407-4fe3433ca832 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:28.727853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-68afc2b6-d207-4b3b-8407-4fe3433ca832 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.089468 Jul 21 22:05:28.728432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 341/636] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:28 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:29.654932 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-51ce6ae7-9efc-4c96-80de-b898b3558c14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:29.655572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-51ce6ae7-9efc-4c96-80de-b898b3558c14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:29.662006 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-51ce6ae7-9efc-4c96-80de-b898b3558c14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:29.662448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-51ce6ae7-9efc-4c96-80de-b898b3558c14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:29.663232 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-51ce6ae7-9efc-4c96-80de-b898b3558c14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:29.663668 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-51ce6ae7-9efc-4c96-80de-b898b3558c14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:29.791064 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-51ce6ae7-9efc-4c96-80de-b898b3558c14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:29.799371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-51ce6ae7-9efc-4c96-80de-b898b3558c14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:29.800895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-51ce6ae7-9efc-4c96-80de-b898b3558c14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:29.802032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-51ce6ae7-9efc-4c96-80de-b898b3558c14 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.150954 Jul 21 22:05:29.802589 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 342/637] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:29 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:29.810150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b46023c2-00d5-4257-a0f2-f381bbcea13d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:29.810150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b46023c2-00d5-4257-a0f2-f381bbcea13d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:29.813433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b46023c2-00d5-4257-a0f2-f381bbcea13d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:29.813881 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b46023c2-00d5-4257-a0f2-f381bbcea13d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:29.814648 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b46023c2-00d5-4257-a0f2-f381bbcea13d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:29.815108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b46023c2-00d5-4257-a0f2-f381bbcea13d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:29.875894 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b46023c2-00d5-4257-a0f2-f381bbcea13d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:29.883383 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b46023c2-00d5-4257-a0f2-f381bbcea13d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079686 Jul 21 22:05:29.883948 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 343/638] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:29 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:30.821052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-91eb15d1-4dbc-42cf-8a34-85a0b0c9f81d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:30.821664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-91eb15d1-4dbc-42cf-8a34-85a0b0c9f81d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:30.828099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-91eb15d1-4dbc-42cf-8a34-85a0b0c9f81d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:30.828554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-91eb15d1-4dbc-42cf-8a34-85a0b0c9f81d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:30.829319 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-91eb15d1-4dbc-42cf-8a34-85a0b0c9f81d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:30.829759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-91eb15d1-4dbc-42cf-8a34-85a0b0c9f81d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:30.960729 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-91eb15d1-4dbc-42cf-8a34-85a0b0c9f81d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:30.969446 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-91eb15d1-4dbc-42cf-8a34-85a0b0c9f81d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:30.970957 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-91eb15d1-4dbc-42cf-8a34-85a0b0c9f81d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:30.972128 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-91eb15d1-4dbc-42cf-8a34-85a0b0c9f81d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.155679 Jul 21 22:05:30.972696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 344/639] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:30 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:30.977452 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-82461123-74cb-4f1f-ab24-7e057fb2adf9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:30.978051 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-82461123-74cb-4f1f-ab24-7e057fb2adf9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:30.983647 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-82461123-74cb-4f1f-ab24-7e057fb2adf9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:30.984106 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-82461123-74cb-4f1f-ab24-7e057fb2adf9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:30.984873 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-82461123-74cb-4f1f-ab24-7e057fb2adf9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:30.985315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-82461123-74cb-4f1f-ab24-7e057fb2adf9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:31.044842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-82461123-74cb-4f1f-ab24-7e057fb2adf9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:31.052364 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-82461123-74cb-4f1f-ab24-7e057fb2adf9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078748 Jul 21 22:05:31.052933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 345/640] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:30 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:31.447400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=4 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:05:31.991063 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-02838b90-9301-4b6c-b78c-c9e56d2a3e06 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:31.991579 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-02838b90-9301-4b6c-b78c-c9e56d2a3e06 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:31.998104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02838b90-9301-4b6c-b78c-c9e56d2a3e06 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:31.998571 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02838b90-9301-4b6c-b78c-c9e56d2a3e06 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:31.999365 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02838b90-9301-4b6c-b78c-c9e56d2a3e06 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:31.999796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02838b90-9301-4b6c-b78c-c9e56d2a3e06 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:32.140212 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-02838b90-9301-4b6c-b78c-c9e56d2a3e06 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:32.148943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-02838b90-9301-4b6c-b78c-c9e56d2a3e06 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:32.150443 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-02838b90-9301-4b6c-b78c-c9e56d2a3e06 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:32.151612 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-02838b90-9301-4b6c-b78c-c9e56d2a3e06 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.164518 Jul 21 22:05:32.152177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 346/641] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:31 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:32.156473 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8817cba9-aa6b-4989-b31a-1f1090b8b00a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:32.157066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8817cba9-aa6b-4989-b31a-1f1090b8b00a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:32.162900 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8817cba9-aa6b-4989-b31a-1f1090b8b00a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:32.163384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8817cba9-aa6b-4989-b31a-1f1090b8b00a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:32.164772 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8817cba9-aa6b-4989-b31a-1f1090b8b00a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:32.165214 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8817cba9-aa6b-4989-b31a-1f1090b8b00a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:32.231345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8817cba9-aa6b-4989-b31a-1f1090b8b00a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:32.238960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8817cba9-aa6b-4989-b31a-1f1090b8b00a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.085874 Jul 21 22:05:32.239543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 347/642] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:32 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:33.171931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-779333e4-e4f2-4da6-9456-31cb8c52bb62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:33.172772 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-779333e4-e4f2-4da6-9456-31cb8c52bb62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:33.180907 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-779333e4-e4f2-4da6-9456-31cb8c52bb62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:33.181366 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-779333e4-e4f2-4da6-9456-31cb8c52bb62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:33.182140 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-779333e4-e4f2-4da6-9456-31cb8c52bb62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:33.182580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-779333e4-e4f2-4da6-9456-31cb8c52bb62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:33.310478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-779333e4-e4f2-4da6-9456-31cb8c52bb62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:33.318820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-779333e4-e4f2-4da6-9456-31cb8c52bb62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:33.320351 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-779333e4-e4f2-4da6-9456-31cb8c52bb62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:33.321554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-779333e4-e4f2-4da6-9456-31cb8c52bb62 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.153567 Jul 21 22:05:33.322122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 348/643] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:33 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:33.326442 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ff63fa9b-02f1-4fcd-ac32-0ebfef135152 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:33.327056 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ff63fa9b-02f1-4fcd-ac32-0ebfef135152 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:33.332757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff63fa9b-02f1-4fcd-ac32-0ebfef135152 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:33.333206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff63fa9b-02f1-4fcd-ac32-0ebfef135152 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:33.333960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff63fa9b-02f1-4fcd-ac32-0ebfef135152 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:33.334390 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff63fa9b-02f1-4fcd-ac32-0ebfef135152 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:33.394372 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ff63fa9b-02f1-4fcd-ac32-0ebfef135152 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:33.401778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ff63fa9b-02f1-4fcd-ac32-0ebfef135152 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078740 Jul 21 22:05:33.402335 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 349/644] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:33 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:34.340236 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-223a118f-3941-43a4-aca2-aea86546f5c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:34.340946 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-223a118f-3941-43a4-aca2-aea86546f5c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:34.347412 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-223a118f-3941-43a4-aca2-aea86546f5c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:34.347862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-223a118f-3941-43a4-aca2-aea86546f5c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:34.348624 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-223a118f-3941-43a4-aca2-aea86546f5c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:34.349057 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-223a118f-3941-43a4-aca2-aea86546f5c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:34.483031 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-223a118f-3941-43a4-aca2-aea86546f5c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:34.491462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-223a118f-3941-43a4-aca2-aea86546f5c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:34.493752 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-223a118f-3941-43a4-aca2-aea86546f5c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:34.494887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-223a118f-3941-43a4-aca2-aea86546f5c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.158957 Jul 21 22:05:34.495480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 350/645] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:34 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:34.500212 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5dcd9e45-e51b-428a-b793-f2a5e509156e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:34.500803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5dcd9e45-e51b-428a-b793-f2a5e509156e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:34.514912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5dcd9e45-e51b-428a-b793-f2a5e509156e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:34.515470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5dcd9e45-e51b-428a-b793-f2a5e509156e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:34.517072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5dcd9e45-e51b-428a-b793-f2a5e509156e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:34.517510 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5dcd9e45-e51b-428a-b793-f2a5e509156e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:34.577825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5dcd9e45-e51b-428a-b793-f2a5e509156e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:34.585669 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5dcd9e45-e51b-428a-b793-f2a5e509156e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.089072 Jul 21 22:05:34.586608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 351/646] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:34 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:35.516692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bedec0cd-f4b1-4457-b3d6-6fe4c3ad140a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:35.517671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bedec0cd-f4b1-4457-b3d6-6fe4c3ad140a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:35.525096 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bedec0cd-f4b1-4457-b3d6-6fe4c3ad140a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:35.525545 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bedec0cd-f4b1-4457-b3d6-6fe4c3ad140a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:35.526316 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bedec0cd-f4b1-4457-b3d6-6fe4c3ad140a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:35.526757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bedec0cd-f4b1-4457-b3d6-6fe4c3ad140a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:35.658575 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bedec0cd-f4b1-4457-b3d6-6fe4c3ad140a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:35.667363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bedec0cd-f4b1-4457-b3d6-6fe4c3ad140a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:35.668508 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bedec0cd-f4b1-4457-b3d6-6fe4c3ad140a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:35.669723 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bedec0cd-f4b1-4457-b3d6-6fe4c3ad140a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.157686 Jul 21 22:05:35.670222 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 352/647] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:35 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:35.675075 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0a7d1d53-b237-4360-9f70-f635f71b4217 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:35.675685 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0a7d1d53-b237-4360-9f70-f635f71b4217 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:35.681663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0a7d1d53-b237-4360-9f70-f635f71b4217 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:35.682121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0a7d1d53-b237-4360-9f70-f635f71b4217 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:35.682900 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0a7d1d53-b237-4360-9f70-f635f71b4217 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:35.683378 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0a7d1d53-b237-4360-9f70-f635f71b4217 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:35.748110 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0a7d1d53-b237-4360-9f70-f635f71b4217 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:35.755581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0a7d1d53-b237-4360-9f70-f635f71b4217 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.084439 Jul 21 22:05:35.756146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 353/648] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:35 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:36.688556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-174b7a1a-cabd-4024-8fce-ea6b914f0382 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:36.689225 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-174b7a1a-cabd-4024-8fce-ea6b914f0382 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:36.696169 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-174b7a1a-cabd-4024-8fce-ea6b914f0382 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:36.696625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-174b7a1a-cabd-4024-8fce-ea6b914f0382 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:36.697464 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-174b7a1a-cabd-4024-8fce-ea6b914f0382 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:36.698085 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-174b7a1a-cabd-4024-8fce-ea6b914f0382 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:36.716683 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:05:36.826217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-174b7a1a-cabd-4024-8fce-ea6b914f0382 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:36.834448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-174b7a1a-cabd-4024-8fce-ea6b914f0382 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:36.836483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-174b7a1a-cabd-4024-8fce-ea6b914f0382 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:36.837629 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-174b7a1a-cabd-4024-8fce-ea6b914f0382 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.152953 Jul 21 22:05:36.838193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 354/649] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:36 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:05:36.842433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b69c7d83-a5ea-4a94-9429-fb41bae03cda tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:36.843055 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b69c7d83-a5ea-4a94-9429-fb41bae03cda tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:36.848772 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b69c7d83-a5ea-4a94-9429-fb41bae03cda tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:36.849219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b69c7d83-a5ea-4a94-9429-fb41bae03cda tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:36.849985 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b69c7d83-a5ea-4a94-9429-fb41bae03cda tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:36.850419 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b69c7d83-a5ea-4a94-9429-fb41bae03cda tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:36.911393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b69c7d83-a5ea-4a94-9429-fb41bae03cda tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:36.918892 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b69c7d83-a5ea-4a94-9429-fb41bae03cda tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079777 Jul 21 22:05:36.919486 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 355/650] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:36 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:37.856394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a0548519-bcab-4c32-9e24-0dfed8bb5903 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:37.856994 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a0548519-bcab-4c32-9e24-0dfed8bb5903 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:37.863267 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a0548519-bcab-4c32-9e24-0dfed8bb5903 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:37.863749 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a0548519-bcab-4c32-9e24-0dfed8bb5903 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:37.864507 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a0548519-bcab-4c32-9e24-0dfed8bb5903 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:37.864979 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a0548519-bcab-4c32-9e24-0dfed8bb5903 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:37.998114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a0548519-bcab-4c32-9e24-0dfed8bb5903 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:38.007785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a0548519-bcab-4c32-9e24-0dfed8bb5903 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:38.009291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a0548519-bcab-4c32-9e24-0dfed8bb5903 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:38.010440 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a0548519-bcab-4c32-9e24-0dfed8bb5903 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.157950 Jul 21 22:05:38.011034 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 356/651] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:37 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:38.015290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4d8c159f-9d53-4997-962e-f431fcf7dd73 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:38.015888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4d8c159f-9d53-4997-962e-f431fcf7dd73 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:38.021376 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d8c159f-9d53-4997-962e-f431fcf7dd73 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:38.021826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d8c159f-9d53-4997-962e-f431fcf7dd73 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:38.022596 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d8c159f-9d53-4997-962e-f431fcf7dd73 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:38.023059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d8c159f-9d53-4997-962e-f431fcf7dd73 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:38.082603 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4d8c159f-9d53-4997-962e-f431fcf7dd73 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:38.090486 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4d8c159f-9d53-4997-962e-f431fcf7dd73 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078550 Jul 21 22:05:38.091065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 357/652] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:38 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:39.028563 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-76fb16e9-1af1-4aaf-a4a1-574bba25bd0e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:39.029272 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-76fb16e9-1af1-4aaf-a4a1-574bba25bd0e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:39.035680 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76fb16e9-1af1-4aaf-a4a1-574bba25bd0e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:39.036126 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76fb16e9-1af1-4aaf-a4a1-574bba25bd0e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:39.036882 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76fb16e9-1af1-4aaf-a4a1-574bba25bd0e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:39.037314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76fb16e9-1af1-4aaf-a4a1-574bba25bd0e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:39.164379 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-76fb16e9-1af1-4aaf-a4a1-574bba25bd0e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:39.173277 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-76fb16e9-1af1-4aaf-a4a1-574bba25bd0e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:39.174789 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-76fb16e9-1af1-4aaf-a4a1-574bba25bd0e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:39.175960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-76fb16e9-1af1-4aaf-a4a1-574bba25bd0e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.151338 Jul 21 22:05:39.176522 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 358/653] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:39 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:39.181394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5aa7bf1f-5b09-4ddc-8160-c0c1413eac45 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:39.181999 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5aa7bf1f-5b09-4ddc-8160-c0c1413eac45 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:39.187534 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aa7bf1f-5b09-4ddc-8160-c0c1413eac45 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:39.187987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aa7bf1f-5b09-4ddc-8160-c0c1413eac45 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:39.188752 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aa7bf1f-5b09-4ddc-8160-c0c1413eac45 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:39.189196 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aa7bf1f-5b09-4ddc-8160-c0c1413eac45 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:39.251355 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5aa7bf1f-5b09-4ddc-8160-c0c1413eac45 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:39.258725 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5aa7bf1f-5b09-4ddc-8160-c0c1413eac45 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081282 Jul 21 22:05:39.259325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 359/654] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:39 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:40.194238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-81c18a4a-5490-4932-82e1-2404e8650ead tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:40.194840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-81c18a4a-5490-4932-82e1-2404e8650ead tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:40.202006 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-81c18a4a-5490-4932-82e1-2404e8650ead tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:40.202457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-81c18a4a-5490-4932-82e1-2404e8650ead tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:40.203260 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-81c18a4a-5490-4932-82e1-2404e8650ead tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:40.203701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-81c18a4a-5490-4932-82e1-2404e8650ead tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:40.331101 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-81c18a4a-5490-4932-82e1-2404e8650ead tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:40.339578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-81c18a4a-5490-4932-82e1-2404e8650ead tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:40.341086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-81c18a4a-5490-4932-82e1-2404e8650ead tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:40.342245 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-81c18a4a-5490-4932-82e1-2404e8650ead tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.151847 Jul 21 22:05:40.342803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 360/655] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:40 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:40.347086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dcb53080-69c2-4cac-b8c4-21bb2f7b9b25 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:40.347688 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dcb53080-69c2-4cac-b8c4-21bb2f7b9b25 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:40.353189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dcb53080-69c2-4cac-b8c4-21bb2f7b9b25 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:40.353643 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dcb53080-69c2-4cac-b8c4-21bb2f7b9b25 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:40.354406 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dcb53080-69c2-4cac-b8c4-21bb2f7b9b25 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:40.354846 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dcb53080-69c2-4cac-b8c4-21bb2f7b9b25 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:40.415546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dcb53080-69c2-4cac-b8c4-21bb2f7b9b25 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:40.422883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dcb53080-69c2-4cac-b8c4-21bb2f7b9b25 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079105 Jul 21 22:05:40.423484 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 361/656] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:40 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:41.360594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9188b6c7-2ae1-4b40-928e-a1d68d51de55 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:41.361281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9188b6c7-2ae1-4b40-928e-a1d68d51de55 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:41.367723 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9188b6c7-2ae1-4b40-928e-a1d68d51de55 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:41.368172 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9188b6c7-2ae1-4b40-928e-a1d68d51de55 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:41.368939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9188b6c7-2ae1-4b40-928e-a1d68d51de55 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:41.369378 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9188b6c7-2ae1-4b40-928e-a1d68d51de55 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:41.500435 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9188b6c7-2ae1-4b40-928e-a1d68d51de55 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:41.508769 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9188b6c7-2ae1-4b40-928e-a1d68d51de55 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:41.510760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9188b6c7-2ae1-4b40-928e-a1d68d51de55 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:41.511933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9188b6c7-2ae1-4b40-928e-a1d68d51de55 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.155240 Jul 21 22:05:41.512489 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 362/657] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:41 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:41.516711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e87edfd1-a775-4204-9ca2-0ca2efd804df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:41.517315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e87edfd1-a775-4204-9ca2-0ca2efd804df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:41.522993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e87edfd1-a775-4204-9ca2-0ca2efd804df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:41.523491 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e87edfd1-a775-4204-9ca2-0ca2efd804df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:41.524245 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e87edfd1-a775-4204-9ca2-0ca2efd804df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:41.525479 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e87edfd1-a775-4204-9ca2-0ca2efd804df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:41.584584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e87edfd1-a775-4204-9ca2-0ca2efd804df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:41.593084 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e87edfd1-a775-4204-9ca2-0ca2efd804df tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079613 Jul 21 22:05:41.593653 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 363/658] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:41 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:42.529296 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e825e9ef-cd52-4d2c-b8a0-4aba6d5297f3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:42.529887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e825e9ef-cd52-4d2c-b8a0-4aba6d5297f3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:42.536276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e825e9ef-cd52-4d2c-b8a0-4aba6d5297f3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:42.536724 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e825e9ef-cd52-4d2c-b8a0-4aba6d5297f3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:42.537478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e825e9ef-cd52-4d2c-b8a0-4aba6d5297f3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:42.537910 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e825e9ef-cd52-4d2c-b8a0-4aba6d5297f3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:42.666901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e825e9ef-cd52-4d2c-b8a0-4aba6d5297f3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:42.675170 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e825e9ef-cd52-4d2c-b8a0-4aba6d5297f3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:42.676685 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e825e9ef-cd52-4d2c-b8a0-4aba6d5297f3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:42.677830 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e825e9ef-cd52-4d2c-b8a0-4aba6d5297f3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.152470 Jul 21 22:05:42.678401 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 364/659] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:42 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:42.683230 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-27676e31-e573-43e6-a212-df1265c42b15 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:42.683836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-27676e31-e573-43e6-a212-df1265c42b15 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:42.689379 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-27676e31-e573-43e6-a212-df1265c42b15 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:42.689826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-27676e31-e573-43e6-a212-df1265c42b15 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:42.690592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-27676e31-e573-43e6-a212-df1265c42b15 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:42.691047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-27676e31-e573-43e6-a212-df1265c42b15 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:42.754223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-27676e31-e573-43e6-a212-df1265c42b15 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:42.762228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-27676e31-e573-43e6-a212-df1265c42b15 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082905 Jul 21 22:05:42.762797 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 365/660] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:42 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:43.696947 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6f8538b8-b275-4e78-a93c-a33c2591a63c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:43.697555 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6f8538b8-b275-4e78-a93c-a33c2591a63c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:43.701051 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:05:43.705434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f8538b8-b275-4e78-a93c-a33c2591a63c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:43.705903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f8538b8-b275-4e78-a93c-a33c2591a63c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:43.706667 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f8538b8-b275-4e78-a93c-a33c2591a63c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:43.707138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f8538b8-b275-4e78-a93c-a33c2591a63c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:43.835394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6f8538b8-b275-4e78-a93c-a33c2591a63c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:43.844747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6f8538b8-b275-4e78-a93c-a33c2591a63c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:43.846242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6f8538b8-b275-4e78-a93c-a33c2591a63c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:43.847416 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6f8538b8-b275-4e78-a93c-a33c2591a63c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.154798 Jul 21 22:05:43.847970 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 366/661] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:05:43 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:05:43.852174 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-66b70fae-2eff-4b5d-afd9-48ed0248765e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:43.852776 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-66b70fae-2eff-4b5d-afd9-48ed0248765e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:43.858256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66b70fae-2eff-4b5d-afd9-48ed0248765e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:43.858705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66b70fae-2eff-4b5d-afd9-48ed0248765e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:43.859502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66b70fae-2eff-4b5d-afd9-48ed0248765e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:43.859937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66b70fae-2eff-4b5d-afd9-48ed0248765e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:43.920295 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-66b70fae-2eff-4b5d-afd9-48ed0248765e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:05:43.928124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-66b70fae-2eff-4b5d-afd9-48ed0248765e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079180 Jul 21 22:05:43.928886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 367/662] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:05:43 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:05:43.934462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5095985b-158b-4362-bb52-36ea949040e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:05:43.935021 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5095985b-158b-4362-bb52-36ea949040e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:05:43.940993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5095985b-158b-4362-bb52-36ea949040e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:43.941451 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5095985b-158b-4362-bb52-36ea949040e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:43.942227 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5095985b-158b-4362-bb52-36ea949040e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:05:43.942671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5095985b-158b-4362-bb52-36ea949040e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:05:53.938586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:05:54.004884 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=84 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:06:23.832304 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-55c5df51-ad61-4db2-8671-1ac396101fff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments/87559f54-5fd6-4f81-9742-d876e6902bdc" status: 202 len: 0 microversion: 2.1 time: 100.090967 Jul 21 22:06:23.833036 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 296/663] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:04:43 2022] DELETE /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments/87559f54-5fd6-4f81-9742-d876e6902bdc => generated 0 bytes in 100093 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:06:23.839902 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1a32c090-6363-4493-bc36-f955d8584aea tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:06:23.840899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1a32c090-6363-4493-bc36-f955d8584aea tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:06:23.849016 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1a32c090-6363-4493-bc36-f955d8584aea tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:06:23.849872 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1a32c090-6363-4493-bc36-f955d8584aea tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:06:23.850926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1a32c090-6363-4493-bc36-f955d8584aea tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:06:23.851584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1a32c090-6363-4493-bc36-f955d8584aea tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:06:24.002347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1a32c090-6363-4493-bc36-f955d8584aea tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:06:24.017409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1a32c090-6363-4493-bc36-f955d8584aea tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:06:24.018945 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1a32c090-6363-4493-bc36-f955d8584aea tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:06:24.020158 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1a32c090-6363-4493-bc36-f955d8584aea tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.185833 Jul 21 22:06:24.020729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 297/664] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:06:23 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:06:24.025308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-64b1f63c-11ae-48c1-9ccc-54e4bc8cbd4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:06:24.026090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-64b1f63c-11ae-48c1-9ccc-54e4bc8cbd4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:06:24.033323 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-64b1f63c-11ae-48c1-9ccc-54e4bc8cbd4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:06:24.033772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-64b1f63c-11ae-48c1-9ccc-54e4bc8cbd4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:06:24.034572 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-64b1f63c-11ae-48c1-9ccc-54e4bc8cbd4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:06:24.035047 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-64b1f63c-11ae-48c1-9ccc-54e4bc8cbd4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:06:24.090214 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-5095985b-158b-4362-bb52-36ea949040e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lazy-loading 'services' on Instance uuid 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:06:24.097137 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-64b1f63c-11ae-48c1-9ccc-54e4bc8cbd4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:06:24.104760 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-64b1f63c-11ae-48c1-9ccc-54e4bc8cbd4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082775 Jul 21 22:06:24.105329 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 298/665] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:06:24 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:06:24.110163 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e4bbe41f-64b0-43fc-825e-94019a7a25a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:06:24.110846 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e4bbe41f-64b0-43fc-825e-94019a7a25a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:06:24.123705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e4bbe41f-64b0-43fc-825e-94019a7a25a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:06:24.123705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e4bbe41f-64b0-43fc-825e-94019a7a25a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:06:24.123705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e4bbe41f-64b0-43fc-825e-94019a7a25a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:06:24.123705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e4bbe41f-64b0-43fc-825e-94019a7a25a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:06:34.115102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=6 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:06:34.145273 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:06:34.153637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:07:21.549868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.objects.instance [None req-e4bbe41f-64b0-43fc-825e-94019a7a25a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lazy-loading 'services' on Instance uuid 7365f289-299d-4d2d-ba74-1ca18cf88e06 {{(pid=117979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:07:21.577216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-5095985b-158b-4362-bb52-36ea949040e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4430de1c-dddb-47ba-a148-369c7e74a73a) Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5095985b-158b-4362-bb52-36ea949040e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Request method failure captured: Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments/87559f54-5fd6-4f81-9742-d876e6902bdc HTTP/1.1 Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwsFoQuFzo2FslExyVTADChaJIs6N9-o5VsNNOQT6SZ9p5oybpNMCsOCZlhpZABdWxKinYf5u4ZG1tARrF46oAgdhaQ5A2jaRTfL56kRa7dxhitIuKMLzZz4qYQ5ouY9PdmQ5B98yRhbQLMuSvyefpqsG0a5Zq3gCR9k5F79Ab1l6Y Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:07:21.579815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:07:21.581211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_64e8fc83edda464e8ec9f7c2ee9c142c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:07:21.581211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:07:21.581211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:07:21.581211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:07:21.581211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:07:21.581211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:07:21.581211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:07:21.581211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 9f6537f0b9d44ba58cb5a5552f2c5b4e Jul 21 22:07:21.581211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:07:21.581211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4430de1c-dddb-47ba-a148-369c7e74a73a) Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'server_id': '8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f', 'id': '87559f54-5fd6-4f81-9742-d876e6902bdc'} Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:07:21.582228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4430de1c-dddb-47ba-a148-369c7e74a73a) Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:07:21.586122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4430de1c-dddb-47ba-a148-369c7e74a73a) Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:07:21.588386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4430de1c-dddb-47ba-a148-369c7e74a73a) Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:07:21.590410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4430de1c-dddb-47ba-a148-369c7e74a73a) Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4430de1c-dddb-47ba-a148-369c7e74a73a) Jul 21 22:07:21.592860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.595206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5095985b-158b-4362-bb52-36ea949040e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4430de1c-dddb-47ba-a148-369c7e74a73a) {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:07:21.595206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5095985b-158b-4362-bb52-36ea949040e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments/87559f54-5fd6-4f81-9742-d876e6902bdc" status: 400 len: 269 microversion: 2.1 time: 97.652044 Jul 21 22:07:21.595206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 368/666] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:05:43 2022] DELETE /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments/87559f54-5fd6-4f81-9742-d876e6902bdc => generated 269 bytes in 97655 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:07:21.595206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3966abc0-420e-4b54-bddb-e8c6bf66589f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:21.595911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3966abc0-420e-4b54-bddb-e8c6bf66589f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:21.602097 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3966abc0-420e-4b54-bddb-e8c6bf66589f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:21.602749 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3966abc0-420e-4b54-bddb-e8c6bf66589f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:21.603498 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3966abc0-420e-4b54-bddb-e8c6bf66589f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:21.604000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3966abc0-420e-4b54-bddb-e8c6bf66589f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:21.732696 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e4bbe41f-64b0-43fc-825e-94019a7a25a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments/e833a0d1-aafb-4650-b1f4-e369f36f1edb" status: 202 len: 0 microversion: 2.1 time: 57.625811 Jul 21 22:07:21.733701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 299/667] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:06:24 2022] DELETE /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments/e833a0d1-aafb-4650-b1f4-e369f36f1edb => generated 0 bytes in 57628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:07:21.739242 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b47cc4d0-707d-41af-937e-d3c33b9c6876 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:21.739747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3966abc0-420e-4b54-bddb-e8c6bf66589f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:21.739938 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b47cc4d0-707d-41af-937e-d3c33b9c6876 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:21.746124 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b47cc4d0-707d-41af-937e-d3c33b9c6876 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:21.746575 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b47cc4d0-707d-41af-937e-d3c33b9c6876 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:21.747379 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b47cc4d0-707d-41af-937e-d3c33b9c6876 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:21.747937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b47cc4d0-707d-41af-937e-d3c33b9c6876 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:21.749398 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3966abc0-420e-4b54-bddb-e8c6bf66589f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:21.751081 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3966abc0-420e-4b54-bddb-e8c6bf66589f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:21.752317 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3966abc0-420e-4b54-bddb-e8c6bf66589f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1750 microversion: 2.20 time: 0.167133 Jul 21 22:07:21.752966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 369/668] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:21 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:21.757933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cb883665-57c1-4ea7-8715-daccabe3a44a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:21.758672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cb883665-57c1-4ea7-8715-daccabe3a44a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:21.766162 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cb883665-57c1-4ea7-8715-daccabe3a44a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:21.766798 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cb883665-57c1-4ea7-8715-daccabe3a44a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:21.767644 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cb883665-57c1-4ea7-8715-daccabe3a44a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:21.768087 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cb883665-57c1-4ea7-8715-daccabe3a44a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:21.820510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b47cc4d0-707d-41af-937e-d3c33b9c6876 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:21.828249 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b47cc4d0-707d-41af-937e-d3c33b9c6876 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.093238 Jul 21 22:07:21.828859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 300/669] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:21 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:21.833420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-74177449-4a40-4306-abcf-2c0ba7891939 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:21.834383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-74177449-4a40-4306-abcf-2c0ba7891939 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:21.840439 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-74177449-4a40-4306-abcf-2c0ba7891939 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:21.840893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-74177449-4a40-4306-abcf-2c0ba7891939 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:21.841665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-74177449-4a40-4306-abcf-2c0ba7891939 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:21.842111 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-74177449-4a40-4306-abcf-2c0ba7891939 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:21.857925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-cb883665-57c1-4ea7-8715-daccabe3a44a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lazy-loading 'services' on Instance uuid 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:07:21.871997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-74177449-4a40-4306-abcf-2c0ba7891939 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042104 Jul 21 22:07:21.872797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 301/670] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:21 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:21.913511 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-cb883665-57c1-4ea7-8715-daccabe3a44a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6dc12f4-a59b-47d9-adf3-704aa1e4fa80) Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cb883665-57c1-4ea7-8715-daccabe3a44a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Request method failure captured: Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments/87559f54-5fd6-4f81-9742-d876e6902bdc HTTP/1.1 Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwsFoQuFzo2FslExyVTADChaJIs6N9-o5VsNNOQT6SZ9p5oybpNMCsOCZlhpZABdWxKinYf5u4ZG1tARrF46oAgdhaQ5A2jaRTfL56kRa7dxhitIuKMLzZz4qYQ5ouY9PdmQ5B98yRhbQLMuSvyefpqsG0a5Zq3gCR9k5F79Ab1l6Y Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:07:21.915701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:07:21.917183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_64e8fc83edda464e8ec9f7c2ee9c142c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:07:21.917183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:07:21.917183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:07:21.917183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:07:21.917183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:07:21.917183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:07:21.917183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:07:21.917183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 9f6537f0b9d44ba58cb5a5552f2c5b4e Jul 21 22:07:21.917183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:07:21.917183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6dc12f4-a59b-47d9-adf3-704aa1e4fa80) Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'server_id': '8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f', 'id': '87559f54-5fd6-4f81-9742-d876e6902bdc'} Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:07:21.917891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6dc12f4-a59b-47d9-adf3-704aa1e4fa80) Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:07:21.919138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6dc12f4-a59b-47d9-adf3-704aa1e4fa80) Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:07:21.920457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6dc12f4-a59b-47d9-adf3-704aa1e4fa80) Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:07:21.922256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6dc12f4-a59b-47d9-adf3-704aa1e4fa80) Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6dc12f4-a59b-47d9-adf3-704aa1e4fa80) Jul 21 22:07:21.923515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:07:21.924769 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cb883665-57c1-4ea7-8715-daccabe3a44a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f6dc12f4-a59b-47d9-adf3-704aa1e4fa80) {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:07:21.924769 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cb883665-57c1-4ea7-8715-daccabe3a44a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments/87559f54-5fd6-4f81-9742-d876e6902bdc" status: 400 len: 269 microversion: 2.1 time: 0.163322 Jul 21 22:07:21.924769 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 370/671] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:07:21 2022] DELETE /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments/87559f54-5fd6-4f81-9742-d876e6902bdc => generated 269 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:07:21.979392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-549ab5ba-336b-47e0-8423-c183eec40a9d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:21.980345 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-549ab5ba-336b-47e0-8423-c183eec40a9d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:21.986863 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-549ab5ba-336b-47e0-8423-c183eec40a9d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:21.987262 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-549ab5ba-336b-47e0-8423-c183eec40a9d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:21.988043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-549ab5ba-336b-47e0-8423-c183eec40a9d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:21.988472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-549ab5ba-336b-47e0-8423-c183eec40a9d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:22.017645 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-549ab5ba-336b-47e0-8423-c183eec40a9d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042201 Jul 21 22:07:22.018205 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 302/672] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:21 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:22.772070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-56143457-d787-4acf-8192-6b2500ce1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:22.772678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-56143457-d787-4acf-8192-6b2500ce1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:22.779195 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56143457-d787-4acf-8192-6b2500ce1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:22.779648 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56143457-d787-4acf-8192-6b2500ce1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:22.780448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56143457-d787-4acf-8192-6b2500ce1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:22.780888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56143457-d787-4acf-8192-6b2500ce1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:22.845071 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2e2117eb-9dc9-4371-ae27-77f679dbe623 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:22.845617 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2e2117eb-9dc9-4371-ae27-77f679dbe623 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:22.852089 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e2117eb-9dc9-4371-ae27-77f679dbe623 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:22.852541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e2117eb-9dc9-4371-ae27-77f679dbe623 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:22.853311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e2117eb-9dc9-4371-ae27-77f679dbe623 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:22.853746 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e2117eb-9dc9-4371-ae27-77f679dbe623 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:22.924017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2e2117eb-9dc9-4371-ae27-77f679dbe623 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:22.930972 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-56143457-d787-4acf-8192-6b2500ce1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:22.931475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2e2117eb-9dc9-4371-ae27-77f679dbe623 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.090291 Jul 21 22:07:22.932049 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 303/673] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:22 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:07:22.937130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e7a37265-ad7e-466d-a749-9016726f6870 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:22.938075 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e7a37265-ad7e-466d-a749-9016726f6870 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:22.940988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-56143457-d787-4acf-8192-6b2500ce1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:22.942633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-56143457-d787-4acf-8192-6b2500ce1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:22.943904 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-56143457-d787-4acf-8192-6b2500ce1555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.176153 Jul 21 22:07:22.944035 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e7a37265-ad7e-466d-a749-9016726f6870 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:22.944400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e7a37265-ad7e-466d-a749-9016726f6870 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:22.944517 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 371/674] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:22 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:22.945171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e7a37265-ad7e-466d-a749-9016726f6870 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:22.945674 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e7a37265-ad7e-466d-a749-9016726f6870 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:22.974225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e7a37265-ad7e-466d-a749-9016726f6870 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041203 Jul 21 22:07:22.974774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 304/675] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:22 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:23.029679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ecb1f1fd-7bfc-4b89-97f4-111d96daf175 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:23.031250 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ecb1f1fd-7bfc-4b89-97f4-111d96daf175 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:23.040045 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ecb1f1fd-7bfc-4b89-97f4-111d96daf175 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:23.040732 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ecb1f1fd-7bfc-4b89-97f4-111d96daf175 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:23.041911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ecb1f1fd-7bfc-4b89-97f4-111d96daf175 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:23.042587 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ecb1f1fd-7bfc-4b89-97f4-111d96daf175 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:23.085773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ecb1f1fd-7bfc-4b89-97f4-111d96daf175 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060114 Jul 21 22:07:23.086580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 372/676] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:23 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:23.948499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-93e8de56-46a2-4642-ad15-6bc1dbdef38e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:23.949119 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-93e8de56-46a2-4642-ad15-6bc1dbdef38e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:23.956349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-93e8de56-46a2-4642-ad15-6bc1dbdef38e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:23.956799 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-93e8de56-46a2-4642-ad15-6bc1dbdef38e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:23.957565 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-93e8de56-46a2-4642-ad15-6bc1dbdef38e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:23.957998 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-93e8de56-46a2-4642-ad15-6bc1dbdef38e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:23.962667 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-98974e18-4afc-4f98-8266-e6b6c0ca2b21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:23.963456 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-98974e18-4afc-4f98-8266-e6b6c0ca2b21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:23.970602 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-98974e18-4afc-4f98-8266-e6b6c0ca2b21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:23.971090 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-98974e18-4afc-4f98-8266-e6b6c0ca2b21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:23.971889 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-98974e18-4afc-4f98-8266-e6b6c0ca2b21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:23.972331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-98974e18-4afc-4f98-8266-e6b6c0ca2b21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:24.034685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-93e8de56-46a2-4642-ad15-6bc1dbdef38e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:24.043127 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-93e8de56-46a2-4642-ad15-6bc1dbdef38e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.098334 Jul 21 22:07:24.043980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 305/677] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:23 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:24.057406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6d50efa3-2e35-4aee-ac73-124b46221bda tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:24.058366 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6d50efa3-2e35-4aee-ac73-124b46221bda tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:24.066188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6d50efa3-2e35-4aee-ac73-124b46221bda tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:24.066981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6d50efa3-2e35-4aee-ac73-124b46221bda tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:24.067838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6d50efa3-2e35-4aee-ac73-124b46221bda tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:24.068282 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6d50efa3-2e35-4aee-ac73-124b46221bda tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:24.102074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6d50efa3-2e35-4aee-ac73-124b46221bda tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048697 Jul 21 22:07:24.102671 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 306/678] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:24 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:24.111173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4a3302d7-9967-45d5-9992-e13c97e48cd8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:24.112688 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4a3302d7-9967-45d5-9992-e13c97e48cd8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:24.118706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4a3302d7-9967-45d5-9992-e13c97e48cd8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:24.119203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4a3302d7-9967-45d5-9992-e13c97e48cd8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:24.119993 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4a3302d7-9967-45d5-9992-e13c97e48cd8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:24.120433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4a3302d7-9967-45d5-9992-e13c97e48cd8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:24.132710 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-98974e18-4afc-4f98-8266-e6b6c0ca2b21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:24.141632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-98974e18-4afc-4f98-8266-e6b6c0ca2b21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:24.143179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-98974e18-4afc-4f98-8266-e6b6c0ca2b21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:24.144357 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-98974e18-4afc-4f98-8266-e6b6c0ca2b21 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.185824 Jul 21 22:07:24.144915 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 373/679] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:23 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:07:24.150202 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4a3302d7-9967-45d5-9992-e13c97e48cd8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 Jul 21 22:07:24.150760 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 307/680] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:24 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:25.059666 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-25e8db91-e73d-4169-83d8-f02127ad048c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:25.060277 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-25e8db91-e73d-4169-83d8-f02127ad048c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:25.066786 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25e8db91-e73d-4169-83d8-f02127ad048c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:25.067284 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25e8db91-e73d-4169-83d8-f02127ad048c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:25.068037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25e8db91-e73d-4169-83d8-f02127ad048c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:25.068478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25e8db91-e73d-4169-83d8-f02127ad048c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:25.113720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a208f49a-5252-4338-b25b-ae4788429ba2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:25.114633 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a208f49a-5252-4338-b25b-ae4788429ba2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:25.121046 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a208f49a-5252-4338-b25b-ae4788429ba2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:25.121488 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a208f49a-5252-4338-b25b-ae4788429ba2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:25.122251 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a208f49a-5252-4338-b25b-ae4788429ba2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:25.122679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a208f49a-5252-4338-b25b-ae4788429ba2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:25.129536 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-25e8db91-e73d-4169-83d8-f02127ad048c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:25.136819 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-25e8db91-e73d-4169-83d8-f02127ad048c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080951 Jul 21 22:07:25.137363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 374/681] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:25 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:25.151322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a208f49a-5252-4338-b25b-ae4788429ba2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041485 Jul 21 22:07:25.151876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 308/682] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:25 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:25.161669 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7ad1209d-d718-43d1-8df0-2f8ffea22707 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:25.161829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-213c5ec7-4fb6-42df-bef2-3214988d5b97 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:25.162270 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7ad1209d-d718-43d1-8df0-2f8ffea22707 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:25.162834 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-213c5ec7-4fb6-42df-bef2-3214988d5b97 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:25.168186 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ad1209d-d718-43d1-8df0-2f8ffea22707 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:25.168637 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ad1209d-d718-43d1-8df0-2f8ffea22707 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:25.168757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-213c5ec7-4fb6-42df-bef2-3214988d5b97 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:25.169173 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-213c5ec7-4fb6-42df-bef2-3214988d5b97 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:25.169401 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ad1209d-d718-43d1-8df0-2f8ffea22707 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:25.169834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ad1209d-d718-43d1-8df0-2f8ffea22707 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:25.169935 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-213c5ec7-4fb6-42df-bef2-3214988d5b97 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:25.170360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-213c5ec7-4fb6-42df-bef2-3214988d5b97 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:25.200294 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-213c5ec7-4fb6-42df-bef2-3214988d5b97 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042118 Jul 21 22:07:25.200860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 375/683] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:25 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:25.299284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7ad1209d-d718-43d1-8df0-2f8ffea22707 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:25.307590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7ad1209d-d718-43d1-8df0-2f8ffea22707 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:25.309103 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7ad1209d-d718-43d1-8df0-2f8ffea22707 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:25.310309 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7ad1209d-d718-43d1-8df0-2f8ffea22707 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.152136 Jul 21 22:07:25.310806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 309/684] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:25 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:26.153542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-40fb62b9-367c-45c0-a78c-fde8d6b62d03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:26.154190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-40fb62b9-367c-45c0-a78c-fde8d6b62d03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:26.160951 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40fb62b9-367c-45c0-a78c-fde8d6b62d03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:26.161404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40fb62b9-367c-45c0-a78c-fde8d6b62d03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:26.162174 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40fb62b9-367c-45c0-a78c-fde8d6b62d03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:26.162333 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-161d66d1-af0c-4661-88cb-93d34ad0b8c6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:26.162761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40fb62b9-367c-45c0-a78c-fde8d6b62d03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:26.163336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-161d66d1-af0c-4661-88cb-93d34ad0b8c6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:26.169721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-161d66d1-af0c-4661-88cb-93d34ad0b8c6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:26.170168 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-161d66d1-af0c-4661-88cb-93d34ad0b8c6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:26.171452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-161d66d1-af0c-4661-88cb-93d34ad0b8c6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:26.171888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-161d66d1-af0c-4661-88cb-93d34ad0b8c6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:26.201068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-161d66d1-af0c-4661-88cb-93d34ad0b8c6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042488 Jul 21 22:07:26.201634 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 310/685] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:26 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:26.211652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0553ed69-7a26-42b0-bfcd-9c39cf949e7a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:26.212568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0553ed69-7a26-42b0-bfcd-9c39cf949e7a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:26.218684 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0553ed69-7a26-42b0-bfcd-9c39cf949e7a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:26.219172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0553ed69-7a26-42b0-bfcd-9c39cf949e7a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:26.219940 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0553ed69-7a26-42b0-bfcd-9c39cf949e7a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:26.220374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0553ed69-7a26-42b0-bfcd-9c39cf949e7a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:26.227453 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-40fb62b9-367c-45c0-a78c-fde8d6b62d03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:26.235509 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-40fb62b9-367c-45c0-a78c-fde8d6b62d03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.085815 Jul 21 22:07:26.236078 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 376/686] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:26 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:26.251861 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0553ed69-7a26-42b0-bfcd-9c39cf949e7a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044131 Jul 21 22:07:26.252417 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 311/687] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:26 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:26.329005 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d3e7f655-00a9-4e9c-a44e-3e8d1f645466 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:26.329725 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d3e7f655-00a9-4e9c-a44e-3e8d1f645466 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:26.336109 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d3e7f655-00a9-4e9c-a44e-3e8d1f645466 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:26.336564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d3e7f655-00a9-4e9c-a44e-3e8d1f645466 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:26.337331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d3e7f655-00a9-4e9c-a44e-3e8d1f645466 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:26.337771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d3e7f655-00a9-4e9c-a44e-3e8d1f645466 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:26.461834 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d3e7f655-00a9-4e9c-a44e-3e8d1f645466 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:26.470639 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d3e7f655-00a9-4e9c-a44e-3e8d1f645466 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:26.472205 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d3e7f655-00a9-4e9c-a44e-3e8d1f645466 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:26.473362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d3e7f655-00a9-4e9c-a44e-3e8d1f645466 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.148240 Jul 21 22:07:26.473915 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 377/688] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:26 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:27.212655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-efd8930a-927c-4437-8b3d-f552fe753219 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:27.213598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-efd8930a-927c-4437-8b3d-f552fe753219 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:27.219979 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-efd8930a-927c-4437-8b3d-f552fe753219 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:27.220425 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-efd8930a-927c-4437-8b3d-f552fe753219 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:27.221179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-efd8930a-927c-4437-8b3d-f552fe753219 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:27.221609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-efd8930a-927c-4437-8b3d-f552fe753219 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:27.249736 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-efd8930a-927c-4437-8b3d-f552fe753219 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040761 Jul 21 22:07:27.250283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 312/689] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:27 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:27.252392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-944825c5-5886-47d2-ab27-069f5412239a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:27.253003 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-944825c5-5886-47d2-ab27-069f5412239a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:27.259432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-944825c5-5886-47d2-ab27-069f5412239a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:27.259884 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-944825c5-5886-47d2-ab27-069f5412239a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:27.260653 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-944825c5-5886-47d2-ab27-069f5412239a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:27.261089 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-944825c5-5886-47d2-ab27-069f5412239a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:27.262822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-db20c46d-44e5-46f5-8fa6-6c0768cb88a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:27.263760 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-db20c46d-44e5-46f5-8fa6-6c0768cb88a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:27.270098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db20c46d-44e5-46f5-8fa6-6c0768cb88a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:27.270546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db20c46d-44e5-46f5-8fa6-6c0768cb88a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:27.271327 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db20c46d-44e5-46f5-8fa6-6c0768cb88a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:27.271762 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db20c46d-44e5-46f5-8fa6-6c0768cb88a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:27.299877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-db20c46d-44e5-46f5-8fa6-6c0768cb88a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040630 Jul 21 22:07:27.300452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 313/690] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:27 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:27.321956 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-944825c5-5886-47d2-ab27-069f5412239a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:27.329961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-944825c5-5886-47d2-ab27-069f5412239a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081901 Jul 21 22:07:27.330523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 378/691] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:27 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:07:27.491910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4447e892-7b09-4fbc-8437-ea99f25e5968 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:27.492522 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4447e892-7b09-4fbc-8437-ea99f25e5968 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:27.498451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4447e892-7b09-4fbc-8437-ea99f25e5968 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:27.499434 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4447e892-7b09-4fbc-8437-ea99f25e5968 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:27.500197 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4447e892-7b09-4fbc-8437-ea99f25e5968 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:27.500634 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4447e892-7b09-4fbc-8437-ea99f25e5968 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:27.628721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4447e892-7b09-4fbc-8437-ea99f25e5968 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:27.637321 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4447e892-7b09-4fbc-8437-ea99f25e5968 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:27.638903 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4447e892-7b09-4fbc-8437-ea99f25e5968 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:27.640031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4447e892-7b09-4fbc-8437-ea99f25e5968 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151997 Jul 21 22:07:27.640582 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 314/692] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:27 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:28.261221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f36bb68c-b13e-43ba-b9bd-d083adc4b019 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:28.262187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f36bb68c-b13e-43ba-b9bd-d083adc4b019 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:28.268594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f36bb68c-b13e-43ba-b9bd-d083adc4b019 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:28.269049 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f36bb68c-b13e-43ba-b9bd-d083adc4b019 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:28.269821 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f36bb68c-b13e-43ba-b9bd-d083adc4b019 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:28.270257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f36bb68c-b13e-43ba-b9bd-d083adc4b019 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:28.299286 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f36bb68c-b13e-43ba-b9bd-d083adc4b019 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041977 Jul 21 22:07:28.299853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 379/693] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:28 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:28.312257 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-25852a75-87c5-4455-b28a-44e1688cd742 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:28.313187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-25852a75-87c5-4455-b28a-44e1688cd742 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:28.319571 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-25852a75-87c5-4455-b28a-44e1688cd742 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:28.320026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-25852a75-87c5-4455-b28a-44e1688cd742 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:28.320787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-25852a75-87c5-4455-b28a-44e1688cd742 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:28.321227 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-25852a75-87c5-4455-b28a-44e1688cd742 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:28.341190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:07:28.346893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-206c66c8-e4a3-4b12-b44d-775d6f73f572 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:28.347523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-206c66c8-e4a3-4b12-b44d-775d6f73f572 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:28.354124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-206c66c8-e4a3-4b12-b44d-775d6f73f572 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:28.354578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-206c66c8-e4a3-4b12-b44d-775d6f73f572 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:28.355372 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-206c66c8-e4a3-4b12-b44d-775d6f73f572 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:28.355803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-206c66c8-e4a3-4b12-b44d-775d6f73f572 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:28.358765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-25852a75-87c5-4455-b28a-44e1688cd742 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050357 Jul 21 22:07:28.359449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 315/694] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:28 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:28.420463 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-206c66c8-e4a3-4b12-b44d-775d6f73f572 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:28.427802 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-206c66c8-e4a3-4b12-b44d-775d6f73f572 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.085793 Jul 21 22:07:28.428374 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 380/695] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:28 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:07:28.658172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3ef4659c-a84f-46b5-bba1-94f66d15b7c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:28.658778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3ef4659c-a84f-46b5-bba1-94f66d15b7c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:28.664748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ef4659c-a84f-46b5-bba1-94f66d15b7c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:28.665222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ef4659c-a84f-46b5-bba1-94f66d15b7c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:28.665967 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ef4659c-a84f-46b5-bba1-94f66d15b7c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:28.666404 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ef4659c-a84f-46b5-bba1-94f66d15b7c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:28.793772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3ef4659c-a84f-46b5-bba1-94f66d15b7c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:28.802045 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3ef4659c-a84f-46b5-bba1-94f66d15b7c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:28.803569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3ef4659c-a84f-46b5-bba1-94f66d15b7c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:28.804737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3ef4659c-a84f-46b5-bba1-94f66d15b7c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151072 Jul 21 22:07:28.805290 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 316/696] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:28 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:29.310838 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d689977b-cbbb-4457-935a-e0d90a973e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:29.311793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d689977b-cbbb-4457-935a-e0d90a973e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:29.318820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d689977b-cbbb-4457-935a-e0d90a973e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:29.319313 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d689977b-cbbb-4457-935a-e0d90a973e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:29.320087 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d689977b-cbbb-4457-935a-e0d90a973e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:29.320528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d689977b-cbbb-4457-935a-e0d90a973e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:29.349001 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d689977b-cbbb-4457-935a-e0d90a973e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042134 Jul 21 22:07:29.349547 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 381/697] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:29 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:29.369597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-46603cba-0438-4e77-bb09-cc6f4b083be6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:29.370694 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-46603cba-0438-4e77-bb09-cc6f4b083be6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:29.377797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-46603cba-0438-4e77-bb09-cc6f4b083be6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:29.378250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-46603cba-0438-4e77-bb09-cc6f4b083be6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:29.379039 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-46603cba-0438-4e77-bb09-cc6f4b083be6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:29.379469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-46603cba-0438-4e77-bb09-cc6f4b083be6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:29.407520 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-46603cba-0438-4e77-bb09-cc6f4b083be6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041822 Jul 21 22:07:29.408058 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 317/698] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:29 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:29.443988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a755e43d-2dcd-48b9-9e8f-0b9d56756071 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:29.444597 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a755e43d-2dcd-48b9-9e8f-0b9d56756071 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:29.450629 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a755e43d-2dcd-48b9-9e8f-0b9d56756071 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:29.451106 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a755e43d-2dcd-48b9-9e8f-0b9d56756071 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:29.451865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a755e43d-2dcd-48b9-9e8f-0b9d56756071 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:29.452295 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a755e43d-2dcd-48b9-9e8f-0b9d56756071 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:29.517308 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a755e43d-2dcd-48b9-9e8f-0b9d56756071 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:29.524766 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a755e43d-2dcd-48b9-9e8f-0b9d56756071 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.084554 Jul 21 22:07:29.525331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 382/699] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:29 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:29.823070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-76d7eaee-c5d9-45c9-944b-b932def59da0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:29.823683 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-76d7eaee-c5d9-45c9-944b-b932def59da0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:29.829864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-76d7eaee-c5d9-45c9-944b-b932def59da0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:29.830310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-76d7eaee-c5d9-45c9-944b-b932def59da0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:29.831098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-76d7eaee-c5d9-45c9-944b-b932def59da0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:29.831536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-76d7eaee-c5d9-45c9-944b-b932def59da0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:29.956514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-76d7eaee-c5d9-45c9-944b-b932def59da0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:29.965150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-76d7eaee-c5d9-45c9-944b-b932def59da0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:29.966651 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-76d7eaee-c5d9-45c9-944b-b932def59da0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:29.967819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-76d7eaee-c5d9-45c9-944b-b932def59da0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.148645 Jul 21 22:07:29.968375 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 318/700] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:29 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:30.361251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8820f4b6-4d8b-4c7a-aa97-73c037b420a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:30.362169 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8820f4b6-4d8b-4c7a-aa97-73c037b420a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:30.368657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8820f4b6-4d8b-4c7a-aa97-73c037b420a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:30.369101 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8820f4b6-4d8b-4c7a-aa97-73c037b420a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:30.369861 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8820f4b6-4d8b-4c7a-aa97-73c037b420a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:30.370320 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8820f4b6-4d8b-4c7a-aa97-73c037b420a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:30.398074 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8820f4b6-4d8b-4c7a-aa97-73c037b420a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 Jul 21 22:07:30.398629 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 383/701] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:30 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:30.419099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0534a229-219b-472d-a439-914e0e2b8695 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:30.420042 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0534a229-219b-472d-a439-914e0e2b8695 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:30.427395 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0534a229-219b-472d-a439-914e0e2b8695 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:30.427845 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0534a229-219b-472d-a439-914e0e2b8695 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:30.428618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0534a229-219b-472d-a439-914e0e2b8695 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:30.429051 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0534a229-219b-472d-a439-914e0e2b8695 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:30.458850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0534a229-219b-472d-a439-914e0e2b8695 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Jul 21 22:07:30.459432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 319/702] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:30 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:30.541442 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-73b75dfc-24d6-471d-84e7-c764e63ed589 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:30.542053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-73b75dfc-24d6-471d-84e7-c764e63ed589 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:30.548354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73b75dfc-24d6-471d-84e7-c764e63ed589 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:30.548806 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73b75dfc-24d6-471d-84e7-c764e63ed589 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:30.549571 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73b75dfc-24d6-471d-84e7-c764e63ed589 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:30.550011 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73b75dfc-24d6-471d-84e7-c764e63ed589 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:30.609423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-73b75dfc-24d6-471d-84e7-c764e63ed589 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:30.616877 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-73b75dfc-24d6-471d-84e7-c764e63ed589 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079197 Jul 21 22:07:30.617385 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 384/703] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:30 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:30.986234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ccb05248-43a8-4382-b107-1340350b1a73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:30.986839 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ccb05248-43a8-4382-b107-1340350b1a73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:30.992903 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccb05248-43a8-4382-b107-1340350b1a73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:30.993349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccb05248-43a8-4382-b107-1340350b1a73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:30.994113 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccb05248-43a8-4382-b107-1340350b1a73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:30.994545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccb05248-43a8-4382-b107-1340350b1a73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:31.125576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ccb05248-43a8-4382-b107-1340350b1a73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:31.133896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ccb05248-43a8-4382-b107-1340350b1a73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:31.135436 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ccb05248-43a8-4382-b107-1340350b1a73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:31.136575 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ccb05248-43a8-4382-b107-1340350b1a73 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.154824 Jul 21 22:07:31.137132 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 320/704] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:30 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:07:31.409988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9486145c-3fc9-496b-9585-2083db91de8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:31.410939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9486145c-3fc9-496b-9585-2083db91de8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:31.417315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9486145c-3fc9-496b-9585-2083db91de8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:31.417761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9486145c-3fc9-496b-9585-2083db91de8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:31.418515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9486145c-3fc9-496b-9585-2083db91de8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:31.418947 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9486145c-3fc9-496b-9585-2083db91de8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:31.422560 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:07:31.447264 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9486145c-3fc9-496b-9585-2083db91de8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041751 Jul 21 22:07:31.447815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 385/705] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:31 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:31.470269 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8308af32-3a5a-448d-89e3-fde04d1cfa5c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:31.471244 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8308af32-3a5a-448d-89e3-fde04d1cfa5c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:31.477662 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8308af32-3a5a-448d-89e3-fde04d1cfa5c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:31.478113 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8308af32-3a5a-448d-89e3-fde04d1cfa5c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:31.478876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8308af32-3a5a-448d-89e3-fde04d1cfa5c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:31.479339 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8308af32-3a5a-448d-89e3-fde04d1cfa5c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:31.507649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8308af32-3a5a-448d-89e3-fde04d1cfa5c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041885 Jul 21 22:07:31.508202 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 321/706] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:31 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:31.632966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cb94a180-e698-4ed3-831c-12ee7ee881c4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:31.633604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cb94a180-e698-4ed3-831c-12ee7ee881c4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:31.639515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cb94a180-e698-4ed3-831c-12ee7ee881c4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:31.639970 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cb94a180-e698-4ed3-831c-12ee7ee881c4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:31.641233 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cb94a180-e698-4ed3-831c-12ee7ee881c4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:31.641674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cb94a180-e698-4ed3-831c-12ee7ee881c4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:31.701523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cb94a180-e698-4ed3-831c-12ee7ee881c4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:31.710766 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cb94a180-e698-4ed3-831c-12ee7ee881c4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081380 Jul 21 22:07:31.711361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 386/707] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:31 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:32.154787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f6c941b9-3fe3-4692-ac3c-33ceab302c39 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:32.155414 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f6c941b9-3fe3-4692-ac3c-33ceab302c39 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:32.161559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f6c941b9-3fe3-4692-ac3c-33ceab302c39 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:32.162000 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f6c941b9-3fe3-4692-ac3c-33ceab302c39 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:32.162768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f6c941b9-3fe3-4692-ac3c-33ceab302c39 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:32.163229 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f6c941b9-3fe3-4692-ac3c-33ceab302c39 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:32.288786 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f6c941b9-3fe3-4692-ac3c-33ceab302c39 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:32.297992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f6c941b9-3fe3-4692-ac3c-33ceab302c39 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:32.299540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f6c941b9-3fe3-4692-ac3c-33ceab302c39 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:32.300716 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f6c941b9-3fe3-4692-ac3c-33ceab302c39 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.149811 Jul 21 22:07:32.301279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 322/708] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:32 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:32.458529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fa551ed4-1cba-48d0-820b-93ebde50b8f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:32.459408 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fa551ed4-1cba-48d0-820b-93ebde50b8f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:32.466632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fa551ed4-1cba-48d0-820b-93ebde50b8f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:32.467119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fa551ed4-1cba-48d0-820b-93ebde50b8f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:32.467912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fa551ed4-1cba-48d0-820b-93ebde50b8f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:32.468344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fa551ed4-1cba-48d0-820b-93ebde50b8f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:32.498079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fa551ed4-1cba-48d0-820b-93ebde50b8f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043566 Jul 21 22:07:32.498645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 387/709] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:32 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:32.519704 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-65ea7a56-5a7d-4111-88c9-b4d6f40bc9e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:32.520643 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-65ea7a56-5a7d-4111-88c9-b4d6f40bc9e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:32.527128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-65ea7a56-5a7d-4111-88c9-b4d6f40bc9e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:32.527582 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-65ea7a56-5a7d-4111-88c9-b4d6f40bc9e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:32.528353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-65ea7a56-5a7d-4111-88c9-b4d6f40bc9e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:32.528792 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-65ea7a56-5a7d-4111-88c9-b4d6f40bc9e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:32.557104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-65ea7a56-5a7d-4111-88c9-b4d6f40bc9e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042268 Jul 21 22:07:32.557658 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 323/710] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:32 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:32.727322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0d921599-c58e-4418-b26f-d90c7f17364d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:32.727890 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0d921599-c58e-4418-b26f-d90c7f17364d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:32.733917 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d921599-c58e-4418-b26f-d90c7f17364d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:32.734365 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d921599-c58e-4418-b26f-d90c7f17364d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:32.735160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d921599-c58e-4418-b26f-d90c7f17364d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:32.735601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d921599-c58e-4418-b26f-d90c7f17364d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:32.798565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0d921599-c58e-4418-b26f-d90c7f17364d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:32.806140 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0d921599-c58e-4418-b26f-d90c7f17364d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082716 Jul 21 22:07:32.806713 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 388/711] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:32 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:33.318931 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-de3eb1b2-8820-47c7-9f6f-a67280f47ad8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:33.319562 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-de3eb1b2-8820-47c7-9f6f-a67280f47ad8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:33.325524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de3eb1b2-8820-47c7-9f6f-a67280f47ad8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:33.325967 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de3eb1b2-8820-47c7-9f6f-a67280f47ad8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:33.326719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de3eb1b2-8820-47c7-9f6f-a67280f47ad8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:33.327184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de3eb1b2-8820-47c7-9f6f-a67280f47ad8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:33.451681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-de3eb1b2-8820-47c7-9f6f-a67280f47ad8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:33.460757 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-de3eb1b2-8820-47c7-9f6f-a67280f47ad8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:33.462270 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-de3eb1b2-8820-47c7-9f6f-a67280f47ad8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:33.463437 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-de3eb1b2-8820-47c7-9f6f-a67280f47ad8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.148464 Jul 21 22:07:33.463995 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 324/712] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:33 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:33.509352 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bac2c86d-408b-444d-a382-c94223f5ecdf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:33.510275 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bac2c86d-408b-444d-a382-c94223f5ecdf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:33.517299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bac2c86d-408b-444d-a382-c94223f5ecdf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:33.517742 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bac2c86d-408b-444d-a382-c94223f5ecdf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:33.518505 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bac2c86d-408b-444d-a382-c94223f5ecdf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:33.518948 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bac2c86d-408b-444d-a382-c94223f5ecdf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:33.546820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bac2c86d-408b-444d-a382-c94223f5ecdf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041453 Jul 21 22:07:33.547893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 389/713] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:33 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:33.568555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-452a4376-b226-40c2-b031-2dd9ede764c0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:33.569531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-452a4376-b226-40c2-b031-2dd9ede764c0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:33.575868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-452a4376-b226-40c2-b031-2dd9ede764c0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:33.576319 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-452a4376-b226-40c2-b031-2dd9ede764c0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:33.577079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-452a4376-b226-40c2-b031-2dd9ede764c0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:33.577514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-452a4376-b226-40c2-b031-2dd9ede764c0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:33.605893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-452a4376-b226-40c2-b031-2dd9ede764c0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041190 Jul 21 22:07:33.606482 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 325/714] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:33 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:33.823256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-73e49b42-4189-44d9-8e6b-79521d7d5411 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:33.823821 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-73e49b42-4189-44d9-8e6b-79521d7d5411 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:33.829777 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73e49b42-4189-44d9-8e6b-79521d7d5411 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:33.830230 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73e49b42-4189-44d9-8e6b-79521d7d5411 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:33.831027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73e49b42-4189-44d9-8e6b-79521d7d5411 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:33.831471 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73e49b42-4189-44d9-8e6b-79521d7d5411 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:33.895702 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-73e49b42-4189-44d9-8e6b-79521d7d5411 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:33.903163 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-73e49b42-4189-44d9-8e6b-79521d7d5411 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083841 Jul 21 22:07:33.903726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 390/715] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:33 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:34.481693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dd45f5ac-263b-47cd-9f78-9813aaf11519 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:34.482327 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dd45f5ac-263b-47cd-9f78-9813aaf11519 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:34.488343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dd45f5ac-263b-47cd-9f78-9813aaf11519 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:34.488786 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dd45f5ac-263b-47cd-9f78-9813aaf11519 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:34.489546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dd45f5ac-263b-47cd-9f78-9813aaf11519 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:34.489978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dd45f5ac-263b-47cd-9f78-9813aaf11519 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:34.557832 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-555b4e0a-bc24-4b26-b15e-263066093492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:34.558783 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-555b4e0a-bc24-4b26-b15e-263066093492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:34.565865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-555b4e0a-bc24-4b26-b15e-263066093492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:34.566311 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-555b4e0a-bc24-4b26-b15e-263066093492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:34.567113 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-555b4e0a-bc24-4b26-b15e-263066093492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:34.567549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-555b4e0a-bc24-4b26-b15e-263066093492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:34.596321 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-555b4e0a-bc24-4b26-b15e-263066093492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042348 Jul 21 22:07:34.596892 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 391/716] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:34 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:34.617609 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-00bcad42-ac8b-4234-bbea-3ab92d5860b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:34.618541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-00bcad42-ac8b-4234-bbea-3ab92d5860b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:34.623416 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dd45f5ac-263b-47cd-9f78-9813aaf11519 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:34.624640 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00bcad42-ac8b-4234-bbea-3ab92d5860b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:34.625181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00bcad42-ac8b-4234-bbea-3ab92d5860b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:34.626524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00bcad42-ac8b-4234-bbea-3ab92d5860b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:34.626963 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00bcad42-ac8b-4234-bbea-3ab92d5860b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:34.634190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dd45f5ac-263b-47cd-9f78-9813aaf11519 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:34.635727 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dd45f5ac-263b-47cd-9f78-9813aaf11519 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:34.636869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dd45f5ac-263b-47cd-9f78-9813aaf11519 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.159069 Jul 21 22:07:34.637425 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 326/717] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:34 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:34.655561 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-00bcad42-ac8b-4234-bbea-3ab92d5860b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041770 Jul 21 22:07:34.656133 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 392/718] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:34 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:34.919737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9ab8f20c-2802-459f-8949-b2cd823b073e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:34.920344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9ab8f20c-2802-459f-8949-b2cd823b073e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:34.926993 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ab8f20c-2802-459f-8949-b2cd823b073e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:34.927479 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ab8f20c-2802-459f-8949-b2cd823b073e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:34.928255 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ab8f20c-2802-459f-8949-b2cd823b073e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:34.928691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ab8f20c-2802-459f-8949-b2cd823b073e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:34.988301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9ab8f20c-2802-459f-8949-b2cd823b073e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:34.995808 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9ab8f20c-2802-459f-8949-b2cd823b073e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079923 Jul 21 22:07:34.996360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 327/719] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:34 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:35.607524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f0bcc991-43f5-4569-b7d3-6390a57257b8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:35.608444 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f0bcc991-43f5-4569-b7d3-6390a57257b8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:35.615562 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0bcc991-43f5-4569-b7d3-6390a57257b8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:35.616013 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0bcc991-43f5-4569-b7d3-6390a57257b8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:35.616777 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0bcc991-43f5-4569-b7d3-6390a57257b8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:35.617216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0bcc991-43f5-4569-b7d3-6390a57257b8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:35.644768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f0bcc991-43f5-4569-b7d3-6390a57257b8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041176 Jul 21 22:07:35.645328 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 393/720] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:35 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:35.654905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c9a0eb7e-30ab-4244-a292-fae5111a7fc8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:35.655544 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c9a0eb7e-30ab-4244-a292-fae5111a7fc8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:35.662360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c9a0eb7e-30ab-4244-a292-fae5111a7fc8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:35.662807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c9a0eb7e-30ab-4244-a292-fae5111a7fc8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:35.663596 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c9a0eb7e-30ab-4244-a292-fae5111a7fc8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:35.664024 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c9a0eb7e-30ab-4244-a292-fae5111a7fc8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:35.667577 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-287dd3da-4226-4c4f-b9e2-699c9646a8c1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:35.668494 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-287dd3da-4226-4c4f-b9e2-699c9646a8c1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:35.674981 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-287dd3da-4226-4c4f-b9e2-699c9646a8c1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:35.675466 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-287dd3da-4226-4c4f-b9e2-699c9646a8c1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:35.676237 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-287dd3da-4226-4c4f-b9e2-699c9646a8c1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:35.676675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-287dd3da-4226-4c4f-b9e2-699c9646a8c1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:35.705813 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-287dd3da-4226-4c4f-b9e2-699c9646a8c1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041891 Jul 21 22:07:35.706393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 394/721] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:35 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:35.790787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c9a0eb7e-30ab-4244-a292-fae5111a7fc8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:35.799213 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c9a0eb7e-30ab-4244-a292-fae5111a7fc8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:35.800724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c9a0eb7e-30ab-4244-a292-fae5111a7fc8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:35.801872 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c9a0eb7e-30ab-4244-a292-fae5111a7fc8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.150833 Jul 21 22:07:35.802439 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 328/722] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:35 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:36.012271 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1a4a7f9e-c41f-420f-95ca-a980417f3e03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:36.012807 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1a4a7f9e-c41f-420f-95ca-a980417f3e03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:36.019320 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a4a7f9e-c41f-420f-95ca-a980417f3e03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:36.019773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a4a7f9e-c41f-420f-95ca-a980417f3e03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:36.020540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a4a7f9e-c41f-420f-95ca-a980417f3e03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:36.020980 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a4a7f9e-c41f-420f-95ca-a980417f3e03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:36.084629 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1a4a7f9e-c41f-420f-95ca-a980417f3e03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:36.092309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1a4a7f9e-c41f-420f-95ca-a980417f3e03 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083979 Jul 21 22:07:36.092873 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 395/723] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:36 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:36.656203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c1038959-6b49-4991-b59a-3569bcbe299d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:36.657119 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c1038959-6b49-4991-b59a-3569bcbe299d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:36.663737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1038959-6b49-4991-b59a-3569bcbe299d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:36.664192 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1038959-6b49-4991-b59a-3569bcbe299d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:36.664965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1038959-6b49-4991-b59a-3569bcbe299d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:36.665409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1038959-6b49-4991-b59a-3569bcbe299d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:36.694341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c1038959-6b49-4991-b59a-3569bcbe299d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042008 Jul 21 22:07:36.695146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 329/724] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:36 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:36.717364 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8867fc16-39af-484c-8154-34a93dc28d2c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:36.718349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8867fc16-39af-484c-8154-34a93dc28d2c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:36.728002 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8867fc16-39af-484c-8154-34a93dc28d2c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:36.728526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8867fc16-39af-484c-8154-34a93dc28d2c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:36.729613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8867fc16-39af-484c-8154-34a93dc28d2c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:36.730336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8867fc16-39af-484c-8154-34a93dc28d2c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:36.761051 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8867fc16-39af-484c-8154-34a93dc28d2c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047527 Jul 21 22:07:36.761530 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 396/725] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:36 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:36.820038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-facaadda-89bb-48ac-9383-7ed8232cc356 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:36.820638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-facaadda-89bb-48ac-9383-7ed8232cc356 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:36.826627 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-facaadda-89bb-48ac-9383-7ed8232cc356 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:36.827096 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-facaadda-89bb-48ac-9383-7ed8232cc356 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:36.827858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-facaadda-89bb-48ac-9383-7ed8232cc356 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:36.828303 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-facaadda-89bb-48ac-9383-7ed8232cc356 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:36.953807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-facaadda-89bb-48ac-9383-7ed8232cc356 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:36.962407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-facaadda-89bb-48ac-9383-7ed8232cc356 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:36.963983 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-facaadda-89bb-48ac-9383-7ed8232cc356 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:36.965124 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-facaadda-89bb-48ac-9383-7ed8232cc356 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.148943 Jul 21 22:07:36.965680 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 330/726] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:36 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:37.109339 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cdeaab22-9f47-4c78-84ec-ff9c772c6be7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:37.110471 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cdeaab22-9f47-4c78-84ec-ff9c772c6be7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:37.116411 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdeaab22-9f47-4c78-84ec-ff9c772c6be7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:37.116865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdeaab22-9f47-4c78-84ec-ff9c772c6be7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:37.117633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdeaab22-9f47-4c78-84ec-ff9c772c6be7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:37.118074 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdeaab22-9f47-4c78-84ec-ff9c772c6be7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:37.178125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cdeaab22-9f47-4c78-84ec-ff9c772c6be7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:37.185590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cdeaab22-9f47-4c78-84ec-ff9c772c6be7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080148 Jul 21 22:07:37.186158 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 397/727] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:37 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:37.706366 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-607a967a-7713-442b-a279-5ff71c49abc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:37.707301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-607a967a-7713-442b-a279-5ff71c49abc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:37.713956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-607a967a-7713-442b-a279-5ff71c49abc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:37.714391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-607a967a-7713-442b-a279-5ff71c49abc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:37.715189 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-607a967a-7713-442b-a279-5ff71c49abc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:37.715613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-607a967a-7713-442b-a279-5ff71c49abc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:37.742937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-607a967a-7713-442b-a279-5ff71c49abc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041041 Jul 21 22:07:37.743445 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 331/728] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:37 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:37.773065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-be34ac80-c513-4d44-994d-f39eb213ec4c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:37.773988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-be34ac80-c513-4d44-994d-f39eb213ec4c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:37.780085 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be34ac80-c513-4d44-994d-f39eb213ec4c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:37.780546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be34ac80-c513-4d44-994d-f39eb213ec4c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:37.781353 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be34ac80-c513-4d44-994d-f39eb213ec4c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:37.781794 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be34ac80-c513-4d44-994d-f39eb213ec4c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:37.809783 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-be34ac80-c513-4d44-994d-f39eb213ec4c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040699 Jul 21 22:07:37.810334 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 398/729] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:37 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:37.983823 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-31d8e3d3-e0f8-4bf2-a521-ceb1dbbf556a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:37.984451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-31d8e3d3-e0f8-4bf2-a521-ceb1dbbf556a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:37.990304 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31d8e3d3-e0f8-4bf2-a521-ceb1dbbf556a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:37.990751 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31d8e3d3-e0f8-4bf2-a521-ceb1dbbf556a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:37.991547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31d8e3d3-e0f8-4bf2-a521-ceb1dbbf556a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:37.991980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31d8e3d3-e0f8-4bf2-a521-ceb1dbbf556a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:37.995939 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:07:38.121997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-31d8e3d3-e0f8-4bf2-a521-ceb1dbbf556a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:38.130963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-31d8e3d3-e0f8-4bf2-a521-ceb1dbbf556a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:38.132511 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-31d8e3d3-e0f8-4bf2-a521-ceb1dbbf556a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:38.133663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-31d8e3d3-e0f8-4bf2-a521-ceb1dbbf556a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.153785 Jul 21 22:07:38.134234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 332/730] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:37 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:38.201705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fb5f712c-299f-4d8a-8683-fb777b61e50a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:38.202481 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fb5f712c-299f-4d8a-8683-fb777b61e50a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:38.212336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb5f712c-299f-4d8a-8683-fb777b61e50a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:38.213014 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb5f712c-299f-4d8a-8683-fb777b61e50a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:38.214195 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb5f712c-299f-4d8a-8683-fb777b61e50a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:38.214868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb5f712c-299f-4d8a-8683-fb777b61e50a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:38.289069 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fb5f712c-299f-4d8a-8683-fb777b61e50a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:38.296544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fb5f712c-299f-4d8a-8683-fb777b61e50a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.098762 Jul 21 22:07:38.297111 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 399/731] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:38 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:38.754498 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2f12d251-35e8-4180-a6d4-6a9856ae1bd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:38.755444 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2f12d251-35e8-4180-a6d4-6a9856ae1bd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:38.761936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2f12d251-35e8-4180-a6d4-6a9856ae1bd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:38.762388 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2f12d251-35e8-4180-a6d4-6a9856ae1bd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:38.763180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2f12d251-35e8-4180-a6d4-6a9856ae1bd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:38.763619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2f12d251-35e8-4180-a6d4-6a9856ae1bd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:38.793027 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2f12d251-35e8-4180-a6d4-6a9856ae1bd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042435 Jul 21 22:07:38.793576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 333/732] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:38 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:38.821236 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-879fddd2-66f0-4b35-a6b1-d487b3233e9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:38.822179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-879fddd2-66f0-4b35-a6b1-d487b3233e9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:38.828117 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-879fddd2-66f0-4b35-a6b1-d487b3233e9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:38.828564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-879fddd2-66f0-4b35-a6b1-d487b3233e9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:38.829810 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-879fddd2-66f0-4b35-a6b1-d487b3233e9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:38.830247 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-879fddd2-66f0-4b35-a6b1-d487b3233e9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:38.858611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-879fddd2-66f0-4b35-a6b1-d487b3233e9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041344 Jul 21 22:07:38.859170 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 400/733] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:38 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:39.151727 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-67e911e4-82b7-4792-967e-3c0f969ef1e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:39.152341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-67e911e4-82b7-4792-967e-3c0f969ef1e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:39.158346 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-67e911e4-82b7-4792-967e-3c0f969ef1e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:39.158797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-67e911e4-82b7-4792-967e-3c0f969ef1e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:39.159606 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-67e911e4-82b7-4792-967e-3c0f969ef1e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:39.160048 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-67e911e4-82b7-4792-967e-3c0f969ef1e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:39.287837 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-67e911e4-82b7-4792-967e-3c0f969ef1e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:39.296080 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-67e911e4-82b7-4792-967e-3c0f969ef1e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:39.297592 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-67e911e4-82b7-4792-967e-3c0f969ef1e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:39.298762 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-67e911e4-82b7-4792-967e-3c0f969ef1e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.150910 Jul 21 22:07:39.299369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 334/734] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:39 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:39.313351 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-33017718-3409-44d8-bc12-308c1ef1fdd5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:39.314446 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-33017718-3409-44d8-bc12-308c1ef1fdd5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:39.320868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-33017718-3409-44d8-bc12-308c1ef1fdd5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:39.321399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-33017718-3409-44d8-bc12-308c1ef1fdd5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:39.322160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-33017718-3409-44d8-bc12-308c1ef1fdd5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:39.322591 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-33017718-3409-44d8-bc12-308c1ef1fdd5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:39.385119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-33017718-3409-44d8-bc12-308c1ef1fdd5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:39.388407 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:07:39.393650 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-33017718-3409-44d8-bc12-308c1ef1fdd5 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.084079 Jul 21 22:07:39.394213 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 401/735] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:39 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:39.596279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:07:39.596470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:07:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:07:39.804043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e6d8f6e9-f711-468f-8393-64dfb7c050b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:39.804952 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e6d8f6e9-f711-468f-8393-64dfb7c050b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:39.811341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e6d8f6e9-f711-468f-8393-64dfb7c050b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:39.811787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e6d8f6e9-f711-468f-8393-64dfb7c050b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:39.812542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e6d8f6e9-f711-468f-8393-64dfb7c050b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:39.812968 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e6d8f6e9-f711-468f-8393-64dfb7c050b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:39.841653 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e6d8f6e9-f711-468f-8393-64dfb7c050b2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041506 Jul 21 22:07:39.842364 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 335/736] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:39 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:39.869671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0650b0b4-2939-48ab-85e3-8cd03d892f2d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:39.870593 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0650b0b4-2939-48ab-85e3-8cd03d892f2d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:39.877499 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0650b0b4-2939-48ab-85e3-8cd03d892f2d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:39.877955 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0650b0b4-2939-48ab-85e3-8cd03d892f2d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:39.878726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0650b0b4-2939-48ab-85e3-8cd03d892f2d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:39.879203 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0650b0b4-2939-48ab-85e3-8cd03d892f2d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:39.907657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0650b0b4-2939-48ab-85e3-8cd03d892f2d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041930 Jul 21 22:07:39.908217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 402/737] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:39 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:40.317435 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f2021129-c730-4a34-a12d-84863f4c1aed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:40.318040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f2021129-c730-4a34-a12d-84863f4c1aed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:40.324000 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2021129-c730-4a34-a12d-84863f4c1aed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:40.324440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2021129-c730-4a34-a12d-84863f4c1aed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:40.325194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2021129-c730-4a34-a12d-84863f4c1aed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:40.325623 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2021129-c730-4a34-a12d-84863f4c1aed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:40.409857 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2cadd0a5-af5d-4a63-b3a9-2f1c0cec40f3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:40.410579 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2cadd0a5-af5d-4a63-b3a9-2f1c0cec40f3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:40.417130 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cadd0a5-af5d-4a63-b3a9-2f1c0cec40f3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:40.417652 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cadd0a5-af5d-4a63-b3a9-2f1c0cec40f3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:40.418537 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cadd0a5-af5d-4a63-b3a9-2f1c0cec40f3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:40.419073 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cadd0a5-af5d-4a63-b3a9-2f1c0cec40f3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:40.450526 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f2021129-c730-4a34-a12d-84863f4c1aed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:40.459076 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f2021129-c730-4a34-a12d-84863f4c1aed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:40.460870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f2021129-c730-4a34-a12d-84863f4c1aed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:40.462054 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f2021129-c730-4a34-a12d-84863f4c1aed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.149090 Jul 21 22:07:40.462817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 336/738] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:40 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:40.481251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2cadd0a5-af5d-4a63-b3a9-2f1c0cec40f3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:40.489342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2cadd0a5-af5d-4a63-b3a9-2f1c0cec40f3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083286 Jul 21 22:07:40.489905 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 403/739] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:40 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:07:40.853777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-89585077-4309-4bc9-b4c6-1562c7f3f628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:40.854695 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-89585077-4309-4bc9-b4c6-1562c7f3f628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:40.861685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-89585077-4309-4bc9-b4c6-1562c7f3f628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:40.862131 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-89585077-4309-4bc9-b4c6-1562c7f3f628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:40.862892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-89585077-4309-4bc9-b4c6-1562c7f3f628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:40.863463 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-89585077-4309-4bc9-b4c6-1562c7f3f628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:40.893186 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-89585077-4309-4bc9-b4c6-1562c7f3f628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 Jul 21 22:07:40.893738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 337/740] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:40 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:40.919211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-405654a6-f556-48d7-a511-b63cf2efa372 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:40.920137 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-405654a6-f556-48d7-a511-b63cf2efa372 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:40.926819 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-405654a6-f556-48d7-a511-b63cf2efa372 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:40.927337 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-405654a6-f556-48d7-a511-b63cf2efa372 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:40.928101 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-405654a6-f556-48d7-a511-b63cf2efa372 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:40.928537 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-405654a6-f556-48d7-a511-b63cf2efa372 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:40.956147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-405654a6-f556-48d7-a511-b63cf2efa372 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040864 Jul 21 22:07:40.956705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 404/741] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:40 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:41.480241 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ce586186-f4e6-4f58-9b9e-c89a1f38c7a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:41.480840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ce586186-f4e6-4f58-9b9e-c89a1f38c7a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:41.486949 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ce586186-f4e6-4f58-9b9e-c89a1f38c7a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:41.487420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ce586186-f4e6-4f58-9b9e-c89a1f38c7a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:41.488177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ce586186-f4e6-4f58-9b9e-c89a1f38c7a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:41.488605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ce586186-f4e6-4f58-9b9e-c89a1f38c7a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:41.506114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b36621da-dd42-49e8-9b64-dc792a442689 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:41.506726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b36621da-dd42-49e8-9b64-dc792a442689 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:41.513066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b36621da-dd42-49e8-9b64-dc792a442689 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:41.513515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b36621da-dd42-49e8-9b64-dc792a442689 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:41.514281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b36621da-dd42-49e8-9b64-dc792a442689 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:41.514718 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b36621da-dd42-49e8-9b64-dc792a442689 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:41.583979 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b36621da-dd42-49e8-9b64-dc792a442689 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:41.592765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b36621da-dd42-49e8-9b64-dc792a442689 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.090435 Jul 21 22:07:41.593349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 405/742] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:41 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:07:41.640221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ce586186-f4e6-4f58-9b9e-c89a1f38c7a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:41.649226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ce586186-f4e6-4f58-9b9e-c89a1f38c7a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:41.650734 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ce586186-f4e6-4f58-9b9e-c89a1f38c7a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:41.651900 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ce586186-f4e6-4f58-9b9e-c89a1f38c7a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.175630 Jul 21 22:07:41.652451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 338/743] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:41 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:41.904857 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e1deb055-9add-44a8-a5e7-e1b28a57514b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:41.905815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e1deb055-9add-44a8-a5e7-e1b28a57514b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:41.912472 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e1deb055-9add-44a8-a5e7-e1b28a57514b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:41.912928 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e1deb055-9add-44a8-a5e7-e1b28a57514b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:41.913701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e1deb055-9add-44a8-a5e7-e1b28a57514b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:41.914135 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e1deb055-9add-44a8-a5e7-e1b28a57514b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:41.941967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e1deb055-9add-44a8-a5e7-e1b28a57514b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041039 Jul 21 22:07:41.942615 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 406/744] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:41 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:41.967550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-571c242b-5bcf-4cf6-8519-e01fc0b365fa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:41.968485 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-571c242b-5bcf-4cf6-8519-e01fc0b365fa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:41.975618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-571c242b-5bcf-4cf6-8519-e01fc0b365fa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:41.976061 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-571c242b-5bcf-4cf6-8519-e01fc0b365fa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:41.976811 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-571c242b-5bcf-4cf6-8519-e01fc0b365fa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:41.977237 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-571c242b-5bcf-4cf6-8519-e01fc0b365fa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:42.005060 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-571c242b-5bcf-4cf6-8519-e01fc0b365fa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041371 Jul 21 22:07:42.005597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 339/745] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:41 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:42.609336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-16623c6f-5734-461b-a526-94ce14efa829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:42.609888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-16623c6f-5734-461b-a526-94ce14efa829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:42.616391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-16623c6f-5734-461b-a526-94ce14efa829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:42.616835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-16623c6f-5734-461b-a526-94ce14efa829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:42.617590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-16623c6f-5734-461b-a526-94ce14efa829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:42.618029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-16623c6f-5734-461b-a526-94ce14efa829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:42.669876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-97d641f8-78c1-4139-8b80-332aad647d82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:42.670630 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-97d641f8-78c1-4139-8b80-332aad647d82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:42.676683 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-97d641f8-78c1-4139-8b80-332aad647d82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:42.677132 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-97d641f8-78c1-4139-8b80-332aad647d82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:42.677893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-97d641f8-78c1-4139-8b80-332aad647d82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:42.678257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-16623c6f-5734-461b-a526-94ce14efa829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:42.678389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-97d641f8-78c1-4139-8b80-332aad647d82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:42.686087 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-16623c6f-5734-461b-a526-94ce14efa829 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080699 Jul 21 22:07:42.686683 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 407/746] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:42 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:42.805714 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-97d641f8-78c1-4139-8b80-332aad647d82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:42.814671 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-97d641f8-78c1-4139-8b80-332aad647d82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:42.816201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-97d641f8-78c1-4139-8b80-332aad647d82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:42.817329 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-97d641f8-78c1-4139-8b80-332aad647d82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151304 Jul 21 22:07:42.817885 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 340/747] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:42 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:07:42.953832 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-79083934-9127-4ccf-9982-55e298c955f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:42.954790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-79083934-9127-4ccf-9982-55e298c955f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:42.961125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79083934-9127-4ccf-9982-55e298c955f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:42.961571 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79083934-9127-4ccf-9982-55e298c955f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:42.962333 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79083934-9127-4ccf-9982-55e298c955f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:42.962764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79083934-9127-4ccf-9982-55e298c955f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:42.992843 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-79083934-9127-4ccf-9982-55e298c955f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042901 Jul 21 22:07:42.993401 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 408/748] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:42 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:43.016489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-920d1bbb-e9a0-4980-9416-688d15590558 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:43.017415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-920d1bbb-e9a0-4980-9416-688d15590558 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:43.023786 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-920d1bbb-e9a0-4980-9416-688d15590558 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:43.024240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-920d1bbb-e9a0-4980-9416-688d15590558 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:43.025004 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-920d1bbb-e9a0-4980-9416-688d15590558 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:43.025448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-920d1bbb-e9a0-4980-9416-688d15590558 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:43.054412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-920d1bbb-e9a0-4980-9416-688d15590558 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041869 Jul 21 22:07:43.054956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 341/749] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:43 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:43.702776 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d802e979-838a-4961-a9e3-21260f1fff3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:43.703402 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d802e979-838a-4961-a9e3-21260f1fff3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:43.710330 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d802e979-838a-4961-a9e3-21260f1fff3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:43.711071 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d802e979-838a-4961-a9e3-21260f1fff3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:43.711827 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d802e979-838a-4961-a9e3-21260f1fff3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:43.712257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d802e979-838a-4961-a9e3-21260f1fff3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:43.771567 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d802e979-838a-4961-a9e3-21260f1fff3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:43.778925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d802e979-838a-4961-a9e3-21260f1fff3c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079979 Jul 21 22:07:43.779511 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 409/750] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:43 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:43.836739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-028c6732-b733-4398-a572-f524821bcb5b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:43.837380 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-028c6732-b733-4398-a572-f524821bcb5b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:43.843362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-028c6732-b733-4398-a572-f524821bcb5b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:43.843819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-028c6732-b733-4398-a572-f524821bcb5b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:43.844582 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-028c6732-b733-4398-a572-f524821bcb5b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:43.845020 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-028c6732-b733-4398-a572-f524821bcb5b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:43.969549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-028c6732-b733-4398-a572-f524821bcb5b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:43.977900 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-028c6732-b733-4398-a572-f524821bcb5b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:43.979450 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-028c6732-b733-4398-a572-f524821bcb5b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:43.980600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-028c6732-b733-4398-a572-f524821bcb5b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.148067 Jul 21 22:07:43.981153 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 342/751] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:43 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:44.004793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-17d1c772-d4ba-4b1c-a4c7-cd8a590b3907 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:44.005747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-17d1c772-d4ba-4b1c-a4c7-cd8a590b3907 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:44.007602 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=83 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:07:44.012857 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-17d1c772-d4ba-4b1c-a4c7-cd8a590b3907 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:44.013301 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-17d1c772-d4ba-4b1c-a4c7-cd8a590b3907 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:44.014059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-17d1c772-d4ba-4b1c-a4c7-cd8a590b3907 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:44.014491 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-17d1c772-d4ba-4b1c-a4c7-cd8a590b3907 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:44.043543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-17d1c772-d4ba-4b1c-a4c7-cd8a590b3907 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042745 Jul 21 22:07:44.043999 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 410/752] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:43 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:44.066249 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5df4d463-8175-49a7-8b89-c0399218c46b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:44.067200 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5df4d463-8175-49a7-8b89-c0399218c46b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:44.073615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5df4d463-8175-49a7-8b89-c0399218c46b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:44.074065 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5df4d463-8175-49a7-8b89-c0399218c46b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:44.074864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5df4d463-8175-49a7-8b89-c0399218c46b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:44.075341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5df4d463-8175-49a7-8b89-c0399218c46b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:44.104599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5df4d463-8175-49a7-8b89-c0399218c46b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042852 Jul 21 22:07:44.105145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 343/753] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:44 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:44.796060 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f7878be9-e8df-44bd-a1b6-b709267edb49 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:44.796589 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f7878be9-e8df-44bd-a1b6-b709267edb49 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:44.803580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f7878be9-e8df-44bd-a1b6-b709267edb49 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:44.804030 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f7878be9-e8df-44bd-a1b6-b709267edb49 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:44.804789 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f7878be9-e8df-44bd-a1b6-b709267edb49 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:44.805223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f7878be9-e8df-44bd-a1b6-b709267edb49 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:44.866198 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f7878be9-e8df-44bd-a1b6-b709267edb49 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:44.873561 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f7878be9-e8df-44bd-a1b6-b709267edb49 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081440 Jul 21 22:07:44.874153 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 411/754] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:44 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:44.998413 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-192fc74d-c1de-46bc-8908-1627c9029f9f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:44.999032 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-192fc74d-c1de-46bc-8908-1627c9029f9f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:45.000882 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=89 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:07:45.006111 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-192fc74d-c1de-46bc-8908-1627c9029f9f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:45.006561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-192fc74d-c1de-46bc-8908-1627c9029f9f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:45.007353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-192fc74d-c1de-46bc-8908-1627c9029f9f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:45.007792 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-192fc74d-c1de-46bc-8908-1627c9029f9f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:45.055383 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8f0065ef-ec38-4a96-aa5f-cbe909b97e89 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:45.056388 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8f0065ef-ec38-4a96-aa5f-cbe909b97e89 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:45.062298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f0065ef-ec38-4a96-aa5f-cbe909b97e89 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:45.062745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f0065ef-ec38-4a96-aa5f-cbe909b97e89 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:45.063600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f0065ef-ec38-4a96-aa5f-cbe909b97e89 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:45.064062 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f0065ef-ec38-4a96-aa5f-cbe909b97e89 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:45.094502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8f0065ef-ec38-4a96-aa5f-cbe909b97e89 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043242 Jul 21 22:07:45.095698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 412/755] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:45 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:45.116051 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c4c793b5-779e-416e-b4da-30241620b113 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:45.116985 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c4c793b5-779e-416e-b4da-30241620b113 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:45.122982 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4c793b5-779e-416e-b4da-30241620b113 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:45.123558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4c793b5-779e-416e-b4da-30241620b113 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:45.124341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4c793b5-779e-416e-b4da-30241620b113 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:45.124783 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4c793b5-779e-416e-b4da-30241620b113 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:45.138109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-192fc74d-c1de-46bc-8908-1627c9029f9f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:45.147870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-192fc74d-c1de-46bc-8908-1627c9029f9f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:45.149376 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-192fc74d-c1de-46bc-8908-1627c9029f9f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:45.150520 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-192fc74d-c1de-46bc-8908-1627c9029f9f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.155976 Jul 21 22:07:45.151095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 344/756] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:44 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:45.155037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c4c793b5-779e-416e-b4da-30241620b113 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042834 Jul 21 22:07:45.155602 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 413/757] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:45 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:45.889604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c2230f5f-983b-43f9-9e2d-c42b51f2cd89 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:45.890221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c2230f5f-983b-43f9-9e2d-c42b51f2cd89 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:45.896420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2230f5f-983b-43f9-9e2d-c42b51f2cd89 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:45.896872 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2230f5f-983b-43f9-9e2d-c42b51f2cd89 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:45.897645 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2230f5f-983b-43f9-9e2d-c42b51f2cd89 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:45.898088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2230f5f-983b-43f9-9e2d-c42b51f2cd89 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:45.967115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c2230f5f-983b-43f9-9e2d-c42b51f2cd89 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:45.975410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c2230f5f-983b-43f9-9e2d-c42b51f2cd89 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.089442 Jul 21 22:07:45.986402 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 345/758] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:45 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:46.107289 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0963f97d-1f7c-4ef7-9303-5c03f44b862e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:46.108277 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0963f97d-1f7c-4ef7-9303-5c03f44b862e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:46.115926 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0963f97d-1f7c-4ef7-9303-5c03f44b862e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:46.116374 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0963f97d-1f7c-4ef7-9303-5c03f44b862e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:46.117150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0963f97d-1f7c-4ef7-9303-5c03f44b862e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:46.117595 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0963f97d-1f7c-4ef7-9303-5c03f44b862e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:46.149219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0963f97d-1f7c-4ef7-9303-5c03f44b862e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045885 Jul 21 22:07:46.149952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 414/759] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:46 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:46.165777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-976e740a-247f-4e3f-8cff-2be6338ac26f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:46.167413 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-976e740a-247f-4e3f-8cff-2be6338ac26f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:46.171347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1fc20489-fc09-453b-bf1a-54597f2f5b1d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:46.172100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1fc20489-fc09-453b-bf1a-54597f2f5b1d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:46.174825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-976e740a-247f-4e3f-8cff-2be6338ac26f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:46.175390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-976e740a-247f-4e3f-8cff-2be6338ac26f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:46.176254 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-976e740a-247f-4e3f-8cff-2be6338ac26f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:46.176681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-976e740a-247f-4e3f-8cff-2be6338ac26f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:46.178673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fc20489-fc09-453b-bf1a-54597f2f5b1d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:46.179192 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fc20489-fc09-453b-bf1a-54597f2f5b1d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:46.180083 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fc20489-fc09-453b-bf1a-54597f2f5b1d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:46.180533 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fc20489-fc09-453b-bf1a-54597f2f5b1d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:46.206629 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-976e740a-247f-4e3f-8cff-2be6338ac26f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Jul 21 22:07:46.207459 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 346/760] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:46 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:46.325487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1fc20489-fc09-453b-bf1a-54597f2f5b1d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:46.334469 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1fc20489-fc09-453b-bf1a-54597f2f5b1d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:46.336307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1fc20489-fc09-453b-bf1a-54597f2f5b1d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:46.337467 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1fc20489-fc09-453b-bf1a-54597f2f5b1d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.170052 Jul 21 22:07:46.338023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 415/761] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:46 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:46.995557 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b9e38a00-89ac-4b90-bc7e-52a6ad93fb31 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:46.996195 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b9e38a00-89ac-4b90-bc7e-52a6ad93fb31 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:47.003080 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9e38a00-89ac-4b90-bc7e-52a6ad93fb31 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:47.003527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9e38a00-89ac-4b90-bc7e-52a6ad93fb31 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:47.004284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9e38a00-89ac-4b90-bc7e-52a6ad93fb31 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:47.004719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9e38a00-89ac-4b90-bc7e-52a6ad93fb31 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:47.065009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b9e38a00-89ac-4b90-bc7e-52a6ad93fb31 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:47.072383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b9e38a00-89ac-4b90-bc7e-52a6ad93fb31 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080583 Jul 21 22:07:47.072943 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 347/762] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:46 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:47.160773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fe0e3dad-aa0a-47c2-81b3-cd9fbc2ab7e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:47.161728 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fe0e3dad-aa0a-47c2-81b3-cd9fbc2ab7e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:47.168910 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fe0e3dad-aa0a-47c2-81b3-cd9fbc2ab7e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:47.169363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fe0e3dad-aa0a-47c2-81b3-cd9fbc2ab7e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:47.170358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fe0e3dad-aa0a-47c2-81b3-cd9fbc2ab7e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:47.170877 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fe0e3dad-aa0a-47c2-81b3-cd9fbc2ab7e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:47.200558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fe0e3dad-aa0a-47c2-81b3-cd9fbc2ab7e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Jul 21 22:07:47.201133 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 416/763] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:47 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:47.218667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2beda629-66e0-4814-8d70-7633fd45f7a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:47.219607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2beda629-66e0-4814-8d70-7633fd45f7a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:47.225649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2beda629-66e0-4814-8d70-7633fd45f7a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:47.226098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2beda629-66e0-4814-8d70-7633fd45f7a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:47.226851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2beda629-66e0-4814-8d70-7633fd45f7a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:47.227305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2beda629-66e0-4814-8d70-7633fd45f7a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:47.254407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:07:47.259568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2beda629-66e0-4814-8d70-7633fd45f7a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044253 Jul 21 22:07:47.260132 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 348/764] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:47 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:47.356134 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-39e650f8-8a68-47bb-be45-058a64efcece tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:47.356738 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-39e650f8-8a68-47bb-be45-058a64efcece tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:47.363242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39e650f8-8a68-47bb-be45-058a64efcece tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:47.363695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39e650f8-8a68-47bb-be45-058a64efcece tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:47.364458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39e650f8-8a68-47bb-be45-058a64efcece tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:47.364906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39e650f8-8a68-47bb-be45-058a64efcece tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:47.498003 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-39e650f8-8a68-47bb-be45-058a64efcece tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:47.506459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-39e650f8-8a68-47bb-be45-058a64efcece tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:47.507926 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-39e650f8-8a68-47bb-be45-058a64efcece tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:47.509106 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-39e650f8-8a68-47bb-be45-058a64efcece tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.156847 Jul 21 22:07:47.509664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 417/765] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:47 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:48.089218 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-001d175d-6bfe-4ac6-8b82-b4ad17099c80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:48.089739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-001d175d-6bfe-4ac6-8b82-b4ad17099c80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:48.096559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-001d175d-6bfe-4ac6-8b82-b4ad17099c80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:48.097005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-001d175d-6bfe-4ac6-8b82-b4ad17099c80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:48.097756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-001d175d-6bfe-4ac6-8b82-b4ad17099c80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:48.098185 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-001d175d-6bfe-4ac6-8b82-b4ad17099c80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:48.157134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-001d175d-6bfe-4ac6-8b82-b4ad17099c80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:48.165012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-001d175d-6bfe-4ac6-8b82-b4ad17099c80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079920 Jul 21 22:07:48.165568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 349/766] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:48 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:48.212325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a313bc45-ef7f-428f-88aa-45cde5eee643 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:48.213242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a313bc45-ef7f-428f-88aa-45cde5eee643 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:48.219626 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a313bc45-ef7f-428f-88aa-45cde5eee643 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:48.220566 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a313bc45-ef7f-428f-88aa-45cde5eee643 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:48.221322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a313bc45-ef7f-428f-88aa-45cde5eee643 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:48.221753 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a313bc45-ef7f-428f-88aa-45cde5eee643 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:48.238731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:07:48.251516 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a313bc45-ef7f-428f-88aa-45cde5eee643 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043358 Jul 21 22:07:48.252065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 418/767] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:48 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:48.270857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-db8f8405-2e0b-4410-988a-e096ba640cd5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:48.271881 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-db8f8405-2e0b-4410-988a-e096ba640cd5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:48.277836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db8f8405-2e0b-4410-988a-e096ba640cd5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:48.278282 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db8f8405-2e0b-4410-988a-e096ba640cd5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:48.279069 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db8f8405-2e0b-4410-988a-e096ba640cd5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:48.279522 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db8f8405-2e0b-4410-988a-e096ba640cd5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:48.309043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-db8f8405-2e0b-4410-988a-e096ba640cd5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041954 Jul 21 22:07:48.309617 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 350/768] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:48 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:48.527122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4f1225af-653f-46af-b3bb-490f44d187ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:48.527731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4f1225af-653f-46af-b3bb-490f44d187ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:48.534339 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f1225af-653f-46af-b3bb-490f44d187ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:48.534791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f1225af-653f-46af-b3bb-490f44d187ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:48.535580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f1225af-653f-46af-b3bb-490f44d187ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:48.536037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f1225af-653f-46af-b3bb-490f44d187ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:48.877474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4f1225af-653f-46af-b3bb-490f44d187ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:48.885679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4f1225af-653f-46af-b3bb-490f44d187ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:48.887203 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4f1225af-653f-46af-b3bb-490f44d187ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:48.888336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4f1225af-653f-46af-b3bb-490f44d187ff tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.365165 Jul 21 22:07:48.888892 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 419/769] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:48 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:49.182021 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-02bc1fd7-ae17-41f0-afb8-110fff0a82a1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:49.182619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-02bc1fd7-ae17-41f0-afb8-110fff0a82a1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:49.189035 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02bc1fd7-ae17-41f0-afb8-110fff0a82a1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:49.189471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02bc1fd7-ae17-41f0-afb8-110fff0a82a1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:49.190225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02bc1fd7-ae17-41f0-afb8-110fff0a82a1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:49.190657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02bc1fd7-ae17-41f0-afb8-110fff0a82a1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:49.252293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-02bc1fd7-ae17-41f0-afb8-110fff0a82a1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:49.259754 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-02bc1fd7-ae17-41f0-afb8-110fff0a82a1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081487 Jul 21 22:07:49.260370 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 351/770] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:49 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:49.261925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-02589cc3-5fda-4739-bcbe-1be4ee4f48ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:49.262850 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-02589cc3-5fda-4739-bcbe-1be4ee4f48ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:49.269807 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02589cc3-5fda-4739-bcbe-1be4ee4f48ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:49.270258 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02589cc3-5fda-4739-bcbe-1be4ee4f48ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:49.271064 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02589cc3-5fda-4739-bcbe-1be4ee4f48ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:49.271507 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-02589cc3-5fda-4739-bcbe-1be4ee4f48ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:49.301150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-02589cc3-5fda-4739-bcbe-1be4ee4f48ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043096 Jul 21 22:07:49.301695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 420/771] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:49 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:49.320975 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-aeca34fc-e771-4f8d-af8a-11f43627948d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:49.321951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-aeca34fc-e771-4f8d-af8a-11f43627948d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:49.327896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aeca34fc-e771-4f8d-af8a-11f43627948d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:49.328339 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aeca34fc-e771-4f8d-af8a-11f43627948d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:49.329097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aeca34fc-e771-4f8d-af8a-11f43627948d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:49.330024 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aeca34fc-e771-4f8d-af8a-11f43627948d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:49.358987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-aeca34fc-e771-4f8d-af8a-11f43627948d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041862 Jul 21 22:07:49.359560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 352/772] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:49 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:49.906115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a6d62eec-4220-4eb8-bc72-f4a90d9ec16a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:49.906721 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a6d62eec-4220-4eb8-bc72-f4a90d9ec16a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:49.912825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6d62eec-4220-4eb8-bc72-f4a90d9ec16a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:49.913278 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6d62eec-4220-4eb8-bc72-f4a90d9ec16a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:49.914045 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6d62eec-4220-4eb8-bc72-f4a90d9ec16a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:49.914487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6d62eec-4220-4eb8-bc72-f4a90d9ec16a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:50.049934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a6d62eec-4220-4eb8-bc72-f4a90d9ec16a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:50.058299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a6d62eec-4220-4eb8-bc72-f4a90d9ec16a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:50.059808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a6d62eec-4220-4eb8-bc72-f4a90d9ec16a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:50.060938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a6d62eec-4220-4eb8-bc72-f4a90d9ec16a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.158749 Jul 21 22:07:50.061493 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 421/773] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:49 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:50.278836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0ab22d2b-c099-4140-88ab-96443a820c1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:50.279605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0ab22d2b-c099-4140-88ab-96443a820c1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:50.288436 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0ab22d2b-c099-4140-88ab-96443a820c1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:50.289180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0ab22d2b-c099-4140-88ab-96443a820c1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:50.290128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0ab22d2b-c099-4140-88ab-96443a820c1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:50.290578 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0ab22d2b-c099-4140-88ab-96443a820c1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:50.312131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-311d4dcf-c19c-4ee2-a16f-7b64b28b0bc9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:50.312988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-311d4dcf-c19c-4ee2-a16f-7b64b28b0bc9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:50.319864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-311d4dcf-c19c-4ee2-a16f-7b64b28b0bc9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:50.320309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-311d4dcf-c19c-4ee2-a16f-7b64b28b0bc9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:50.321075 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-311d4dcf-c19c-4ee2-a16f-7b64b28b0bc9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:50.321506 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-311d4dcf-c19c-4ee2-a16f-7b64b28b0bc9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:50.350173 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-311d4dcf-c19c-4ee2-a16f-7b64b28b0bc9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041949 Jul 21 22:07:50.350744 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 422/774] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:50 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:50.351215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0ab22d2b-c099-4140-88ab-96443a820c1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:50.358741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0ab22d2b-c099-4140-88ab-96443a820c1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.085939 Jul 21 22:07:50.359323 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 353/775] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:50 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:50.369278 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d9e159f5-9019-4575-9c94-ebb88b299d06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:50.370194 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d9e159f5-9019-4575-9c94-ebb88b299d06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:50.376003 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9e159f5-9019-4575-9c94-ebb88b299d06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:50.377094 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9e159f5-9019-4575-9c94-ebb88b299d06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:50.377848 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9e159f5-9019-4575-9c94-ebb88b299d06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:50.378281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9e159f5-9019-4575-9c94-ebb88b299d06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:50.406113 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d9e159f5-9019-4575-9c94-ebb88b299d06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040471 Jul 21 22:07:50.406662 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 423/776] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:50 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:51.080175 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4d76e08c-0b9b-4fb6-be87-29b3f990cd4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:51.080777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4d76e08c-0b9b-4fb6-be87-29b3f990cd4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:51.086990 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4d76e08c-0b9b-4fb6-be87-29b3f990cd4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:51.087464 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4d76e08c-0b9b-4fb6-be87-29b3f990cd4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:51.088214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4d76e08c-0b9b-4fb6-be87-29b3f990cd4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:51.088643 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4d76e08c-0b9b-4fb6-be87-29b3f990cd4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:51.213338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4d76e08c-0b9b-4fb6-be87-29b3f990cd4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:51.221579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4d76e08c-0b9b-4fb6-be87-29b3f990cd4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:51.223101 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4d76e08c-0b9b-4fb6-be87-29b3f990cd4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:51.224229 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4d76e08c-0b9b-4fb6-be87-29b3f990cd4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.148457 Jul 21 22:07:51.224774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 354/777] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:51 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:51.361760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4b2bddec-2516-4f2f-8b21-305ba7e6f8cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:51.362600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4b2bddec-2516-4f2f-8b21-305ba7e6f8cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:51.369422 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b2bddec-2516-4f2f-8b21-305ba7e6f8cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:51.369960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b2bddec-2516-4f2f-8b21-305ba7e6f8cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:51.370732 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b2bddec-2516-4f2f-8b21-305ba7e6f8cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:51.371195 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b2bddec-2516-4f2f-8b21-305ba7e6f8cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:51.374752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-223c5559-2884-45d2-b60f-49516845fdd7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:51.375408 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-223c5559-2884-45d2-b60f-49516845fdd7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:51.382038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-223c5559-2884-45d2-b60f-49516845fdd7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:51.382485 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-223c5559-2884-45d2-b60f-49516845fdd7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:51.383274 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-223c5559-2884-45d2-b60f-49516845fdd7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:51.383717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-223c5559-2884-45d2-b60f-49516845fdd7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:51.400793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4b2bddec-2516-4f2f-8b21-305ba7e6f8cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043014 Jul 21 22:07:51.401356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 424/778] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:51 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:51.417449 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-df13708a-8bd4-45a7-94b3-02eb8efa3c7d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:51.418367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-df13708a-8bd4-45a7-94b3-02eb8efa3c7d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:51.424313 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df13708a-8bd4-45a7-94b3-02eb8efa3c7d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:51.424766 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df13708a-8bd4-45a7-94b3-02eb8efa3c7d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:51.425577 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df13708a-8bd4-45a7-94b3-02eb8efa3c7d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:51.426018 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df13708a-8bd4-45a7-94b3-02eb8efa3c7d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:51.447351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-223c5559-2884-45d2-b60f-49516845fdd7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:51.455403 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-223c5559-2884-45d2-b60f-49516845fdd7 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083617 Jul 21 22:07:51.455965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 355/779] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:51 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:07:51.456091 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-df13708a-8bd4-45a7-94b3-02eb8efa3c7d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042306 Jul 21 22:07:51.456624 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 425/780] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:51 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:52.242155 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e6dbfffb-fb39-4ebb-90cf-935814ba2555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:52.242772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e6dbfffb-fb39-4ebb-90cf-935814ba2555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:52.248957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e6dbfffb-fb39-4ebb-90cf-935814ba2555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:52.249405 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e6dbfffb-fb39-4ebb-90cf-935814ba2555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:52.250170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e6dbfffb-fb39-4ebb-90cf-935814ba2555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:52.250605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e6dbfffb-fb39-4ebb-90cf-935814ba2555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:52.380706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e6dbfffb-fb39-4ebb-90cf-935814ba2555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:52.389613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e6dbfffb-fb39-4ebb-90cf-935814ba2555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:52.391157 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e6dbfffb-fb39-4ebb-90cf-935814ba2555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:52.392334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e6dbfffb-fb39-4ebb-90cf-935814ba2555 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.154050 Jul 21 22:07:52.392890 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 356/781] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:52 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:52.412733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fb2b80f2-b9bb-4991-ac5a-46aa9dfaf12b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:52.413645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fb2b80f2-b9bb-4991-ac5a-46aa9dfaf12b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:52.420190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb2b80f2-b9bb-4991-ac5a-46aa9dfaf12b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:52.420640 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb2b80f2-b9bb-4991-ac5a-46aa9dfaf12b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:52.421432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb2b80f2-b9bb-4991-ac5a-46aa9dfaf12b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:52.421883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb2b80f2-b9bb-4991-ac5a-46aa9dfaf12b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:52.450072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fb2b80f2-b9bb-4991-ac5a-46aa9dfaf12b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041376 Jul 21 22:07:52.450624 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 426/782] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:52 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:52.467442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4d8bb335-9733-4ab6-ab4f-1179f72eb455 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:52.468367 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4d8bb335-9733-4ab6-ab4f-1179f72eb455 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:52.472427 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6d39f25a-3587-415c-8ab2-62f3bd54f8bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:52.473042 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6d39f25a-3587-415c-8ab2-62f3bd54f8bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:52.475043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4d8bb335-9733-4ab6-ab4f-1179f72eb455 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:52.475501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4d8bb335-9733-4ab6-ab4f-1179f72eb455 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:52.476271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4d8bb335-9733-4ab6-ab4f-1179f72eb455 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:52.476705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4d8bb335-9733-4ab6-ab4f-1179f72eb455 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:52.483880 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d39f25a-3587-415c-8ab2-62f3bd54f8bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:52.483880 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d39f25a-3587-415c-8ab2-62f3bd54f8bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:52.484614 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d39f25a-3587-415c-8ab2-62f3bd54f8bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:52.485047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d39f25a-3587-415c-8ab2-62f3bd54f8bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:52.508116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4d8bb335-9733-4ab6-ab4f-1179f72eb455 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043230 Jul 21 22:07:52.508116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 357/783] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:52 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:52.546243 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6d39f25a-3587-415c-8ab2-62f3bd54f8bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:52.554462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6d39f25a-3587-415c-8ab2-62f3bd54f8bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.086309 Jul 21 22:07:52.555045 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 427/784] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:52 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:07:53.410800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-267a657b-510b-4a3d-949e-667823133bb2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:53.411436 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-267a657b-510b-4a3d-949e-667823133bb2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:53.418049 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-267a657b-510b-4a3d-949e-667823133bb2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:53.418500 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-267a657b-510b-4a3d-949e-667823133bb2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:53.419311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-267a657b-510b-4a3d-949e-667823133bb2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:53.419751 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-267a657b-510b-4a3d-949e-667823133bb2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:53.461647 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a05663b1-929e-4981-8a37-2295f2a3ab61 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:53.462570 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a05663b1-929e-4981-8a37-2295f2a3ab61 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:53.469346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a05663b1-929e-4981-8a37-2295f2a3ab61 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:53.469797 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a05663b1-929e-4981-8a37-2295f2a3ab61 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:53.472535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a05663b1-929e-4981-8a37-2295f2a3ab61 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:53.472977 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a05663b1-929e-4981-8a37-2295f2a3ab61 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:53.503770 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a05663b1-929e-4981-8a37-2295f2a3ab61 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046210 Jul 21 22:07:53.504339 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 428/785] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:53 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:53.518846 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e3b2bc82-a4f8-4757-b52e-c27eb025076f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:53.519783 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e3b2bc82-a4f8-4757-b52e-c27eb025076f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:53.525721 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3b2bc82-a4f8-4757-b52e-c27eb025076f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:53.526179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3b2bc82-a4f8-4757-b52e-c27eb025076f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:53.526955 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3b2bc82-a4f8-4757-b52e-c27eb025076f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:53.527426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3b2bc82-a4f8-4757-b52e-c27eb025076f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:53.554508 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-267a657b-510b-4a3d-949e-667823133bb2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:53.556225 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e3b2bc82-a4f8-4757-b52e-c27eb025076f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041201 Jul 21 22:07:53.556806 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 429/786] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:53 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:53.563226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-267a657b-510b-4a3d-949e-667823133bb2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:53.565922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-267a657b-510b-4a3d-949e-667823133bb2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:53.567108 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-267a657b-510b-4a3d-949e-667823133bb2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.160311 Jul 21 22:07:53.567646 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 358/787] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:53 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:53.570635 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4ad709c1-4964-4b47-8b98-ee8c8b124c82 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:53.571304 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4ad709c1-4964-4b47-8b98-ee8c8b124c82 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:53.577161 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ad709c1-4964-4b47-8b98-ee8c8b124c82 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:53.577611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ad709c1-4964-4b47-8b98-ee8c8b124c82 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:53.578375 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ad709c1-4964-4b47-8b98-ee8c8b124c82 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:53.578813 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ad709c1-4964-4b47-8b98-ee8c8b124c82 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:53.638101 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4ad709c1-4964-4b47-8b98-ee8c8b124c82 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:53.645581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4ad709c1-4964-4b47-8b98-ee8c8b124c82 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078586 Jul 21 22:07:53.646146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 430/788] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:53 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:07:54.515124 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f4bc94bb-dd79-4d8e-9a06-5b22eae65f03 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:54.516045 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f4bc94bb-dd79-4d8e-9a06-5b22eae65f03 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:54.526429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f4bc94bb-dd79-4d8e-9a06-5b22eae65f03 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:54.526874 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f4bc94bb-dd79-4d8e-9a06-5b22eae65f03 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:54.527660 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f4bc94bb-dd79-4d8e-9a06-5b22eae65f03 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:54.528091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f4bc94bb-dd79-4d8e-9a06-5b22eae65f03 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:54.557040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f4bc94bb-dd79-4d8e-9a06-5b22eae65f03 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Jul 21 22:07:54.557583 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 359/789] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:54 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:54.567612 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-72b345fb-1f25-466e-8427-44ab3f950a5b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:54.568536 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-72b345fb-1f25-466e-8427-44ab3f950a5b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:54.574937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72b345fb-1f25-466e-8427-44ab3f950a5b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:54.575444 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72b345fb-1f25-466e-8427-44ab3f950a5b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:54.576214 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72b345fb-1f25-466e-8427-44ab3f950a5b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:54.576656 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72b345fb-1f25-466e-8427-44ab3f950a5b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:54.584805 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b3d503d2-46d5-45e0-a726-ea4340fec6cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:54.585457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b3d503d2-46d5-45e0-a726-ea4340fec6cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:54.591693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3d503d2-46d5-45e0-a726-ea4340fec6cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:54.592138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3d503d2-46d5-45e0-a726-ea4340fec6cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:54.592893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3d503d2-46d5-45e0-a726-ea4340fec6cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:54.593325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3d503d2-46d5-45e0-a726-ea4340fec6cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:54.606619 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-72b345fb-1f25-466e-8427-44ab3f950a5b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042922 Jul 21 22:07:54.607223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 431/790] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:54 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:54.662148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5ae56c72-13a2-4501-8aa0-eced314fa481 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:54.662754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5ae56c72-13a2-4501-8aa0-eced314fa481 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:54.669026 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ae56c72-13a2-4501-8aa0-eced314fa481 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:54.669473 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ae56c72-13a2-4501-8aa0-eced314fa481 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:54.670251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ae56c72-13a2-4501-8aa0-eced314fa481 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:54.670827 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ae56c72-13a2-4501-8aa0-eced314fa481 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:54.747629 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5ae56c72-13a2-4501-8aa0-eced314fa481 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:54.751798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b3d503d2-46d5-45e0-a726-ea4340fec6cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:54.755097 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5ae56c72-13a2-4501-8aa0-eced314fa481 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.097171 Jul 21 22:07:54.755670 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 432/791] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:54 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:07:54.760437 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b3d503d2-46d5-45e0-a726-ea4340fec6cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:54.761940 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b3d503d2-46d5-45e0-a726-ea4340fec6cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:54.763136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b3d503d2-46d5-45e0-a726-ea4340fec6cc tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.181998 Jul 21 22:07:54.763683 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 360/792] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:54 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:07:55.569133 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-be678915-80e8-46d9-b4a1-f6cab5a47df0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:55.570053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-be678915-80e8-46d9-b4a1-f6cab5a47df0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:55.576638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be678915-80e8-46d9-b4a1-f6cab5a47df0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:55.577095 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be678915-80e8-46d9-b4a1-f6cab5a47df0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:55.577865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be678915-80e8-46d9-b4a1-f6cab5a47df0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:55.578306 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be678915-80e8-46d9-b4a1-f6cab5a47df0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:55.606953 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-be678915-80e8-46d9-b4a1-f6cab5a47df0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041842 Jul 21 22:07:55.607523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 433/793] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:55 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:55.617620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7682175b-375f-4ac5-8c3f-1cf61864a5ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:55.618543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7682175b-375f-4ac5-8c3f-1cf61864a5ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:55.624980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7682175b-375f-4ac5-8c3f-1cf61864a5ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:55.625429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7682175b-375f-4ac5-8c3f-1cf61864a5ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:55.626707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7682175b-375f-4ac5-8c3f-1cf61864a5ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:55.627173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7682175b-375f-4ac5-8c3f-1cf61864a5ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:55.655394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7682175b-375f-4ac5-8c3f-1cf61864a5ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041651 Jul 21 22:07:55.655937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 361/794] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:55 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:55.771537 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-18c8cebe-6d99-406a-8296-493569c44f4a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:55.772106 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-18c8cebe-6d99-406a-8296-493569c44f4a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:55.778263 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18c8cebe-6d99-406a-8296-493569c44f4a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:55.778726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18c8cebe-6d99-406a-8296-493569c44f4a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:55.779545 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18c8cebe-6d99-406a-8296-493569c44f4a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:55.779989 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18c8cebe-6d99-406a-8296-493569c44f4a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:55.781077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-de51b66c-a89f-4177-85ab-b42f503896b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:55.781682 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-de51b66c-a89f-4177-85ab-b42f503896b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:55.788078 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de51b66c-a89f-4177-85ab-b42f503896b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:55.788078 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de51b66c-a89f-4177-85ab-b42f503896b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:55.789295 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de51b66c-a89f-4177-85ab-b42f503896b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:55.789295 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de51b66c-a89f-4177-85ab-b42f503896b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:55.849957 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-18c8cebe-6d99-406a-8296-493569c44f4a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:55.857458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-18c8cebe-6d99-406a-8296-493569c44f4a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.089767 Jul 21 22:07:55.858023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 434/795] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:55 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:55.930509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-de51b66c-a89f-4177-85ab-b42f503896b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:55.938776 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-de51b66c-a89f-4177-85ab-b42f503896b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:55.940309 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-de51b66c-a89f-4177-85ab-b42f503896b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:55.941460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-de51b66c-a89f-4177-85ab-b42f503896b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.164290 Jul 21 22:07:55.942020 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 362/796] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:55 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:07:56.617702 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ce51c3ab-6e9b-4091-a77a-8f07a82e0eb4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:56.618689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ce51c3ab-6e9b-4091-a77a-8f07a82e0eb4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:56.625158 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce51c3ab-6e9b-4091-a77a-8f07a82e0eb4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:56.625603 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce51c3ab-6e9b-4091-a77a-8f07a82e0eb4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:56.626387 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce51c3ab-6e9b-4091-a77a-8f07a82e0eb4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:56.626816 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce51c3ab-6e9b-4091-a77a-8f07a82e0eb4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:56.630315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:07:56.655380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ce51c3ab-6e9b-4091-a77a-8f07a82e0eb4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041548 Jul 21 22:07:56.655922 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 435/797] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:56 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:56.666661 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-014d0744-e9fd-4604-8b1f-6bdeea24508b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:56.667621 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-014d0744-e9fd-4604-8b1f-6bdeea24508b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:56.674056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-014d0744-e9fd-4604-8b1f-6bdeea24508b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:56.674510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-014d0744-e9fd-4604-8b1f-6bdeea24508b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:56.675306 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-014d0744-e9fd-4604-8b1f-6bdeea24508b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:56.675747 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-014d0744-e9fd-4604-8b1f-6bdeea24508b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:56.704935 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-014d0744-e9fd-4604-8b1f-6bdeea24508b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041610 Jul 21 22:07:56.705488 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 363/798] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:56 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:56.873621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6f83282a-8dde-4938-a423-5a69dd2b1aab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:56.874156 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6f83282a-8dde-4938-a423-5a69dd2b1aab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:56.880647 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f83282a-8dde-4938-a423-5a69dd2b1aab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:56.881111 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f83282a-8dde-4938-a423-5a69dd2b1aab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:56.881881 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f83282a-8dde-4938-a423-5a69dd2b1aab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:56.882317 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f83282a-8dde-4938-a423-5a69dd2b1aab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:56.941578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6f83282a-8dde-4938-a423-5a69dd2b1aab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:56.948887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6f83282a-8dde-4938-a423-5a69dd2b1aab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079204 Jul 21 22:07:56.949444 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 436/799] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:56 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:56.959966 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4b60e3ae-a139-437f-88e5-3a88417d88d8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:56.960569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4b60e3ae-a139-437f-88e5-3a88417d88d8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:56.966678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b60e3ae-a139-437f-88e5-3a88417d88d8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:56.967167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b60e3ae-a139-437f-88e5-3a88417d88d8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:56.967923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b60e3ae-a139-437f-88e5-3a88417d88d8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:56.968354 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b60e3ae-a139-437f-88e5-3a88417d88d8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:57.099159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4b60e3ae-a139-437f-88e5-3a88417d88d8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:57.107502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4b60e3ae-a139-437f-88e5-3a88417d88d8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:57.108995 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4b60e3ae-a139-437f-88e5-3a88417d88d8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:57.110160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4b60e3ae-a139-437f-88e5-3a88417d88d8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.154025 Jul 21 22:07:57.110711 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 364/800] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:56 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:57.667692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ffd60c1a-ac72-4647-9cb2-0bd6b90f5409 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:57.668613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ffd60c1a-ac72-4647-9cb2-0bd6b90f5409 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:57.675753 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ffd60c1a-ac72-4647-9cb2-0bd6b90f5409 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:57.676201 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ffd60c1a-ac72-4647-9cb2-0bd6b90f5409 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:57.676958 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ffd60c1a-ac72-4647-9cb2-0bd6b90f5409 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:57.677392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ffd60c1a-ac72-4647-9cb2-0bd6b90f5409 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:57.704877 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ffd60c1a-ac72-4647-9cb2-0bd6b90f5409 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041313 Jul 21 22:07:57.705417 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 437/801] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:57 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:57.716481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8e927ab3-9712-4512-8dfb-d20d39bc452e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:57.717393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8e927ab3-9712-4512-8dfb-d20d39bc452e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:57.724221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8e927ab3-9712-4512-8dfb-d20d39bc452e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:57.724669 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8e927ab3-9712-4512-8dfb-d20d39bc452e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:57.725427 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8e927ab3-9712-4512-8dfb-d20d39bc452e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:57.725852 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8e927ab3-9712-4512-8dfb-d20d39bc452e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:57.742392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:07:57.755178 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8e927ab3-9712-4512-8dfb-d20d39bc452e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042497 Jul 21 22:07:57.755718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 365/802] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:57 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:57.966473 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5fdee5f1-65f4-4982-8376-757e8596c4bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:57.966985 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5fdee5f1-65f4-4982-8376-757e8596c4bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:57.972938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5fdee5f1-65f4-4982-8376-757e8596c4bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:57.973386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5fdee5f1-65f4-4982-8376-757e8596c4bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:57.974147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5fdee5f1-65f4-4982-8376-757e8596c4bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:57.974586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5fdee5f1-65f4-4982-8376-757e8596c4bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:58.034000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5fdee5f1-65f4-4982-8376-757e8596c4bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:58.041324 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5fdee5f1-65f4-4982-8376-757e8596c4bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078790 Jul 21 22:07:58.041887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 438/803] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:57 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:58.128720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-32c9a6c9-bf77-4813-bdb9-5f3a0b65cd20 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:58.129322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-32c9a6c9-bf77-4813-bdb9-5f3a0b65cd20 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:58.135403 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32c9a6c9-bf77-4813-bdb9-5f3a0b65cd20 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:58.135852 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32c9a6c9-bf77-4813-bdb9-5f3a0b65cd20 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:58.136605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32c9a6c9-bf77-4813-bdb9-5f3a0b65cd20 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:58.137034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32c9a6c9-bf77-4813-bdb9-5f3a0b65cd20 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:58.261498 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-32c9a6c9-bf77-4813-bdb9-5f3a0b65cd20 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:58.269956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-32c9a6c9-bf77-4813-bdb9-5f3a0b65cd20 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:58.271552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-32c9a6c9-bf77-4813-bdb9-5f3a0b65cd20 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:58.272741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-32c9a6c9-bf77-4813-bdb9-5f3a0b65cd20 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.148502 Jul 21 22:07:58.273305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 366/804] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:58 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:58.716403 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-50c2e660-f4e2-4a2b-9856-b351309edf9e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:58.717360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-50c2e660-f4e2-4a2b-9856-b351309edf9e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:58.724524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-50c2e660-f4e2-4a2b-9856-b351309edf9e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:58.724977 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-50c2e660-f4e2-4a2b-9856-b351309edf9e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:58.725741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-50c2e660-f4e2-4a2b-9856-b351309edf9e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:58.726185 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-50c2e660-f4e2-4a2b-9856-b351309edf9e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:58.754036 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-50c2e660-f4e2-4a2b-9856-b351309edf9e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041567 Jul 21 22:07:58.754585 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 439/805] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:58 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:07:58.766138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5556d1e8-53c6-4b7e-8e63-16b150b414ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:58.767579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5556d1e8-53c6-4b7e-8e63-16b150b414ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:58.773933 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5556d1e8-53c6-4b7e-8e63-16b150b414ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:58.774448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5556d1e8-53c6-4b7e-8e63-16b150b414ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:58.775238 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5556d1e8-53c6-4b7e-8e63-16b150b414ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:58.775669 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5556d1e8-53c6-4b7e-8e63-16b150b414ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:58.803825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5556d1e8-53c6-4b7e-8e63-16b150b414ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041512 Jul 21 22:07:58.804352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 367/806] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:58 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:59.058307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-46a59f9a-1bf2-473f-9b06-5115782b687a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:59.058839 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-46a59f9a-1bf2-473f-9b06-5115782b687a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:59.064836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-46a59f9a-1bf2-473f-9b06-5115782b687a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:59.065286 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-46a59f9a-1bf2-473f-9b06-5115782b687a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:59.066051 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-46a59f9a-1bf2-473f-9b06-5115782b687a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:59.066488 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-46a59f9a-1bf2-473f-9b06-5115782b687a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:59.129514 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-46a59f9a-1bf2-473f-9b06-5115782b687a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:59.136941 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-46a59f9a-1bf2-473f-9b06-5115782b687a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082624 Jul 21 22:07:59.137498 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 440/807] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:07:59 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:07:59.291359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6ca02184-d7dd-4098-aeb6-d653f7155596 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:59.291970 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6ca02184-d7dd-4098-aeb6-d653f7155596 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:59.297953 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ca02184-d7dd-4098-aeb6-d653f7155596 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:59.299066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ca02184-d7dd-4098-aeb6-d653f7155596 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:59.299831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ca02184-d7dd-4098-aeb6-d653f7155596 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:59.300274 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ca02184-d7dd-4098-aeb6-d653f7155596 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:59.425636 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6ca02184-d7dd-4098-aeb6-d653f7155596 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:59.434018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6ca02184-d7dd-4098-aeb6-d653f7155596 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:59.435544 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6ca02184-d7dd-4098-aeb6-d653f7155596 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:07:59.436707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6ca02184-d7dd-4098-aeb6-d653f7155596 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.149298 Jul 21 22:07:59.437265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 368/808] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:07:59 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:07:59.765524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-30d5b0d9-7495-472e-a39b-7a1c7b954ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:59.766454 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-30d5b0d9-7495-472e-a39b-7a1c7b954ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:59.773503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30d5b0d9-7495-472e-a39b-7a1c7b954ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:59.773953 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30d5b0d9-7495-472e-a39b-7a1c7b954ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:59.774969 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30d5b0d9-7495-472e-a39b-7a1c7b954ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:59.775260 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30d5b0d9-7495-472e-a39b-7a1c7b954ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:59.807396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-30d5b0d9-7495-472e-a39b-7a1c7b954ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Jul 21 22:07:59.807959 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 441/809] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:59 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:07:59.815691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-035381d0-5cb6-4f18-ba4d-8b37c65f32f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:07:59.816614 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-035381d0-5cb6-4f18-ba4d-8b37c65f32f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:07:59.823084 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-035381d0-5cb6-4f18-ba4d-8b37c65f32f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:59.823536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-035381d0-5cb6-4f18-ba4d-8b37c65f32f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:59.824296 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-035381d0-5cb6-4f18-ba4d-8b37c65f32f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:07:59.824729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-035381d0-5cb6-4f18-ba4d-8b37c65f32f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:07:59.853077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-035381d0-5cb6-4f18-ba4d-8b37c65f32f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041837 Jul 21 22:07:59.853617 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 369/810] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:07:59 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:00.153431 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-89d3df6f-f538-4719-bfc1-dd73b7ed7545 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:00.154044 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-89d3df6f-f538-4719-bfc1-dd73b7ed7545 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:00.160037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-89d3df6f-f538-4719-bfc1-dd73b7ed7545 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:00.160488 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-89d3df6f-f538-4719-bfc1-dd73b7ed7545 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:00.161254 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-89d3df6f-f538-4719-bfc1-dd73b7ed7545 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:00.161692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-89d3df6f-f538-4719-bfc1-dd73b7ed7545 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:00.221242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-89d3df6f-f538-4719-bfc1-dd73b7ed7545 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:00.228682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-89d3df6f-f538-4719-bfc1-dd73b7ed7545 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079094 Jul 21 22:08:00.229247 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 442/811] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:00 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:00.455419 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-225bcd0a-b1ee-4d7f-b698-48c1db6bc3e5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:00.455942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-225bcd0a-b1ee-4d7f-b698-48c1db6bc3e5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:00.462211 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-225bcd0a-b1ee-4d7f-b698-48c1db6bc3e5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:00.462663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-225bcd0a-b1ee-4d7f-b698-48c1db6bc3e5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:00.463456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-225bcd0a-b1ee-4d7f-b698-48c1db6bc3e5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:00.463895 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-225bcd0a-b1ee-4d7f-b698-48c1db6bc3e5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:00.594487 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-225bcd0a-b1ee-4d7f-b698-48c1db6bc3e5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:00.602801 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-225bcd0a-b1ee-4d7f-b698-48c1db6bc3e5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:00.604351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-225bcd0a-b1ee-4d7f-b698-48c1db6bc3e5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:00.605489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-225bcd0a-b1ee-4d7f-b698-48c1db6bc3e5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.154578 Jul 21 22:08:00.606049 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 370/812] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:00 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:00.819424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c5d00da1-3d5f-41af-828a-faaf81b53887 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:00.820294 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c5d00da1-3d5f-41af-828a-faaf81b53887 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:00.826767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c5d00da1-3d5f-41af-828a-faaf81b53887 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:00.827259 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c5d00da1-3d5f-41af-828a-faaf81b53887 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:00.828255 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c5d00da1-3d5f-41af-828a-faaf81b53887 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:00.828462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c5d00da1-3d5f-41af-828a-faaf81b53887 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:00.857404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c5d00da1-3d5f-41af-828a-faaf81b53887 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042026 Jul 21 22:08:00.857958 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 443/813] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:00 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:00.864426 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a753e6cc-a88e-40df-926f-3fdaec8724e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:00.865339 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a753e6cc-a88e-40df-926f-3fdaec8724e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:00.871881 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a753e6cc-a88e-40df-926f-3fdaec8724e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:00.872324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a753e6cc-a88e-40df-926f-3fdaec8724e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:00.873077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a753e6cc-a88e-40df-926f-3fdaec8724e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:00.873509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a753e6cc-a88e-40df-926f-3fdaec8724e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:00.902597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a753e6cc-a88e-40df-926f-3fdaec8724e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042073 Jul 21 22:08:00.903165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 371/814] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:00 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:01.245452 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e784d8cc-83d6-4d75-aeeb-1af35c372ed9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:01.246070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e784d8cc-83d6-4d75-aeeb-1af35c372ed9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:01.252720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e784d8cc-83d6-4d75-aeeb-1af35c372ed9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:01.253170 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e784d8cc-83d6-4d75-aeeb-1af35c372ed9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:01.253941 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e784d8cc-83d6-4d75-aeeb-1af35c372ed9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:01.254380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e784d8cc-83d6-4d75-aeeb-1af35c372ed9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:01.315874 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e784d8cc-83d6-4d75-aeeb-1af35c372ed9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:01.323362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e784d8cc-83d6-4d75-aeeb-1af35c372ed9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081675 Jul 21 22:08:01.324010 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 444/815] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:01 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:01.624036 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4da7cf70-be7d-4179-b337-2351cb7b120b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:01.624563 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4da7cf70-be7d-4179-b337-2351cb7b120b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:01.630500 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4da7cf70-be7d-4179-b337-2351cb7b120b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:01.630944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4da7cf70-be7d-4179-b337-2351cb7b120b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:01.631832 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4da7cf70-be7d-4179-b337-2351cb7b120b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:01.632293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4da7cf70-be7d-4179-b337-2351cb7b120b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:01.763151 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4da7cf70-be7d-4179-b337-2351cb7b120b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:01.771954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4da7cf70-be7d-4179-b337-2351cb7b120b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:01.773447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4da7cf70-be7d-4179-b337-2351cb7b120b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:01.774581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4da7cf70-be7d-4179-b337-2351cb7b120b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.154502 Jul 21 22:08:01.775146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 372/816] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:01 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:01.869060 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3089b9fb-3a6d-41b8-bfd5-0a1ea36eb177 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:01.869988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3089b9fb-3a6d-41b8-bfd5-0a1ea36eb177 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:01.877232 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3089b9fb-3a6d-41b8-bfd5-0a1ea36eb177 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:01.877629 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3089b9fb-3a6d-41b8-bfd5-0a1ea36eb177 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:01.878400 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3089b9fb-3a6d-41b8-bfd5-0a1ea36eb177 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:01.878841 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3089b9fb-3a6d-41b8-bfd5-0a1ea36eb177 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:01.906836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3089b9fb-3a6d-41b8-bfd5-0a1ea36eb177 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041730 Jul 21 22:08:01.907597 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 445/817] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:01 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:01.913565 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-08c0cb8a-9acf-4e51-839f-d8ecc99db3d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:01.914475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-08c0cb8a-9acf-4e51-839f-d8ecc99db3d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:01.920913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-08c0cb8a-9acf-4e51-839f-d8ecc99db3d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:01.921354 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-08c0cb8a-9acf-4e51-839f-d8ecc99db3d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:01.922110 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-08c0cb8a-9acf-4e51-839f-d8ecc99db3d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:01.922543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-08c0cb8a-9acf-4e51-839f-d8ecc99db3d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:01.951168 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-08c0cb8a-9acf-4e51-839f-d8ecc99db3d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041411 Jul 21 22:08:01.951704 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 373/818] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:01 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:02.340191 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-194c9c55-3ad8-4584-94f3-cf883e9ab423 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:02.340795 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-194c9c55-3ad8-4584-94f3-cf883e9ab423 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:02.347247 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-194c9c55-3ad8-4584-94f3-cf883e9ab423 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:02.347701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-194c9c55-3ad8-4584-94f3-cf883e9ab423 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:02.348468 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-194c9c55-3ad8-4584-94f3-cf883e9ab423 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:02.348904 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-194c9c55-3ad8-4584-94f3-cf883e9ab423 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:02.420312 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-194c9c55-3ad8-4584-94f3-cf883e9ab423 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:02.427898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-194c9c55-3ad8-4584-94f3-cf883e9ab423 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.091898 Jul 21 22:08:02.428522 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 446/819] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:02 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:02.793322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4ee2dfd8-3253-43bf-8de5-36a4ef974978 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:02.793929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4ee2dfd8-3253-43bf-8de5-36a4ef974978 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:02.800773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ee2dfd8-3253-43bf-8de5-36a4ef974978 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:02.801218 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ee2dfd8-3253-43bf-8de5-36a4ef974978 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:02.801982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ee2dfd8-3253-43bf-8de5-36a4ef974978 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:02.802416 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ee2dfd8-3253-43bf-8de5-36a4ef974978 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:02.917987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4db3ee05-e163-4bd0-a750-eb413bfb080f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:02.918972 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4db3ee05-e163-4bd0-a750-eb413bfb080f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:02.926177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4db3ee05-e163-4bd0-a750-eb413bfb080f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:02.926638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4db3ee05-e163-4bd0-a750-eb413bfb080f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:02.927500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4db3ee05-e163-4bd0-a750-eb413bfb080f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:02.927940 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4db3ee05-e163-4bd0-a750-eb413bfb080f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:02.930234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4ee2dfd8-3253-43bf-8de5-36a4ef974978 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:02.939678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4ee2dfd8-3253-43bf-8de5-36a4ef974978 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:02.941186 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4ee2dfd8-3253-43bf-8de5-36a4ef974978 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:02.942337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4ee2dfd8-3253-43bf-8de5-36a4ef974978 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.152910 Jul 21 22:08:02.942895 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 374/820] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:02 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:02.956949 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4db3ee05-e163-4bd0-a750-eb413bfb080f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042982 Jul 21 22:08:02.957510 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 447/821] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:02 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:02.962992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dbf84ee9-96a0-42ee-9eb6-b93f1bd6b420 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:02.963926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dbf84ee9-96a0-42ee-9eb6-b93f1bd6b420 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:02.969739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dbf84ee9-96a0-42ee-9eb6-b93f1bd6b420 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:02.970688 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dbf84ee9-96a0-42ee-9eb6-b93f1bd6b420 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:02.971471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dbf84ee9-96a0-42ee-9eb6-b93f1bd6b420 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:02.971900 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dbf84ee9-96a0-42ee-9eb6-b93f1bd6b420 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:03.000267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dbf84ee9-96a0-42ee-9eb6-b93f1bd6b420 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041271 Jul 21 22:08:03.000807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 375/822] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:02 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:03.444886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2e8a53e1-1b75-43e8-a0a9-8c2a37409288 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:03.445497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2e8a53e1-1b75-43e8-a0a9-8c2a37409288 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:03.451568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e8a53e1-1b75-43e8-a0a9-8c2a37409288 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:03.452018 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e8a53e1-1b75-43e8-a0a9-8c2a37409288 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:03.452779 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e8a53e1-1b75-43e8-a0a9-8c2a37409288 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:03.453215 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e8a53e1-1b75-43e8-a0a9-8c2a37409288 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:03.513991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2e8a53e1-1b75-43e8-a0a9-8c2a37409288 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:03.521457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2e8a53e1-1b75-43e8-a0a9-8c2a37409288 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080409 Jul 21 22:08:03.522020 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 448/823] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:03 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:03.960200 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c31d3e5a-ed32-418b-be92-89ff91d3be77 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:03.960822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c31d3e5a-ed32-418b-be92-89ff91d3be77 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:03.967809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c31d3e5a-ed32-418b-be92-89ff91d3be77 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:03.968233 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9b7262cc-dc6a-4035-a457-c339f2b48e24 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:03.968670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c31d3e5a-ed32-418b-be92-89ff91d3be77 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:03.969065 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c31d3e5a-ed32-418b-be92-89ff91d3be77 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:03.969282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9b7262cc-dc6a-4035-a457-c339f2b48e24 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:03.969506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c31d3e5a-ed32-418b-be92-89ff91d3be77 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:03.975786 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9b7262cc-dc6a-4035-a457-c339f2b48e24 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:03.976239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9b7262cc-dc6a-4035-a457-c339f2b48e24 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:03.977009 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9b7262cc-dc6a-4035-a457-c339f2b48e24 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:03.977476 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9b7262cc-dc6a-4035-a457-c339f2b48e24 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:04.007150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9b7262cc-dc6a-4035-a457-c339f2b48e24 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042647 Jul 21 22:08:04.007723 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 449/824] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:03 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:04.012409 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2c7b3a11-3d23-41bc-be8f-d48681c5b31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:04.013317 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2c7b3a11-3d23-41bc-be8f-d48681c5b31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:04.019161 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2c7b3a11-3d23-41bc-be8f-d48681c5b31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:04.019614 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2c7b3a11-3d23-41bc-be8f-d48681c5b31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:04.020386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2c7b3a11-3d23-41bc-be8f-d48681c5b31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:04.020825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2c7b3a11-3d23-41bc-be8f-d48681c5b31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:04.049487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2c7b3a11-3d23-41bc-be8f-d48681c5b31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040757 Jul 21 22:08:04.050280 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 450/825] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:04 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:04.100555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c31d3e5a-ed32-418b-be92-89ff91d3be77 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:04.108738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c31d3e5a-ed32-418b-be92-89ff91d3be77 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:04.110235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c31d3e5a-ed32-418b-be92-89ff91d3be77 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:04.111891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c31d3e5a-ed32-418b-be92-89ff91d3be77 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.155581 Jul 21 22:08:04.112440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 376/826] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:03 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:04.538378 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d272b8c3-342a-42cd-89f5-33cc9b4a0c4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:04.538991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d272b8c3-342a-42cd-89f5-33cc9b4a0c4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:04.545110 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d272b8c3-342a-42cd-89f5-33cc9b4a0c4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:04.545563 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d272b8c3-342a-42cd-89f5-33cc9b4a0c4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:04.546330 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d272b8c3-342a-42cd-89f5-33cc9b4a0c4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:04.546766 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d272b8c3-342a-42cd-89f5-33cc9b4a0c4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:04.607548 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d272b8c3-342a-42cd-89f5-33cc9b4a0c4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:04.611990 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:04.616641 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d272b8c3-342a-42cd-89f5-33cc9b4a0c4d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082159 Jul 21 22:08:04.617208 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 451/827] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:04 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:05.019213 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1fceaedc-5f61-40a0-afc1-cd148ec6087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:05.020138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1fceaedc-5f61-40a0-afc1-cd148ec6087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:05.026631 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1fceaedc-5f61-40a0-afc1-cd148ec6087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:05.027115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1fceaedc-5f61-40a0-afc1-cd148ec6087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:05.027879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1fceaedc-5f61-40a0-afc1-cd148ec6087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:05.028319 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1fceaedc-5f61-40a0-afc1-cd148ec6087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:05.056788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1fceaedc-5f61-40a0-afc1-cd148ec6087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042089 Jul 21 22:08:05.057627 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 377/828] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:05 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:05.061287 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-251140d5-7f92-473b-8642-e14095959d78 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:05.062347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-251140d5-7f92-473b-8642-e14095959d78 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:05.074151 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-251140d5-7f92-473b-8642-e14095959d78 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:05.074604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-251140d5-7f92-473b-8642-e14095959d78 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:05.075420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-251140d5-7f92-473b-8642-e14095959d78 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:05.075856 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-251140d5-7f92-473b-8642-e14095959d78 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:05.105999 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-251140d5-7f92-473b-8642-e14095959d78 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048898 Jul 21 22:08:05.106554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 452/829] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:05 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:05.130050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fe4cccc6-5524-43ca-b083-028c2e5838c1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:05.130660 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fe4cccc6-5524-43ca-b083-028c2e5838c1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:05.136824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe4cccc6-5524-43ca-b083-028c2e5838c1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:05.137275 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe4cccc6-5524-43ca-b083-028c2e5838c1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:05.138045 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe4cccc6-5524-43ca-b083-028c2e5838c1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:05.138486 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe4cccc6-5524-43ca-b083-028c2e5838c1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:05.264929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fe4cccc6-5524-43ca-b083-028c2e5838c1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:05.273880 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fe4cccc6-5524-43ca-b083-028c2e5838c1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:05.275357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fe4cccc6-5524-43ca-b083-028c2e5838c1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:05.276542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fe4cccc6-5524-43ca-b083-028c2e5838c1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.150854 Jul 21 22:08:05.277105 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 378/830] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:05 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:05.633571 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ae59c050-d3d2-499d-b561-63bb34628a06 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:05.634191 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ae59c050-d3d2-499d-b561-63bb34628a06 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:05.640332 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ae59c050-d3d2-499d-b561-63bb34628a06 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:05.640784 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ae59c050-d3d2-499d-b561-63bb34628a06 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:05.641561 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ae59c050-d3d2-499d-b561-63bb34628a06 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:05.642003 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ae59c050-d3d2-499d-b561-63bb34628a06 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:05.705101 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ae59c050-d3d2-499d-b561-63bb34628a06 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:05.713011 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ae59c050-d3d2-499d-b561-63bb34628a06 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083334 Jul 21 22:08:05.713584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 453/831] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:05 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:06.068859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-02db1857-a0a7-4761-a315-71c952e08ba8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:06.069772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-02db1857-a0a7-4761-a315-71c952e08ba8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:06.076318 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02db1857-a0a7-4761-a315-71c952e08ba8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:06.076772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02db1857-a0a7-4761-a315-71c952e08ba8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:06.077530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02db1857-a0a7-4761-a315-71c952e08ba8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:06.077960 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02db1857-a0a7-4761-a315-71c952e08ba8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:06.106271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-02db1857-a0a7-4761-a315-71c952e08ba8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041478 Jul 21 22:08:06.106806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 379/832] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:06 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:06.117658 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f84ac634-4614-4219-a788-5c17ad8cdc46 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:06.118641 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f84ac634-4614-4219-a788-5c17ad8cdc46 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:06.125045 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f84ac634-4614-4219-a788-5c17ad8cdc46 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:06.125491 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f84ac634-4614-4219-a788-5c17ad8cdc46 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:06.126886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f84ac634-4614-4219-a788-5c17ad8cdc46 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:06.127356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f84ac634-4614-4219-a788-5c17ad8cdc46 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:06.155596 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f84ac634-4614-4219-a788-5c17ad8cdc46 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041807 Jul 21 22:08:06.156137 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 454/833] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:06 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:06.294328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c54be33e-6d3c-497d-b2de-1f9798503bba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:06.294925 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c54be33e-6d3c-497d-b2de-1f9798503bba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:06.301377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c54be33e-6d3c-497d-b2de-1f9798503bba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:06.301824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c54be33e-6d3c-497d-b2de-1f9798503bba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:06.302572 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c54be33e-6d3c-497d-b2de-1f9798503bba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:06.303022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c54be33e-6d3c-497d-b2de-1f9798503bba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:06.428780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c54be33e-6d3c-497d-b2de-1f9798503bba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:06.436988 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c54be33e-6d3c-497d-b2de-1f9798503bba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:06.438508 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c54be33e-6d3c-497d-b2de-1f9798503bba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:06.440265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c54be33e-6d3c-497d-b2de-1f9798503bba tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.149890 Jul 21 22:08:06.440827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 380/834] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:06 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:06.729711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8a595457-b236-47f6-8483-d451b63a4559 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:06.730341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8a595457-b236-47f6-8483-d451b63a4559 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:06.736981 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a595457-b236-47f6-8483-d451b63a4559 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:06.737424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a595457-b236-47f6-8483-d451b63a4559 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:06.738178 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a595457-b236-47f6-8483-d451b63a4559 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:06.738606 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a595457-b236-47f6-8483-d451b63a4559 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:06.797616 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8a595457-b236-47f6-8483-d451b63a4559 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:06.805673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8a595457-b236-47f6-8483-d451b63a4559 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079878 Jul 21 22:08:06.806232 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 455/835] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:06 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:07.117941 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-af61cd45-83a5-4437-b517-0079f13c4add tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:07.118816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-af61cd45-83a5-4437-b517-0079f13c4add tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:07.125256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af61cd45-83a5-4437-b517-0079f13c4add tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:07.125709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af61cd45-83a5-4437-b517-0079f13c4add tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:07.127114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af61cd45-83a5-4437-b517-0079f13c4add tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:07.127555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af61cd45-83a5-4437-b517-0079f13c4add tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:07.155410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-af61cd45-83a5-4437-b517-0079f13c4add tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041517 Jul 21 22:08:07.155955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 381/836] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:07 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:07.167389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a5ac5c6f-4856-4206-8eff-8c3235df3d0e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:07.168305 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a5ac5c6f-4856-4206-8eff-8c3235df3d0e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:07.174722 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5ac5c6f-4856-4206-8eff-8c3235df3d0e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:07.175213 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5ac5c6f-4856-4206-8eff-8c3235df3d0e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:07.175976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5ac5c6f-4856-4206-8eff-8c3235df3d0e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:07.176405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5ac5c6f-4856-4206-8eff-8c3235df3d0e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:07.205165 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a5ac5c6f-4856-4206-8eff-8c3235df3d0e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042088 Jul 21 22:08:07.205735 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 456/837] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:07 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:07.457670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4f8c7a25-20af-4568-9e8a-e2138146bdb5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:07.458274 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4f8c7a25-20af-4568-9e8a-e2138146bdb5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:07.464448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4f8c7a25-20af-4568-9e8a-e2138146bdb5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:07.464891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4f8c7a25-20af-4568-9e8a-e2138146bdb5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:07.465648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4f8c7a25-20af-4568-9e8a-e2138146bdb5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:07.466076 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4f8c7a25-20af-4568-9e8a-e2138146bdb5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:07.470535 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:07.599875 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4f8c7a25-20af-4568-9e8a-e2138146bdb5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:07.608142 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4f8c7a25-20af-4568-9e8a-e2138146bdb5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:07.609639 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4f8c7a25-20af-4568-9e8a-e2138146bdb5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:07.611404 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4f8c7a25-20af-4568-9e8a-e2138146bdb5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.157010 Jul 21 22:08:07.611917 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 382/838] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:07 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:07.821569 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f90bc67e-c922-4cd6-942f-c5337eebe6d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:07.822184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f90bc67e-c922-4cd6-942f-c5337eebe6d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:07.828314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f90bc67e-c922-4cd6-942f-c5337eebe6d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:07.828770 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f90bc67e-c922-4cd6-942f-c5337eebe6d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:07.830110 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f90bc67e-c922-4cd6-942f-c5337eebe6d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:07.830535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f90bc67e-c922-4cd6-942f-c5337eebe6d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:07.891501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f90bc67e-c922-4cd6-942f-c5337eebe6d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:07.898871 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f90bc67e-c922-4cd6-942f-c5337eebe6d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081162 Jul 21 22:08:07.899467 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 457/839] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:07 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:08.166809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7f3914d0-ccd6-446d-8088-61726f286ece tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:08.167785 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7f3914d0-ccd6-446d-8088-61726f286ece tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:08.174803 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f3914d0-ccd6-446d-8088-61726f286ece tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:08.175275 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f3914d0-ccd6-446d-8088-61726f286ece tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:08.176041 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f3914d0-ccd6-446d-8088-61726f286ece tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:08.176473 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f3914d0-ccd6-446d-8088-61726f286ece tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:08.204320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7f3914d0-ccd6-446d-8088-61726f286ece tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041410 Jul 21 22:08:08.204868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 383/840] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:08 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:08.216946 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-de1e82ed-5ef5-4535-8e28-21ce3684c8ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:08.217873 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-de1e82ed-5ef5-4535-8e28-21ce3684c8ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:08.224856 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de1e82ed-5ef5-4535-8e28-21ce3684c8ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:08.225381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de1e82ed-5ef5-4535-8e28-21ce3684c8ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:08.226164 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de1e82ed-5ef5-4535-8e28-21ce3684c8ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:08.226605 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de1e82ed-5ef5-4535-8e28-21ce3684c8ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:08.255148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-de1e82ed-5ef5-4535-8e28-21ce3684c8ae tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042272 Jul 21 22:08:08.255695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 458/841] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:08 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:08.630156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-defa5304-c688-44fe-97e4-a5ccdd36a60e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:08.630759 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-defa5304-c688-44fe-97e4-a5ccdd36a60e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:08.637814 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-defa5304-c688-44fe-97e4-a5ccdd36a60e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:08.638295 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-defa5304-c688-44fe-97e4-a5ccdd36a60e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:08.639121 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-defa5304-c688-44fe-97e4-a5ccdd36a60e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:08.639561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-defa5304-c688-44fe-97e4-a5ccdd36a60e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:08.766223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-defa5304-c688-44fe-97e4-a5ccdd36a60e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:08.774429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-defa5304-c688-44fe-97e4-a5ccdd36a60e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:08.775955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-defa5304-c688-44fe-97e4-a5ccdd36a60e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:08.777089 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-defa5304-c688-44fe-97e4-a5ccdd36a60e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151710 Jul 21 22:08:08.777696 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 384/842] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:08 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:08.915336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8172fb39-353c-4f01-aa83-5de9eac20833 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:08.915987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8172fb39-353c-4f01-aa83-5de9eac20833 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:08.922100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8172fb39-353c-4f01-aa83-5de9eac20833 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:08.922557 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8172fb39-353c-4f01-aa83-5de9eac20833 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:08.923918 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8172fb39-353c-4f01-aa83-5de9eac20833 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:08.924362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8172fb39-353c-4f01-aa83-5de9eac20833 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:08.988524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8172fb39-353c-4f01-aa83-5de9eac20833 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:08.996074 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8172fb39-353c-4f01-aa83-5de9eac20833 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.084574 Jul 21 22:08:08.996646 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 459/843] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:08 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:09.216193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-343a5014-6129-4e64-8464-0aba229f3d8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:09.217107 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-343a5014-6129-4e64-8464-0aba229f3d8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:09.224156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-343a5014-6129-4e64-8464-0aba229f3d8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:09.224598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-343a5014-6129-4e64-8464-0aba229f3d8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:09.225351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-343a5014-6129-4e64-8464-0aba229f3d8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:09.225780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-343a5014-6129-4e64-8464-0aba229f3d8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:09.253668 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-343a5014-6129-4e64-8464-0aba229f3d8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041636 Jul 21 22:08:09.254206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 385/844] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:09 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:09.266266 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e4b8c68f-c736-465a-a53d-41556bf24f9c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:09.267745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e4b8c68f-c736-465a-a53d-41556bf24f9c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:09.270015 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:09.275251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4b8c68f-c736-465a-a53d-41556bf24f9c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:09.275703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4b8c68f-c736-465a-a53d-41556bf24f9c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:09.276462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4b8c68f-c736-465a-a53d-41556bf24f9c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:09.276893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4b8c68f-c736-465a-a53d-41556bf24f9c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:09.305236 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e4b8c68f-c736-465a-a53d-41556bf24f9c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042900 Jul 21 22:08:09.305937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 460/845] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:09 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:09.796012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-adf3414f-a7d4-47a4-8eee-e363f66faa59 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:09.796012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-adf3414f-a7d4-47a4-8eee-e363f66faa59 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:09.803409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-adf3414f-a7d4-47a4-8eee-e363f66faa59 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:09.804149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-adf3414f-a7d4-47a4-8eee-e363f66faa59 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:09.805303 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-adf3414f-a7d4-47a4-8eee-e363f66faa59 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:09.805953 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-adf3414f-a7d4-47a4-8eee-e363f66faa59 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:09.939869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-adf3414f-a7d4-47a4-8eee-e363f66faa59 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:09.948146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-adf3414f-a7d4-47a4-8eee-e363f66faa59 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:09.949691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-adf3414f-a7d4-47a4-8eee-e363f66faa59 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:09.950825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-adf3414f-a7d4-47a4-8eee-e363f66faa59 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.159520 Jul 21 22:08:09.951501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 386/846] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:09 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:10.011809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0d9266bb-f004-4ed2-a002-7669aa9f7cbd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:10.012552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0d9266bb-f004-4ed2-a002-7669aa9f7cbd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:10.018402 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d9266bb-f004-4ed2-a002-7669aa9f7cbd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:10.018851 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d9266bb-f004-4ed2-a002-7669aa9f7cbd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:10.019660 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d9266bb-f004-4ed2-a002-7669aa9f7cbd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:10.020126 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d9266bb-f004-4ed2-a002-7669aa9f7cbd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:10.079652 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0d9266bb-f004-4ed2-a002-7669aa9f7cbd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:10.087292 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0d9266bb-f004-4ed2-a002-7669aa9f7cbd tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079026 Jul 21 22:08:10.087856 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 461/847] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:10 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:10.265126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b49c277f-19bc-40de-8b55-3689e499538a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:10.266040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b49c277f-19bc-40de-8b55-3689e499538a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:10.272482 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b49c277f-19bc-40de-8b55-3689e499538a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:10.272926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b49c277f-19bc-40de-8b55-3689e499538a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:10.273678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b49c277f-19bc-40de-8b55-3689e499538a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:10.274129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b49c277f-19bc-40de-8b55-3689e499538a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:10.303446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b49c277f-19bc-40de-8b55-3689e499538a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042203 Jul 21 22:08:10.303997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 387/848] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:10 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:10.316662 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5aab02c2-e0a2-4cc2-aefc-f5d40473e29f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:10.317587 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5aab02c2-e0a2-4cc2-aefc-f5d40473e29f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:10.323976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aab02c2-e0a2-4cc2-aefc-f5d40473e29f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:10.324428 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aab02c2-e0a2-4cc2-aefc-f5d40473e29f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:10.325191 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aab02c2-e0a2-4cc2-aefc-f5d40473e29f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:10.325627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aab02c2-e0a2-4cc2-aefc-f5d40473e29f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:10.354280 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5aab02c2-e0a2-4cc2-aefc-f5d40473e29f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041448 Jul 21 22:08:10.354760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 462/849] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:10 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:10.968810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a23bfdc7-9a76-4ce2-bab0-fdbd7ba1cde9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:10.969410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a23bfdc7-9a76-4ce2-bab0-fdbd7ba1cde9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:10.976006 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a23bfdc7-9a76-4ce2-bab0-fdbd7ba1cde9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:10.976450 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a23bfdc7-9a76-4ce2-bab0-fdbd7ba1cde9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:10.977206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a23bfdc7-9a76-4ce2-bab0-fdbd7ba1cde9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:10.977639 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a23bfdc7-9a76-4ce2-bab0-fdbd7ba1cde9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:11.104050 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7aecaaf0-30ad-46d6-a5c0-256860eda62c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:11.104485 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7aecaaf0-30ad-46d6-a5c0-256860eda62c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:11.106079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a23bfdc7-9a76-4ce2-bab0-fdbd7ba1cde9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:11.110574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7aecaaf0-30ad-46d6-a5c0-256860eda62c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:11.111051 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7aecaaf0-30ad-46d6-a5c0-256860eda62c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:11.111835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7aecaaf0-30ad-46d6-a5c0-256860eda62c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:11.112277 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7aecaaf0-30ad-46d6-a5c0-256860eda62c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:11.114414 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a23bfdc7-9a76-4ce2-bab0-fdbd7ba1cde9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:11.115947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a23bfdc7-9a76-4ce2-bab0-fdbd7ba1cde9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:11.117135 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a23bfdc7-9a76-4ce2-bab0-fdbd7ba1cde9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.152140 Jul 21 22:08:11.117694 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 388/850] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:10 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:11.172218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7aecaaf0-30ad-46d6-a5c0-256860eda62c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:11.179613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7aecaaf0-30ad-46d6-a5c0-256860eda62c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079674 Jul 21 22:08:11.180180 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 463/851] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:11 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:08:11.315336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-97c4ec35-e5cd-4b59-822e-6213b7e73a04 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:11.316255 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-97c4ec35-e5cd-4b59-822e-6213b7e73a04 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:11.322613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-97c4ec35-e5cd-4b59-822e-6213b7e73a04 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:11.323092 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-97c4ec35-e5cd-4b59-822e-6213b7e73a04 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:11.323847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-97c4ec35-e5cd-4b59-822e-6213b7e73a04 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:11.324274 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-97c4ec35-e5cd-4b59-822e-6213b7e73a04 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:11.353458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-97c4ec35-e5cd-4b59-822e-6213b7e73a04 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042542 Jul 21 22:08:11.353999 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 389/852] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:11 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:11.366237 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-829f917b-11ab-462b-8f3b-827e4a8f7d6e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:11.367199 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-829f917b-11ab-462b-8f3b-827e4a8f7d6e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:11.373628 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-829f917b-11ab-462b-8f3b-827e4a8f7d6e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:11.374091 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-829f917b-11ab-462b-8f3b-827e4a8f7d6e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:11.374845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-829f917b-11ab-462b-8f3b-827e4a8f7d6e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:11.375325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-829f917b-11ab-462b-8f3b-827e4a8f7d6e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:11.403530 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-829f917b-11ab-462b-8f3b-827e4a8f7d6e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041272 Jul 21 22:08:11.404070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 464/853] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:11 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:12.135707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-011e8fde-23f7-4cd2-8225-bece1c048974 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:12.136313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-011e8fde-23f7-4cd2-8225-bece1c048974 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:12.142851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-011e8fde-23f7-4cd2-8225-bece1c048974 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:12.143331 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-011e8fde-23f7-4cd2-8225-bece1c048974 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:12.144083 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-011e8fde-23f7-4cd2-8225-bece1c048974 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:12.144513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-011e8fde-23f7-4cd2-8225-bece1c048974 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:12.196305 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cf67dd6b-098b-4e6e-ba24-df5bdd3a04bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:12.197176 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cf67dd6b-098b-4e6e-ba24-df5bdd3a04bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:12.203526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cf67dd6b-098b-4e6e-ba24-df5bdd3a04bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:12.203973 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cf67dd6b-098b-4e6e-ba24-df5bdd3a04bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:12.204776 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cf67dd6b-098b-4e6e-ba24-df5bdd3a04bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:12.205208 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cf67dd6b-098b-4e6e-ba24-df5bdd3a04bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:12.274862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cf67dd6b-098b-4e6e-ba24-df5bdd3a04bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:12.282189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cf67dd6b-098b-4e6e-ba24-df5bdd3a04bb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.089905 Jul 21 22:08:12.282907 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 465/854] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:12 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:12.296240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-011e8fde-23f7-4cd2-8225-bece1c048974 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:12.305017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-011e8fde-23f7-4cd2-8225-bece1c048974 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:12.306522 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-011e8fde-23f7-4cd2-8225-bece1c048974 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:12.307703 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-011e8fde-23f7-4cd2-8225-bece1c048974 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.175862 Jul 21 22:08:12.308260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 390/855] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:12 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:12.365372 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-41d57876-0366-4189-aac7-23c1a3b131af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:12.366316 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-41d57876-0366-4189-aac7-23c1a3b131af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:12.372815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41d57876-0366-4189-aac7-23c1a3b131af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:12.373260 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41d57876-0366-4189-aac7-23c1a3b131af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:12.374014 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41d57876-0366-4189-aac7-23c1a3b131af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:12.374445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41d57876-0366-4189-aac7-23c1a3b131af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:12.402816 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-41d57876-0366-4189-aac7-23c1a3b131af tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041878 Jul 21 22:08:12.403403 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 466/856] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:12 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:12.421608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-eb394c19-f0e9-4f87-9272-b8136fa5a971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:12.422521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-eb394c19-f0e9-4f87-9272-b8136fa5a971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:12.429472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eb394c19-f0e9-4f87-9272-b8136fa5a971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:12.429916 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eb394c19-f0e9-4f87-9272-b8136fa5a971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:12.430670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eb394c19-f0e9-4f87-9272-b8136fa5a971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:12.431123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eb394c19-f0e9-4f87-9272-b8136fa5a971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:12.459421 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-eb394c19-f0e9-4f87-9272-b8136fa5a971 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048345 Jul 21 22:08:12.459961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 391/857] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:12 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:13.299438 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0936bf12-1fda-4321-982f-8b2d623b6fba tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:13.300043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0936bf12-1fda-4321-982f-8b2d623b6fba tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:13.306069 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0936bf12-1fda-4321-982f-8b2d623b6fba tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:13.306525 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0936bf12-1fda-4321-982f-8b2d623b6fba tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:13.307332 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0936bf12-1fda-4321-982f-8b2d623b6fba tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:13.307770 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0936bf12-1fda-4321-982f-8b2d623b6fba tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:13.326163 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ab2d1425-8c5c-49c7-8eff-a6f2e023a1db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:13.326776 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ab2d1425-8c5c-49c7-8eff-a6f2e023a1db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:13.332974 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ab2d1425-8c5c-49c7-8eff-a6f2e023a1db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:13.333431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ab2d1425-8c5c-49c7-8eff-a6f2e023a1db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:13.334203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ab2d1425-8c5c-49c7-8eff-a6f2e023a1db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:13.334644 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ab2d1425-8c5c-49c7-8eff-a6f2e023a1db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:13.375862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0936bf12-1fda-4321-982f-8b2d623b6fba tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:13.383563 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0936bf12-1fda-4321-982f-8b2d623b6fba tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.088577 Jul 21 22:08:13.384141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 467/858] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:13 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:13.414475 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3962e8a9-eb9b-4137-9672-8f7cffe71461 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:13.415419 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3962e8a9-eb9b-4137-9672-8f7cffe71461 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:13.421326 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3962e8a9-eb9b-4137-9672-8f7cffe71461 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:13.421768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3962e8a9-eb9b-4137-9672-8f7cffe71461 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:13.422530 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3962e8a9-eb9b-4137-9672-8f7cffe71461 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:13.422953 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3962e8a9-eb9b-4137-9672-8f7cffe71461 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:13.440425 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:13.454254 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3962e8a9-eb9b-4137-9672-8f7cffe71461 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043548 Jul 21 22:08:13.454825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 468/859] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:13 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:13.469154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ab2d1425-8c5c-49c7-8eff-a6f2e023a1db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:13.471925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-739a6b9e-b21e-42af-8e36-2de6c6e46f82 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:13.472901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-739a6b9e-b21e-42af-8e36-2de6c6e46f82 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:13.478252 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ab2d1425-8c5c-49c7-8eff-a6f2e023a1db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:13.478930 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-739a6b9e-b21e-42af-8e36-2de6c6e46f82 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:13.479427 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-739a6b9e-b21e-42af-8e36-2de6c6e46f82 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:13.479806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ab2d1425-8c5c-49c7-8eff-a6f2e023a1db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:13.480200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-739a6b9e-b21e-42af-8e36-2de6c6e46f82 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:13.480636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-739a6b9e-b21e-42af-8e36-2de6c6e46f82 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:13.480966 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ab2d1425-8c5c-49c7-8eff-a6f2e023a1db tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.158645 Jul 21 22:08:13.481750 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 392/860] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:13 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:13.509425 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-739a6b9e-b21e-42af-8e36-2de6c6e46f82 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042141 Jul 21 22:08:13.509976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 469/861] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:13 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:14.399127 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-58d62b3f-71d5-493d-8e7a-bb15740f1e4e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:14.399775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-58d62b3f-71d5-493d-8e7a-bb15740f1e4e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:14.405773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-58d62b3f-71d5-493d-8e7a-bb15740f1e4e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:14.406226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-58d62b3f-71d5-493d-8e7a-bb15740f1e4e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:14.406991 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-58d62b3f-71d5-493d-8e7a-bb15740f1e4e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:14.408038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-58d62b3f-71d5-493d-8e7a-bb15740f1e4e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:14.466093 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-137d76f7-8da9-4f65-9977-c0a770f740a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:14.467077 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-137d76f7-8da9-4f65-9977-c0a770f740a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:14.469145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-58d62b3f-71d5-493d-8e7a-bb15740f1e4e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:14.474299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-137d76f7-8da9-4f65-9977-c0a770f740a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:14.474746 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-137d76f7-8da9-4f65-9977-c0a770f740a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:14.475554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-137d76f7-8da9-4f65-9977-c0a770f740a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:14.475988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-137d76f7-8da9-4f65-9977-c0a770f740a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:14.477347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-58d62b3f-71d5-493d-8e7a-bb15740f1e4e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082055 Jul 21 22:08:14.478381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 393/862] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:14 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:14.500250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6ce4af4d-91bb-455f-ba85-c9a9fede66f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:14.500882 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6ce4af4d-91bb-455f-ba85-c9a9fede66f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:14.502696 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:14.508130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ce4af4d-91bb-455f-ba85-c9a9fede66f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:14.508583 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ce4af4d-91bb-455f-ba85-c9a9fede66f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:14.509384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ce4af4d-91bb-455f-ba85-c9a9fede66f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:14.509817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ce4af4d-91bb-455f-ba85-c9a9fede66f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:14.510968 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-137d76f7-8da9-4f65-9977-c0a770f740a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048971 Jul 21 22:08:14.511581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 470/863] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:14 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:14.521102 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2e8bb710-bd7e-433c-9d0d-aa2f28841c75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:14.522014 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2e8bb710-bd7e-433c-9d0d-aa2f28841c75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:14.528018 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e8bb710-bd7e-433c-9d0d-aa2f28841c75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:14.528477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e8bb710-bd7e-433c-9d0d-aa2f28841c75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:14.529246 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e8bb710-bd7e-433c-9d0d-aa2f28841c75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:14.529685 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e8bb710-bd7e-433c-9d0d-aa2f28841c75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:14.558426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2e8bb710-bd7e-433c-9d0d-aa2f28841c75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041431 Jul 21 22:08:14.558988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 471/864] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:14 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:14.640687 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6ce4af4d-91bb-455f-ba85-c9a9fede66f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:14.649380 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6ce4af4d-91bb-455f-ba85-c9a9fede66f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:14.650809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6ce4af4d-91bb-455f-ba85-c9a9fede66f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:14.651975 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6ce4af4d-91bb-455f-ba85-c9a9fede66f7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.156153 Jul 21 22:08:14.652524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 394/865] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:14 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:15.494006 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-475e26e6-2588-42d9-a17d-312fa58b4fea tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:15.494619 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-475e26e6-2588-42d9-a17d-312fa58b4fea tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:15.501063 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-475e26e6-2588-42d9-a17d-312fa58b4fea tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:15.501547 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-475e26e6-2588-42d9-a17d-312fa58b4fea tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:15.502313 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-475e26e6-2588-42d9-a17d-312fa58b4fea tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:15.502752 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-475e26e6-2588-42d9-a17d-312fa58b4fea tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:15.522327 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-08fa3bc7-679d-493a-afea-b797be2dc069 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:15.523300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-08fa3bc7-679d-493a-afea-b797be2dc069 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:15.529268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-08fa3bc7-679d-493a-afea-b797be2dc069 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:15.529724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-08fa3bc7-679d-493a-afea-b797be2dc069 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:15.530489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-08fa3bc7-679d-493a-afea-b797be2dc069 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:15.530919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-08fa3bc7-679d-493a-afea-b797be2dc069 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:15.570031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-08fa3bc7-679d-493a-afea-b797be2dc069 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051708 Jul 21 22:08:15.573791 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 395/866] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:15 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:15.573965 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-475e26e6-2588-42d9-a17d-312fa58b4fea tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:15.576325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cdbc59e7-1a83-4ae6-b275-ea5a565304e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:15.577237 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cdbc59e7-1a83-4ae6-b275-ea5a565304e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:15.580905 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-475e26e6-2588-42d9-a17d-312fa58b4fea tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.090712 Jul 21 22:08:15.581494 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 472/867] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:15 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:15.583794 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cdbc59e7-1a83-4ae6-b275-ea5a565304e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:15.584253 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cdbc59e7-1a83-4ae6-b275-ea5a565304e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:15.585031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cdbc59e7-1a83-4ae6-b275-ea5a565304e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:15.585470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cdbc59e7-1a83-4ae6-b275-ea5a565304e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:15.613825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cdbc59e7-1a83-4ae6-b275-ea5a565304e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041101 Jul 21 22:08:15.614372 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 396/868] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:15 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:15.670642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-97ad84d8-7eda-4a12-a25c-31f227829e08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:15.671278 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-97ad84d8-7eda-4a12-a25c-31f227829e08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:15.677258 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-97ad84d8-7eda-4a12-a25c-31f227829e08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:15.677704 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-97ad84d8-7eda-4a12-a25c-31f227829e08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:15.678463 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-97ad84d8-7eda-4a12-a25c-31f227829e08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:15.678895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-97ad84d8-7eda-4a12-a25c-31f227829e08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:15.802611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-97ad84d8-7eda-4a12-a25c-31f227829e08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:15.811334 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-97ad84d8-7eda-4a12-a25c-31f227829e08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:15.812811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-97ad84d8-7eda-4a12-a25c-31f227829e08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:15.814487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-97ad84d8-7eda-4a12-a25c-31f227829e08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.147355 Jul 21 22:08:15.815155 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 473/869] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:15 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:16.581628 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9978c64e-7151-443c-b757-d77f6befc307 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:16.582543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9978c64e-7151-443c-b757-d77f6befc307 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:16.589258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9978c64e-7151-443c-b757-d77f6befc307 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:16.589709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9978c64e-7151-443c-b757-d77f6befc307 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:16.590477 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9978c64e-7151-443c-b757-d77f6befc307 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:16.590920 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9978c64e-7151-443c-b757-d77f6befc307 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:16.597226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9e5c86c2-74fb-41af-876d-769fd5d5bc7c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:16.597829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9e5c86c2-74fb-41af-876d-769fd5d5bc7c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:16.604336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e5c86c2-74fb-41af-876d-769fd5d5bc7c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:16.604784 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e5c86c2-74fb-41af-876d-769fd5d5bc7c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:16.605547 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e5c86c2-74fb-41af-876d-769fd5d5bc7c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:16.605981 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e5c86c2-74fb-41af-876d-769fd5d5bc7c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:16.619523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9978c64e-7151-443c-b757-d77f6befc307 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042351 Jul 21 22:08:16.620369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 397/870] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:16 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:16.624877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3883f637-10fd-431a-bd6b-0917ed42d4eb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:16.625785 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3883f637-10fd-431a-bd6b-0917ed42d4eb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:16.632709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3883f637-10fd-431a-bd6b-0917ed42d4eb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:16.633163 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3883f637-10fd-431a-bd6b-0917ed42d4eb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:16.633937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3883f637-10fd-431a-bd6b-0917ed42d4eb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:16.634373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3883f637-10fd-431a-bd6b-0917ed42d4eb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:16.660348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:16.667686 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3883f637-10fd-431a-bd6b-0917ed42d4eb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046314 Jul 21 22:08:16.668268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 398/871] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:16 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:16.674308 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9e5c86c2-74fb-41af-876d-769fd5d5bc7c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:16.682030 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9e5c86c2-74fb-41af-876d-769fd5d5bc7c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.088616 Jul 21 22:08:16.682584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 474/872] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:16 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:08:16.832216 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ebb04ab0-d8eb-4ccf-a853-0b56731cfabb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:16.832742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ebb04ab0-d8eb-4ccf-a853-0b56731cfabb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:16.839199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ebb04ab0-d8eb-4ccf-a853-0b56731cfabb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:16.839656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ebb04ab0-d8eb-4ccf-a853-0b56731cfabb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:16.840422 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ebb04ab0-d8eb-4ccf-a853-0b56731cfabb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:16.840862 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ebb04ab0-d8eb-4ccf-a853-0b56731cfabb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:16.969519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ebb04ab0-d8eb-4ccf-a853-0b56731cfabb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:16.977957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ebb04ab0-d8eb-4ccf-a853-0b56731cfabb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:16.979494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ebb04ab0-d8eb-4ccf-a853-0b56731cfabb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:16.980640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ebb04ab0-d8eb-4ccf-a853-0b56731cfabb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.152415 Jul 21 22:08:16.981200 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 399/873] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:16 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:17.631203 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8a1b61fc-c491-43fe-8bdd-a6f0e635bd8c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:17.632144 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8a1b61fc-c491-43fe-8bdd-a6f0e635bd8c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:17.638541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a1b61fc-c491-43fe-8bdd-a6f0e635bd8c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:17.638985 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a1b61fc-c491-43fe-8bdd-a6f0e635bd8c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:17.639777 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a1b61fc-c491-43fe-8bdd-a6f0e635bd8c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:17.640210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a1b61fc-c491-43fe-8bdd-a6f0e635bd8c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:17.668758 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8a1b61fc-c491-43fe-8bdd-a6f0e635bd8c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041647 Jul 21 22:08:17.669299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 475/874] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:17 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:17.678429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-377619b5-199f-4d83-9515-2df0b0df46b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:17.679368 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-377619b5-199f-4d83-9515-2df0b0df46b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:17.685724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-377619b5-199f-4d83-9515-2df0b0df46b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:17.686171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-377619b5-199f-4d83-9515-2df0b0df46b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:17.686927 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-377619b5-199f-4d83-9515-2df0b0df46b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:17.687383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-377619b5-199f-4d83-9515-2df0b0df46b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:17.698296 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-07431426-c2f6-4ed8-b630-f348556963f1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:17.698910 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-07431426-c2f6-4ed8-b630-f348556963f1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:17.705319 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07431426-c2f6-4ed8-b630-f348556963f1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:17.705773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07431426-c2f6-4ed8-b630-f348556963f1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:17.706542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07431426-c2f6-4ed8-b630-f348556963f1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:17.706979 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07431426-c2f6-4ed8-b630-f348556963f1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:17.716361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-377619b5-199f-4d83-9515-2df0b0df46b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041711 Jul 21 22:08:17.716915 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 400/875] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:17 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:17.768785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-07431426-c2f6-4ed8-b630-f348556963f1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:17.776134 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-07431426-c2f6-4ed8-b630-f348556963f1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081565 Jul 21 22:08:17.776713 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 476/876] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:17 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:08:17.999173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-eb04fd42-b024-4774-ba81-a0d987c1788c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:17.999806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-eb04fd42-b024-4774-ba81-a0d987c1788c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:18.005772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eb04fd42-b024-4774-ba81-a0d987c1788c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:18.006245 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eb04fd42-b024-4774-ba81-a0d987c1788c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:18.007022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eb04fd42-b024-4774-ba81-a0d987c1788c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:18.007452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eb04fd42-b024-4774-ba81-a0d987c1788c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:18.137083 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-eb04fd42-b024-4774-ba81-a0d987c1788c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:18.145784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-eb04fd42-b024-4774-ba81-a0d987c1788c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:18.147334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-eb04fd42-b024-4774-ba81-a0d987c1788c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:18.148464 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-eb04fd42-b024-4774-ba81-a0d987c1788c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.153193 Jul 21 22:08:18.149023 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 401/877] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:17 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:18.680232 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-59cd7023-cb32-4f2e-a3e4-8b2fed8e2dd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:18.681114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-59cd7023-cb32-4f2e-a3e4-8b2fed8e2dd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:18.687704 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-59cd7023-cb32-4f2e-a3e4-8b2fed8e2dd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:18.688158 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-59cd7023-cb32-4f2e-a3e4-8b2fed8e2dd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:18.689434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-59cd7023-cb32-4f2e-a3e4-8b2fed8e2dd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:18.690143 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-59cd7023-cb32-4f2e-a3e4-8b2fed8e2dd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:18.720682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-59cd7023-cb32-4f2e-a3e4-8b2fed8e2dd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044411 Jul 21 22:08:18.721243 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 477/878] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:18 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:18.728442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cba53787-d328-4e5f-8beb-0ab3a2d898b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:18.729353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cba53787-d328-4e5f-8beb-0ab3a2d898b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:18.735824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cba53787-d328-4e5f-8beb-0ab3a2d898b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:18.736268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cba53787-d328-4e5f-8beb-0ab3a2d898b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:18.737019 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cba53787-d328-4e5f-8beb-0ab3a2d898b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:18.737448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cba53787-d328-4e5f-8beb-0ab3a2d898b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:18.765389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cba53787-d328-4e5f-8beb-0ab3a2d898b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040803 Jul 21 22:08:18.765922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 402/879] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:18 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:18.792956 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-088a9bb8-8660-4bb0-81b5-cf0e4b633e32 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:18.793565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-088a9bb8-8660-4bb0-81b5-cf0e4b633e32 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:18.799534 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-088a9bb8-8660-4bb0-81b5-cf0e4b633e32 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:18.799990 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-088a9bb8-8660-4bb0-81b5-cf0e4b633e32 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:18.800759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-088a9bb8-8660-4bb0-81b5-cf0e4b633e32 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:18.801200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-088a9bb8-8660-4bb0-81b5-cf0e4b633e32 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:18.862292 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-088a9bb8-8660-4bb0-81b5-cf0e4b633e32 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:18.869858 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-088a9bb8-8660-4bb0-81b5-cf0e4b633e32 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080669 Jul 21 22:08:18.870424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 478/880] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:18 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:19.167179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a1b7b999-0b6b-4737-8d03-0e265d7a96d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:19.167785 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a1b7b999-0b6b-4737-8d03-0e265d7a96d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:19.173723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1b7b999-0b6b-4737-8d03-0e265d7a96d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:19.174170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1b7b999-0b6b-4737-8d03-0e265d7a96d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:19.174924 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1b7b999-0b6b-4737-8d03-0e265d7a96d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:19.175381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1b7b999-0b6b-4737-8d03-0e265d7a96d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:19.309400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a1b7b999-0b6b-4737-8d03-0e265d7a96d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:19.318097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a1b7b999-0b6b-4737-8d03-0e265d7a96d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:19.319631 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a1b7b999-0b6b-4737-8d03-0e265d7a96d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:19.320768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a1b7b999-0b6b-4737-8d03-0e265d7a96d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.157450 Jul 21 22:08:19.321313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 403/881] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:19 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:19.732145 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d830d5a7-bfd3-4e4f-92b1-d82bed7238fe tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:19.733110 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d830d5a7-bfd3-4e4f-92b1-d82bed7238fe tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:19.739938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d830d5a7-bfd3-4e4f-92b1-d82bed7238fe tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:19.740384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d830d5a7-bfd3-4e4f-92b1-d82bed7238fe tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:19.741136 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d830d5a7-bfd3-4e4f-92b1-d82bed7238fe tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:19.741567 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d830d5a7-bfd3-4e4f-92b1-d82bed7238fe tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:19.769698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d830d5a7-bfd3-4e4f-92b1-d82bed7238fe tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041450 Jul 21 22:08:19.770238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 479/882] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:19 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:19.777598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-681ce435-ee3f-4156-b42b-fec5933d3d9f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:19.778675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-681ce435-ee3f-4156-b42b-fec5933d3d9f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:19.785236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-681ce435-ee3f-4156-b42b-fec5933d3d9f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:19.785697 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-681ce435-ee3f-4156-b42b-fec5933d3d9f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:19.786460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-681ce435-ee3f-4156-b42b-fec5933d3d9f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:19.786894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-681ce435-ee3f-4156-b42b-fec5933d3d9f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:19.816145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-681ce435-ee3f-4156-b42b-fec5933d3d9f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042448 Jul 21 22:08:19.816691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 404/883] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:19 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:19.886077 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2000009d-fbcc-4941-9a37-9b1031f83201 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:19.886686 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2000009d-fbcc-4941-9a37-9b1031f83201 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:19.893229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2000009d-fbcc-4941-9a37-9b1031f83201 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:19.893678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2000009d-fbcc-4941-9a37-9b1031f83201 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:19.894446 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2000009d-fbcc-4941-9a37-9b1031f83201 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:19.894880 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2000009d-fbcc-4941-9a37-9b1031f83201 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:19.958032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2000009d-fbcc-4941-9a37-9b1031f83201 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:19.965773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2000009d-fbcc-4941-9a37-9b1031f83201 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083553 Jul 21 22:08:19.966340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 480/884] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:19 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:20.339384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-557de2a5-8688-4278-9e75-5bb3cc9527a7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:20.339986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-557de2a5-8688-4278-9e75-5bb3cc9527a7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:20.345934 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-557de2a5-8688-4278-9e75-5bb3cc9527a7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:20.346452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-557de2a5-8688-4278-9e75-5bb3cc9527a7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:20.347244 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-557de2a5-8688-4278-9e75-5bb3cc9527a7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:20.347677 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-557de2a5-8688-4278-9e75-5bb3cc9527a7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:20.472534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-557de2a5-8688-4278-9e75-5bb3cc9527a7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:20.480992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-557de2a5-8688-4278-9e75-5bb3cc9527a7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:20.482514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-557de2a5-8688-4278-9e75-5bb3cc9527a7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:20.483778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-557de2a5-8688-4278-9e75-5bb3cc9527a7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.148492 Jul 21 22:08:20.484245 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 405/885] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:20 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:20.781268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e039e034-478c-45f8-b92d-64ec79904447 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:20.782102 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e039e034-478c-45f8-b92d-64ec79904447 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:20.789315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e039e034-478c-45f8-b92d-64ec79904447 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:20.789768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e039e034-478c-45f8-b92d-64ec79904447 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:20.790554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e039e034-478c-45f8-b92d-64ec79904447 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:20.791018 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e039e034-478c-45f8-b92d-64ec79904447 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:20.819247 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e039e034-478c-45f8-b92d-64ec79904447 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041959 Jul 21 22:08:20.819793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 481/886] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:20 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:20.827430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b58ccae0-b707-4831-8d7d-f85710a78300 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:20.828352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b58ccae0-b707-4831-8d7d-f85710a78300 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:20.834705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b58ccae0-b707-4831-8d7d-f85710a78300 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:20.835196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b58ccae0-b707-4831-8d7d-f85710a78300 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:20.835961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b58ccae0-b707-4831-8d7d-f85710a78300 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:20.836399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b58ccae0-b707-4831-8d7d-f85710a78300 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:20.869271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b58ccae0-b707-4831-8d7d-f85710a78300 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045473 Jul 21 22:08:20.869723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 406/887] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:20 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:20.982189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-811bdda9-6b33-4f0c-b8b5-f64b6937f353 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:20.982788 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-811bdda9-6b33-4f0c-b8b5-f64b6937f353 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:20.989484 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-811bdda9-6b33-4f0c-b8b5-f64b6937f353 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:20.989933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-811bdda9-6b33-4f0c-b8b5-f64b6937f353 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:20.990715 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-811bdda9-6b33-4f0c-b8b5-f64b6937f353 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:20.991178 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-811bdda9-6b33-4f0c-b8b5-f64b6937f353 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:21.050341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-811bdda9-6b33-4f0c-b8b5-f64b6937f353 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:21.057710 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-811bdda9-6b33-4f0c-b8b5-f64b6937f353 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079359 Jul 21 22:08:21.058268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 482/888] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:20 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:21.502513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-15683e46-0813-4b41-8dbe-ba34ad5a2a82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:21.503160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-15683e46-0813-4b41-8dbe-ba34ad5a2a82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:21.509199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15683e46-0813-4b41-8dbe-ba34ad5a2a82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:21.509644 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15683e46-0813-4b41-8dbe-ba34ad5a2a82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:21.510407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15683e46-0813-4b41-8dbe-ba34ad5a2a82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:21.510869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15683e46-0813-4b41-8dbe-ba34ad5a2a82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:21.640167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-15683e46-0813-4b41-8dbe-ba34ad5a2a82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:21.649070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-15683e46-0813-4b41-8dbe-ba34ad5a2a82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:21.650576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-15683e46-0813-4b41-8dbe-ba34ad5a2a82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:21.651745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-15683e46-0813-4b41-8dbe-ba34ad5a2a82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.153730 Jul 21 22:08:21.652300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 407/889] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:21 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:21.830874 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7b0558c6-1173-416c-a10f-239ebeed0c40 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:21.831824 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7b0558c6-1173-416c-a10f-239ebeed0c40 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:21.839202 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b0558c6-1173-416c-a10f-239ebeed0c40 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:21.839648 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b0558c6-1173-416c-a10f-239ebeed0c40 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:21.840407 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b0558c6-1173-416c-a10f-239ebeed0c40 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:21.840840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b0558c6-1173-416c-a10f-239ebeed0c40 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:21.869129 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7b0558c6-1173-416c-a10f-239ebeed0c40 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042206 Jul 21 22:08:21.869672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 483/890] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:21 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:21.881240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-249b7016-2b67-49ca-8530-63cc4dd2a77e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:21.882375 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-249b7016-2b67-49ca-8530-63cc4dd2a77e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:21.889055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-249b7016-2b67-49ca-8530-63cc4dd2a77e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:21.889499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-249b7016-2b67-49ca-8530-63cc4dd2a77e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:21.890255 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-249b7016-2b67-49ca-8530-63cc4dd2a77e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:21.890684 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-249b7016-2b67-49ca-8530-63cc4dd2a77e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:21.919458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-249b7016-2b67-49ca-8530-63cc4dd2a77e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041933 Jul 21 22:08:21.920002 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 408/891] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:21 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:22.074284 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d41455eb-d52b-47f1-adca-84c400026b0a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:22.074831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d41455eb-d52b-47f1-adca-84c400026b0a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:22.080891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d41455eb-d52b-47f1-adca-84c400026b0a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:22.081349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d41455eb-d52b-47f1-adca-84c400026b0a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:22.082120 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d41455eb-d52b-47f1-adca-84c400026b0a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:22.082564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d41455eb-d52b-47f1-adca-84c400026b0a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:22.142327 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d41455eb-d52b-47f1-adca-84c400026b0a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:22.149707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d41455eb-d52b-47f1-adca-84c400026b0a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079321 Jul 21 22:08:22.150276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 484/892] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:22 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:22.669836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-99a4f882-62f8-4040-970e-fe05ccfcfff8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:22.670435 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-99a4f882-62f8-4040-970e-fe05ccfcfff8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:22.676403 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-99a4f882-62f8-4040-970e-fe05ccfcfff8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:22.676851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-99a4f882-62f8-4040-970e-fe05ccfcfff8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:22.677597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-99a4f882-62f8-4040-970e-fe05ccfcfff8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:22.678030 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-99a4f882-62f8-4040-970e-fe05ccfcfff8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:22.807622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-99a4f882-62f8-4040-970e-fe05ccfcfff8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:22.815922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-99a4f882-62f8-4040-970e-fe05ccfcfff8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:22.817415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-99a4f882-62f8-4040-970e-fe05ccfcfff8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:22.818554 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-99a4f882-62f8-4040-970e-fe05ccfcfff8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.152722 Jul 21 22:08:22.819142 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 409/893] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:22 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:22.880942 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8a780106-7a2c-4195-b47c-1e40e52b566d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:22.881948 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8a780106-7a2c-4195-b47c-1e40e52b566d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:22.888638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a780106-7a2c-4195-b47c-1e40e52b566d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:22.889082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a780106-7a2c-4195-b47c-1e40e52b566d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:22.889847 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a780106-7a2c-4195-b47c-1e40e52b566d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:22.890278 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a780106-7a2c-4195-b47c-1e40e52b566d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:22.894433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:22.920011 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8a780106-7a2c-4195-b47c-1e40e52b566d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043311 Jul 21 22:08:22.920586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 485/894] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:22 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:22.931945 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-831812d6-1115-4103-8277-48c2cefe5e22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:22.933571 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-831812d6-1115-4103-8277-48c2cefe5e22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:22.941541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-831812d6-1115-4103-8277-48c2cefe5e22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:22.941995 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-831812d6-1115-4103-8277-48c2cefe5e22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:22.942775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-831812d6-1115-4103-8277-48c2cefe5e22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:22.943240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-831812d6-1115-4103-8277-48c2cefe5e22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:22.975716 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-831812d6-1115-4103-8277-48c2cefe5e22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048012 Jul 21 22:08:22.976280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 410/895] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:22 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:23.166301 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fb28cb8e-65e5-4d0e-817a-216206c95803 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:23.167029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fb28cb8e-65e5-4d0e-817a-216206c95803 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:23.173009 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb28cb8e-65e5-4d0e-817a-216206c95803 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:23.173453 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb28cb8e-65e5-4d0e-817a-216206c95803 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:23.174208 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb28cb8e-65e5-4d0e-817a-216206c95803 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:23.174640 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb28cb8e-65e5-4d0e-817a-216206c95803 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:23.240252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fb28cb8e-65e5-4d0e-817a-216206c95803 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:23.247987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fb28cb8e-65e5-4d0e-817a-216206c95803 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.085660 Jul 21 22:08:23.248556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 486/896] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:23 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:23.836570 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d3195ed2-961b-4db4-a6ee-1afac09bfa5d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:23.837441 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d3195ed2-961b-4db4-a6ee-1afac09bfa5d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:23.843771 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d3195ed2-961b-4db4-a6ee-1afac09bfa5d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:23.844223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d3195ed2-961b-4db4-a6ee-1afac09bfa5d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:23.845477 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d3195ed2-961b-4db4-a6ee-1afac09bfa5d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:23.845914 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d3195ed2-961b-4db4-a6ee-1afac09bfa5d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:23.931547 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9348d831-60f8-41d3-a3d5-e08cadad208c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:23.932474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9348d831-60f8-41d3-a3d5-e08cadad208c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:23.939128 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9348d831-60f8-41d3-a3d5-e08cadad208c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:23.939622 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9348d831-60f8-41d3-a3d5-e08cadad208c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:23.940410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9348d831-60f8-41d3-a3d5-e08cadad208c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:23.940851 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9348d831-60f8-41d3-a3d5-e08cadad208c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:23.970532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9348d831-60f8-41d3-a3d5-e08cadad208c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042267 Jul 21 22:08:23.974347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 487/897] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:23 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:23.979329 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d3195ed2-961b-4db4-a6ee-1afac09bfa5d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:23.987700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f51c853b-e3b9-4ebf-82c1-2bd684c9b151 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:23.988493 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d3195ed2-961b-4db4-a6ee-1afac09bfa5d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:23.988621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f51c853b-e3b9-4ebf-82c1-2bd684c9b151 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:23.989991 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d3195ed2-961b-4db4-a6ee-1afac09bfa5d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:23.991198 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d3195ed2-961b-4db4-a6ee-1afac09bfa5d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.158498 Jul 21 22:08:23.991746 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 411/898] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:23 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:23.994571 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f51c853b-e3b9-4ebf-82c1-2bd684c9b151 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:23.995054 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f51c853b-e3b9-4ebf-82c1-2bd684c9b151 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:23.995824 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f51c853b-e3b9-4ebf-82c1-2bd684c9b151 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:23.996259 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f51c853b-e3b9-4ebf-82c1-2bd684c9b151 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:24.024581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f51c853b-e3b9-4ebf-82c1-2bd684c9b151 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041416 Jul 21 22:08:24.025131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 488/899] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:23 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:24.267358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fe01e088-eb61-4ef2-8bc5-556f5a4449ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:24.267977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fe01e088-eb61-4ef2-8bc5-556f5a4449ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:24.274068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe01e088-eb61-4ef2-8bc5-556f5a4449ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:24.274531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe01e088-eb61-4ef2-8bc5-556f5a4449ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:24.275396 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe01e088-eb61-4ef2-8bc5-556f5a4449ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:24.275813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe01e088-eb61-4ef2-8bc5-556f5a4449ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:24.287174 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fc4c4083-0152-430a-8357-c8324aaf909e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:24.287678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fc4c4083-0152-430a-8357-c8324aaf909e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:24.298549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc4c4083-0152-430a-8357-c8324aaf909e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:24.298549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc4c4083-0152-430a-8357-c8324aaf909e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:24.298549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc4c4083-0152-430a-8357-c8324aaf909e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:24.298549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc4c4083-0152-430a-8357-c8324aaf909e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:24.345960 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fe01e088-eb61-4ef2-8bc5-556f5a4449ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:24.353906 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fe01e088-eb61-4ef2-8bc5-556f5a4449ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.090340 Jul 21 22:08:24.354502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 412/900] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:24 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:24.983760 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-11d48b89-19ea-4f06-bef8-08b5c0ae3d7f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:24.984706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-11d48b89-19ea-4f06-bef8-08b5c0ae3d7f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:24.991696 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-11d48b89-19ea-4f06-bef8-08b5c0ae3d7f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:24.992151 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-11d48b89-19ea-4f06-bef8-08b5c0ae3d7f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:24.993229 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-11d48b89-19ea-4f06-bef8-08b5c0ae3d7f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:24.993667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-11d48b89-19ea-4f06-bef8-08b5c0ae3d7f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:25.026752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-11d48b89-19ea-4f06-bef8-08b5c0ae3d7f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048476 Jul 21 22:08:25.027330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 413/901] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:24 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:25.031606 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4bf06fd6-42e5-43ef-bcc6-2d1d0c76b7ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:25.032203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4bf06fd6-42e5-43ef-bcc6-2d1d0c76b7ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:25.037749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bf06fd6-42e5-43ef-bcc6-2d1d0c76b7ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:25.038196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bf06fd6-42e5-43ef-bcc6-2d1d0c76b7ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:25.038954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bf06fd6-42e5-43ef-bcc6-2d1d0c76b7ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:25.039414 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bf06fd6-42e5-43ef-bcc6-2d1d0c76b7ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:25.167804 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4bf06fd6-42e5-43ef-bcc6-2d1d0c76b7ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:25.176578 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4bf06fd6-42e5-43ef-bcc6-2d1d0c76b7ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:25.178097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4bf06fd6-42e5-43ef-bcc6-2d1d0c76b7ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:25.179281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4bf06fd6-42e5-43ef-bcc6-2d1d0c76b7ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151019 Jul 21 22:08:25.179844 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 414/902] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:25 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:08:25.184254 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-71d7a3ca-b41a-49f0-b5e9-2a59c80384cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:25.185162 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-71d7a3ca-b41a-49f0-b5e9-2a59c80384cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:25.191402 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71d7a3ca-b41a-49f0-b5e9-2a59c80384cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:25.191851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71d7a3ca-b41a-49f0-b5e9-2a59c80384cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:25.192624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71d7a3ca-b41a-49f0-b5e9-2a59c80384cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:25.193062 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71d7a3ca-b41a-49f0-b5e9-2a59c80384cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:25.208822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:25.221975 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-71d7a3ca-b41a-49f0-b5e9-2a59c80384cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041147 Jul 21 22:08:25.222528 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 415/903] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:25 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:25.373265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-31aa6984-2011-49d1-be10-eebce2b99626 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:25.374192 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-31aa6984-2011-49d1-be10-eebce2b99626 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:25.382982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31aa6984-2011-49d1-be10-eebce2b99626 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:25.383721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31aa6984-2011-49d1-be10-eebce2b99626 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:25.384978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31aa6984-2011-49d1-be10-eebce2b99626 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:25.385609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31aa6984-2011-49d1-be10-eebce2b99626 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:25.446283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-31aa6984-2011-49d1-be10-eebce2b99626 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:25.453748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-31aa6984-2011-49d1-be10-eebce2b99626 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.086402 Jul 21 22:08:25.454338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 416/904] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:25 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:08:26.038314 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5694ea7c-ccf5-4050-b34c-e16a72af8310 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:26.039343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5694ea7c-ccf5-4050-b34c-e16a72af8310 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:26.045738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5694ea7c-ccf5-4050-b34c-e16a72af8310 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:26.046193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5694ea7c-ccf5-4050-b34c-e16a72af8310 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:26.046963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5694ea7c-ccf5-4050-b34c-e16a72af8310 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:26.047494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5694ea7c-ccf5-4050-b34c-e16a72af8310 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:26.076155 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5694ea7c-ccf5-4050-b34c-e16a72af8310 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041698 Jul 21 22:08:26.076645 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 417/905] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:26 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:26.197914 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-39ff9d2e-537a-4591-8629-3d819e012956 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:26.198506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-39ff9d2e-537a-4591-8629-3d819e012956 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:26.204964 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-39ff9d2e-537a-4591-8629-3d819e012956 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:26.205415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-39ff9d2e-537a-4591-8629-3d819e012956 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:26.206169 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-39ff9d2e-537a-4591-8629-3d819e012956 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:26.206601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-39ff9d2e-537a-4591-8629-3d819e012956 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:26.331102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-39ff9d2e-537a-4591-8629-3d819e012956 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:26.339728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-39ff9d2e-537a-4591-8629-3d819e012956 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:26.341222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-39ff9d2e-537a-4591-8629-3d819e012956 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:26.342377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-39ff9d2e-537a-4591-8629-3d819e012956 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.148246 Jul 21 22:08:26.342937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 418/906] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:26 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:26.347399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c0f74004-76cf-4c00-920f-0679e8a82c50 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:26.348317 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c0f74004-76cf-4c00-920f-0679e8a82c50 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:26.353840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c0f74004-76cf-4c00-920f-0679e8a82c50 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:26.354286 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c0f74004-76cf-4c00-920f-0679e8a82c50 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:26.355055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c0f74004-76cf-4c00-920f-0679e8a82c50 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:26.355485 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c0f74004-76cf-4c00-920f-0679e8a82c50 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:26.383362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c0f74004-76cf-4c00-920f-0679e8a82c50 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039405 Jul 21 22:08:26.383981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 419/907] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:26 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:26.471889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a7330825-36d4-40d1-baa4-4400baffdc21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:26.472493 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a7330825-36d4-40d1-baa4-4400baffdc21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:26.478486 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7330825-36d4-40d1-baa4-4400baffdc21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:26.478943 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7330825-36d4-40d1-baa4-4400baffdc21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:26.479742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7330825-36d4-40d1-baa4-4400baffdc21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:26.480177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7330825-36d4-40d1-baa4-4400baffdc21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:26.543027 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a7330825-36d4-40d1-baa4-4400baffdc21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:26.550862 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a7330825-36d4-40d1-baa4-4400baffdc21 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082684 Jul 21 22:08:26.551448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 420/908] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:26 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:08:27.088892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-77c5ddfa-093e-4273-b755-5c5038c64141 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:27.089813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-77c5ddfa-093e-4273-b755-5c5038c64141 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:27.096313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77c5ddfa-093e-4273-b755-5c5038c64141 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:27.096758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77c5ddfa-093e-4273-b755-5c5038c64141 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:27.097512 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77c5ddfa-093e-4273-b755-5c5038c64141 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:27.097946 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77c5ddfa-093e-4273-b755-5c5038c64141 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:27.125591 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-77c5ddfa-093e-4273-b755-5c5038c64141 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040990 Jul 21 22:08:27.126125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 421/909] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:27 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:27.360471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-229072f2-6b49-4571-a798-1497a7ed0dd3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:27.360991 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-229072f2-6b49-4571-a798-1497a7ed0dd3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:27.366798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-229072f2-6b49-4571-a798-1497a7ed0dd3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:27.367279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-229072f2-6b49-4571-a798-1497a7ed0dd3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:27.368037 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-229072f2-6b49-4571-a798-1497a7ed0dd3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:27.368468 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-229072f2-6b49-4571-a798-1497a7ed0dd3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:27.496475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-229072f2-6b49-4571-a798-1497a7ed0dd3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:27.504783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-229072f2-6b49-4571-a798-1497a7ed0dd3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:27.506284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-229072f2-6b49-4571-a798-1497a7ed0dd3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:27.507458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-229072f2-6b49-4571-a798-1497a7ed0dd3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.150844 Jul 21 22:08:27.508004 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 422/910] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:27 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:27.512368 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2e65dbb6-3d1a-4b2c-a106-7237ab6341d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:27.513262 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2e65dbb6-3d1a-4b2c-a106-7237ab6341d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:27.519337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e65dbb6-3d1a-4b2c-a106-7237ab6341d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:27.519778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e65dbb6-3d1a-4b2c-a106-7237ab6341d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:27.520530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e65dbb6-3d1a-4b2c-a106-7237ab6341d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:27.520958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e65dbb6-3d1a-4b2c-a106-7237ab6341d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:27.548988 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2e65dbb6-3d1a-4b2c-a106-7237ab6341d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040031 Jul 21 22:08:27.549516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 423/911] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:27 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:27.567477 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e1bcae0a-c49f-4655-a397-0375d39abc90 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:27.568077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e1bcae0a-c49f-4655-a397-0375d39abc90 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:27.573823 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1bcae0a-c49f-4655-a397-0375d39abc90 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:27.574272 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1bcae0a-c49f-4655-a397-0375d39abc90 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:27.575056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1bcae0a-c49f-4655-a397-0375d39abc90 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:27.575493 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1bcae0a-c49f-4655-a397-0375d39abc90 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:27.634889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e1bcae0a-c49f-4655-a397-0375d39abc90 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:27.642638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e1bcae0a-c49f-4655-a397-0375d39abc90 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078579 Jul 21 22:08:27.643221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 424/912] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:27 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:08:28.137827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c9cc1704-80bf-4ffb-89e9-ffaba9bf7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:28.138788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c9cc1704-80bf-4ffb-89e9-ffaba9bf7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:28.145412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c9cc1704-80bf-4ffb-89e9-ffaba9bf7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:28.145884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c9cc1704-80bf-4ffb-89e9-ffaba9bf7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:28.146664 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c9cc1704-80bf-4ffb-89e9-ffaba9bf7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:28.147132 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c9cc1704-80bf-4ffb-89e9-ffaba9bf7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:28.176580 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c9cc1704-80bf-4ffb-89e9-ffaba9bf7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042649 Jul 21 22:08:28.177054 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 425/913] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:28 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:28.525628 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-43174267-f2fe-407f-b3f6-cb0c95801de7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:28.526242 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-43174267-f2fe-407f-b3f6-cb0c95801de7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:28.532852 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-43174267-f2fe-407f-b3f6-cb0c95801de7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:28.533306 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-43174267-f2fe-407f-b3f6-cb0c95801de7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:28.534065 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-43174267-f2fe-407f-b3f6-cb0c95801de7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:28.534500 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-43174267-f2fe-407f-b3f6-cb0c95801de7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:28.664590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-43174267-f2fe-407f-b3f6-cb0c95801de7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:28.673027 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-43174267-f2fe-407f-b3f6-cb0c95801de7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:28.674528 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-43174267-f2fe-407f-b3f6-cb0c95801de7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:28.675705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-43174267-f2fe-407f-b3f6-cb0c95801de7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.154012 Jul 21 22:08:28.676256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 426/914] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:28 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:28.680622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f98abe64-ba66-4a5a-91db-8464275f0a94 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:28.681529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f98abe64-ba66-4a5a-91db-8464275f0a94 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:28.687068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f98abe64-ba66-4a5a-91db-8464275f0a94 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:28.687517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f98abe64-ba66-4a5a-91db-8464275f0a94 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:28.688278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f98abe64-ba66-4a5a-91db-8464275f0a94 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:28.688706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f98abe64-ba66-4a5a-91db-8464275f0a94 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:28.716882 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f98abe64-ba66-4a5a-91db-8464275f0a94 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039679 Jul 21 22:08:28.717418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 427/915] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:28 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:28.721665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-725287f8-dd43-4308-8c52-7fb7d803b47c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:28.722255 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-725287f8-dd43-4308-8c52-7fb7d803b47c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:28.727660 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-725287f8-dd43-4308-8c52-7fb7d803b47c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:28.728111 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-725287f8-dd43-4308-8c52-7fb7d803b47c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:28.728863 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-725287f8-dd43-4308-8c52-7fb7d803b47c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:28.729300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-725287f8-dd43-4308-8c52-7fb7d803b47c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:28.788478 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-725287f8-dd43-4308-8c52-7fb7d803b47c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:28.795831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-725287f8-dd43-4308-8c52-7fb7d803b47c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.077518 Jul 21 22:08:28.796391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 428/916] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:28 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:29.188071 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-30a30ca7-9399-4fe9-b19e-bf3f6dcc2079 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:29.188988 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-30a30ca7-9399-4fe9-b19e-bf3f6dcc2079 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:29.195424 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-30a30ca7-9399-4fe9-b19e-bf3f6dcc2079 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:29.195870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-30a30ca7-9399-4fe9-b19e-bf3f6dcc2079 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:29.196634 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-30a30ca7-9399-4fe9-b19e-bf3f6dcc2079 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:29.197065 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-30a30ca7-9399-4fe9-b19e-bf3f6dcc2079 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:29.225555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-30a30ca7-9399-4fe9-b19e-bf3f6dcc2079 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041468 Jul 21 22:08:29.226100 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 429/917] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:29 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:29.694470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ee2a7cb8-95a3-41f7-8faa-77b184badf3d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:29.695099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ee2a7cb8-95a3-41f7-8faa-77b184badf3d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:29.701065 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ee2a7cb8-95a3-41f7-8faa-77b184badf3d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:29.701506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ee2a7cb8-95a3-41f7-8faa-77b184badf3d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:29.702260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ee2a7cb8-95a3-41f7-8faa-77b184badf3d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:29.702688 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ee2a7cb8-95a3-41f7-8faa-77b184badf3d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:29.827818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ee2a7cb8-95a3-41f7-8faa-77b184badf3d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:29.835990 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ee2a7cb8-95a3-41f7-8faa-77b184badf3d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:29.837756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ee2a7cb8-95a3-41f7-8faa-77b184badf3d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:29.838924 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ee2a7cb8-95a3-41f7-8faa-77b184badf3d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.148297 Jul 21 22:08:29.839506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 430/918] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:29 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:29.844000 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d855b2c5-449c-4625-acec-ab9c9d3d12f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:29.845415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d855b2c5-449c-4625-acec-ab9c9d3d12f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:29.850888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d855b2c5-449c-4625-acec-ab9c9d3d12f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:29.851366 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d855b2c5-449c-4625-acec-ab9c9d3d12f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:29.852123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d855b2c5-449c-4625-acec-ab9c9d3d12f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:29.852555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d855b2c5-449c-4625-acec-ab9c9d3d12f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:29.881901 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d855b2c5-449c-4625-acec-ab9c9d3d12f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041392 Jul 21 22:08:29.882458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 431/919] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:29 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:29.886667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5869218e-8f49-41d9-9495-6f33b0fc13e8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:29.887295 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5869218e-8f49-41d9-9495-6f33b0fc13e8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:29.892754 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5869218e-8f49-41d9-9495-6f33b0fc13e8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:29.893204 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5869218e-8f49-41d9-9495-6f33b0fc13e8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:29.893964 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5869218e-8f49-41d9-9495-6f33b0fc13e8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:29.894397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5869218e-8f49-41d9-9495-6f33b0fc13e8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:29.898207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:29.957772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5869218e-8f49-41d9-9495-6f33b0fc13e8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:29.965402 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5869218e-8f49-41d9-9495-6f33b0fc13e8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082039 Jul 21 22:08:29.965962 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 432/920] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:29 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:30.236622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-66cfbc87-441a-40ca-872e-1fd4980584f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:30.237536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-66cfbc87-441a-40ca-872e-1fd4980584f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:30.243949 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66cfbc87-441a-40ca-872e-1fd4980584f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:30.244397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66cfbc87-441a-40ca-872e-1fd4980584f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:30.245159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66cfbc87-441a-40ca-872e-1fd4980584f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:30.245590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66cfbc87-441a-40ca-872e-1fd4980584f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:30.419719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-66cfbc87-441a-40ca-872e-1fd4980584f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.186980 Jul 21 22:08:30.420270 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 433/921] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:30 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:30.857308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-edd24b43-cf8d-4558-b106-693e7d51a849 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:30.857911 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-edd24b43-cf8d-4558-b106-693e7d51a849 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:30.864024 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-edd24b43-cf8d-4558-b106-693e7d51a849 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:30.864466 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-edd24b43-cf8d-4558-b106-693e7d51a849 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:30.865226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-edd24b43-cf8d-4558-b106-693e7d51a849 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:30.865653 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-edd24b43-cf8d-4558-b106-693e7d51a849 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:30.992133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-edd24b43-cf8d-4558-b106-693e7d51a849 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:31.000384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-edd24b43-cf8d-4558-b106-693e7d51a849 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:31.001998 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-edd24b43-cf8d-4558-b106-693e7d51a849 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:31.003168 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-edd24b43-cf8d-4558-b106-693e7d51a849 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.149703 Jul 21 22:08:31.003707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 434/922] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:30 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:31.008063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8c9ae497-fedb-430f-9d1d-d60a25467863 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:31.008955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8c9ae497-fedb-430f-9d1d-d60a25467863 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:31.014384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c9ae497-fedb-430f-9d1d-d60a25467863 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:31.014829 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c9ae497-fedb-430f-9d1d-d60a25467863 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:31.015621 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c9ae497-fedb-430f-9d1d-d60a25467863 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:31.016055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c9ae497-fedb-430f-9d1d-d60a25467863 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:31.046082 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8c9ae497-fedb-430f-9d1d-d60a25467863 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041357 Jul 21 22:08:31.046622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 435/923] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:31 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:31.052057 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dc8353af-b42d-44cd-a7fc-5f4ae7998c41 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:31.052654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dc8353af-b42d-44cd-a7fc-5f4ae7998c41 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:31.058406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc8353af-b42d-44cd-a7fc-5f4ae7998c41 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:31.058852 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc8353af-b42d-44cd-a7fc-5f4ae7998c41 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:31.059641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc8353af-b42d-44cd-a7fc-5f4ae7998c41 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:31.060076 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc8353af-b42d-44cd-a7fc-5f4ae7998c41 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:31.119852 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dc8353af-b42d-44cd-a7fc-5f4ae7998c41 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:31.127108 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dc8353af-b42d-44cd-a7fc-5f4ae7998c41 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079527 Jul 21 22:08:31.127650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 436/924] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:31 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:31.431249 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7dff6233-e529-4ba0-861f-ce56a3bc4ef5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:31.432219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7dff6233-e529-4ba0-861f-ce56a3bc4ef5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:31.438560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7dff6233-e529-4ba0-861f-ce56a3bc4ef5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:31.439550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7dff6233-e529-4ba0-861f-ce56a3bc4ef5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:31.440306 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7dff6233-e529-4ba0-861f-ce56a3bc4ef5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:31.440732 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7dff6233-e529-4ba0-861f-ce56a3bc4ef5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:31.469313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7dff6233-e529-4ba0-861f-ce56a3bc4ef5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041975 Jul 21 22:08:31.469849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 437/925] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:31 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:32.021546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-aeeb731b-2d26-4f64-a62b-8294124adc64 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:32.022151 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-aeeb731b-2d26-4f64-a62b-8294124adc64 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:32.028202 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aeeb731b-2d26-4f64-a62b-8294124adc64 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:32.028650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aeeb731b-2d26-4f64-a62b-8294124adc64 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:32.029409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aeeb731b-2d26-4f64-a62b-8294124adc64 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:32.029844 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aeeb731b-2d26-4f64-a62b-8294124adc64 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:32.160588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-aeeb731b-2d26-4f64-a62b-8294124adc64 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:32.168825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-aeeb731b-2d26-4f64-a62b-8294124adc64 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:32.170335 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-aeeb731b-2d26-4f64-a62b-8294124adc64 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:32.171520 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-aeeb731b-2d26-4f64-a62b-8294124adc64 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.153820 Jul 21 22:08:32.172268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 438/926] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:32 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:32.176678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cd57e70f-2bd9-4558-8ee4-2b97e6449ec1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:32.177592 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cd57e70f-2bd9-4558-8ee4-2b97e6449ec1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:32.183129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd57e70f-2bd9-4558-8ee4-2b97e6449ec1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:32.183580 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd57e70f-2bd9-4558-8ee4-2b97e6449ec1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:32.184341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd57e70f-2bd9-4558-8ee4-2b97e6449ec1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:32.184778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd57e70f-2bd9-4558-8ee4-2b97e6449ec1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:32.214384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cd57e70f-2bd9-4558-8ee4-2b97e6449ec1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041091 Jul 21 22:08:32.214921 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 439/927] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:32 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:32.219150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a82ca362-1e4b-43cf-80bf-6f7e81b0f7d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:32.219748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a82ca362-1e4b-43cf-80bf-6f7e81b0f7d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:32.225216 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a82ca362-1e4b-43cf-80bf-6f7e81b0f7d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:32.225667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a82ca362-1e4b-43cf-80bf-6f7e81b0f7d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:32.226427 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a82ca362-1e4b-43cf-80bf-6f7e81b0f7d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:32.226861 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a82ca362-1e4b-43cf-80bf-6f7e81b0f7d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:32.287349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a82ca362-1e4b-43cf-80bf-6f7e81b0f7d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:32.295024 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a82ca362-1e4b-43cf-80bf-6f7e81b0f7d4 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079093 Jul 21 22:08:32.295594 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 440/928] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:32 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:32.480866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4bbb0cf4-7adb-43da-a26c-5db4363562d5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:32.481784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4bbb0cf4-7adb-43da-a26c-5db4363562d5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:32.488795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bbb0cf4-7adb-43da-a26c-5db4363562d5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:32.489240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bbb0cf4-7adb-43da-a26c-5db4363562d5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:32.490003 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bbb0cf4-7adb-43da-a26c-5db4363562d5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:32.490438 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bbb0cf4-7adb-43da-a26c-5db4363562d5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:32.518909 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4bbb0cf4-7adb-43da-a26c-5db4363562d5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042143 Jul 21 22:08:32.519482 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 441/929] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:32 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:33.190400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6c4a7cf3-c401-4a26-b867-dd6b59fde358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:33.191027 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6c4a7cf3-c401-4a26-b867-dd6b59fde358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:33.197042 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c4a7cf3-c401-4a26-b867-dd6b59fde358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:33.197497 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c4a7cf3-c401-4a26-b867-dd6b59fde358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:33.198273 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c4a7cf3-c401-4a26-b867-dd6b59fde358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:33.198714 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c4a7cf3-c401-4a26-b867-dd6b59fde358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:33.323908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6c4a7cf3-c401-4a26-b867-dd6b59fde358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:33.332179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6c4a7cf3-c401-4a26-b867-dd6b59fde358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:33.333671 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6c4a7cf3-c401-4a26-b867-dd6b59fde358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:33.334811 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6c4a7cf3-c401-4a26-b867-dd6b59fde358 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.149023 Jul 21 22:08:33.335385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 442/930] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:33 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:33.340656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f1bf1a5d-1a44-45cc-a851-001a205eea33 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:33.341572 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f1bf1a5d-1a44-45cc-a851-001a205eea33 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:33.347758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1bf1a5d-1a44-45cc-a851-001a205eea33 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:33.348212 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1bf1a5d-1a44-45cc-a851-001a205eea33 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:33.348981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1bf1a5d-1a44-45cc-a851-001a205eea33 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:33.349410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1bf1a5d-1a44-45cc-a851-001a205eea33 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:33.378217 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f1bf1a5d-1a44-45cc-a851-001a205eea33 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041870 Jul 21 22:08:33.378763 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 443/931] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:33 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:33.383154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3d4d7739-99f0-46e2-8cd0-d0b69a080dc2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:33.383747 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3d4d7739-99f0-46e2-8cd0-d0b69a080dc2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:33.385269 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:33.390304 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3d4d7739-99f0-46e2-8cd0-d0b69a080dc2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:33.390757 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3d4d7739-99f0-46e2-8cd0-d0b69a080dc2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:33.391537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3d4d7739-99f0-46e2-8cd0-d0b69a080dc2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:33.392636 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3d4d7739-99f0-46e2-8cd0-d0b69a080dc2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:33.454863 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3d4d7739-99f0-46e2-8cd0-d0b69a080dc2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:33.462399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3d4d7739-99f0-46e2-8cd0-d0b69a080dc2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082687 Jul 21 22:08:33.463227 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 444/932] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:33 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:33.529844 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2e12083d-fc7f-4199-b845-691d3991471d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:33.530752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2e12083d-fc7f-4199-b845-691d3991471d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:33.537655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e12083d-fc7f-4199-b845-691d3991471d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:33.538099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e12083d-fc7f-4199-b845-691d3991471d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:33.538853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e12083d-fc7f-4199-b845-691d3991471d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:33.539305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e12083d-fc7f-4199-b845-691d3991471d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:33.567230 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2e12083d-fc7f-4199-b845-691d3991471d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041466 Jul 21 22:08:33.567758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 445/933] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:33 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:08:34.296069 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=59 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:34.357524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bbc147d1-9b8a-4b15-8ee1-346113f267ab tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:34.358119 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bbc147d1-9b8a-4b15-8ee1-346113f267ab tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:34.364787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bbc147d1-9b8a-4b15-8ee1-346113f267ab tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:34.365227 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bbc147d1-9b8a-4b15-8ee1-346113f267ab tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:34.365985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bbc147d1-9b8a-4b15-8ee1-346113f267ab tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:34.366417 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bbc147d1-9b8a-4b15-8ee1-346113f267ab tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:34.472910 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=26 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:34.493561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bbc147d1-9b8a-4b15-8ee1-346113f267ab tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:34.502150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bbc147d1-9b8a-4b15-8ee1-346113f267ab tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:34.503759 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bbc147d1-9b8a-4b15-8ee1-346113f267ab tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:34.504912 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bbc147d1-9b8a-4b15-8ee1-346113f267ab tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151202 Jul 21 22:08:34.505467 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 446/934] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:34 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:34.509875 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f7547839-ca74-491b-83b2-9bad16d687b7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:34.510775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f7547839-ca74-491b-83b2-9bad16d687b7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:34.516498 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f7547839-ca74-491b-83b2-9bad16d687b7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:34.516952 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f7547839-ca74-491b-83b2-9bad16d687b7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:34.517721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f7547839-ca74-491b-83b2-9bad16d687b7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:34.518159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f7547839-ca74-491b-83b2-9bad16d687b7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:34.547646 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f7547839-ca74-491b-83b2-9bad16d687b7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041126 Jul 21 22:08:34.548936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 447/935] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:34 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:34.552965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0c768683-d3cf-4a73-8515-37cfd85883b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:34.553562 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0c768683-d3cf-4a73-8515-37cfd85883b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:34.559204 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0c768683-d3cf-4a73-8515-37cfd85883b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:34.559659 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0c768683-d3cf-4a73-8515-37cfd85883b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:34.560419 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0c768683-d3cf-4a73-8515-37cfd85883b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:34.560859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0c768683-d3cf-4a73-8515-37cfd85883b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:34.620456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0c768683-d3cf-4a73-8515-37cfd85883b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:34.623806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:34.628455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0c768683-d3cf-4a73-8515-37cfd85883b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078862 Jul 21 22:08:34.629009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 448/936] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:34 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:34.633456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-28af0856-2ca0-4f57-b293-a4522ffd856e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:34.634365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-28af0856-2ca0-4f57-b293-a4522ffd856e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:34.640367 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-28af0856-2ca0-4f57-b293-a4522ffd856e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:34.640818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-28af0856-2ca0-4f57-b293-a4522ffd856e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:34.641577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-28af0856-2ca0-4f57-b293-a4522ffd856e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:34.642530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-28af0856-2ca0-4f57-b293-a4522ffd856e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:34.670734 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-28af0856-2ca0-4f57-b293-a4522ffd856e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040763 Jul 21 22:08:34.671302 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 449/937] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:34 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:35.523162 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1b23a8f9-b477-4fc1-92e6-02a24474c933 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:35.523789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1b23a8f9-b477-4fc1-92e6-02a24474c933 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:35.530069 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1b23a8f9-b477-4fc1-92e6-02a24474c933 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:35.530510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1b23a8f9-b477-4fc1-92e6-02a24474c933 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:35.531292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1b23a8f9-b477-4fc1-92e6-02a24474c933 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:35.531725 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1b23a8f9-b477-4fc1-92e6-02a24474c933 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:35.660171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1b23a8f9-b477-4fc1-92e6-02a24474c933 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:35.668411 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1b23a8f9-b477-4fc1-92e6-02a24474c933 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:35.669902 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1b23a8f9-b477-4fc1-92e6-02a24474c933 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:35.671045 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1b23a8f9-b477-4fc1-92e6-02a24474c933 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151726 Jul 21 22:08:35.671587 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 450/938] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:35 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:35.675968 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-163de4eb-7fe6-449c-9c27-9745b1623fc5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:35.677115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-163de4eb-7fe6-449c-9c27-9745b1623fc5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:35.682867 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-163de4eb-7fe6-449c-9c27-9745b1623fc5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:35.683338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-163de4eb-7fe6-449c-9c27-9745b1623fc5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:35.684099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-163de4eb-7fe6-449c-9c27-9745b1623fc5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:35.684527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-163de4eb-7fe6-449c-9c27-9745b1623fc5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:35.713233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-163de4eb-7fe6-449c-9c27-9745b1623fc5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040379 Jul 21 22:08:35.713689 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 451/939] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:35 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:35.717810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f3b10114-66f0-4d1f-9fc5-6030e5c6482b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:35.718395 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f3b10114-66f0-4d1f-9fc5-6030e5c6482b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:35.724383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f3b10114-66f0-4d1f-9fc5-6030e5c6482b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:35.724826 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f3b10114-66f0-4d1f-9fc5-6030e5c6482b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:35.725568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f3b10114-66f0-4d1f-9fc5-6030e5c6482b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:35.726003 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f3b10114-66f0-4d1f-9fc5-6030e5c6482b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:35.785713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f3b10114-66f0-4d1f-9fc5-6030e5c6482b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:35.793114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f3b10114-66f0-4d1f-9fc5-6030e5c6482b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078534 Jul 21 22:08:35.793665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 452/940] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:35 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:35.798069 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5dd30bbe-2ad0-4751-a170-6793b2403f67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:35.799039 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5dd30bbe-2ad0-4751-a170-6793b2403f67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:35.804480 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5dd30bbe-2ad0-4751-a170-6793b2403f67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:35.804921 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5dd30bbe-2ad0-4751-a170-6793b2403f67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:35.805765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5dd30bbe-2ad0-4751-a170-6793b2403f67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:35.806193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5dd30bbe-2ad0-4751-a170-6793b2403f67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:35.835070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5dd30bbe-2ad0-4751-a170-6793b2403f67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040415 Jul 21 22:08:35.835607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 453/941] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:35 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:36.690611 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6f1ae840-ff73-4a31-9880-f78d9c099177 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:36.691390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6f1ae840-ff73-4a31-9880-f78d9c099177 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:36.698009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f1ae840-ff73-4a31-9880-f78d9c099177 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:36.698449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f1ae840-ff73-4a31-9880-f78d9c099177 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:36.699349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f1ae840-ff73-4a31-9880-f78d9c099177 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:36.699789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f1ae840-ff73-4a31-9880-f78d9c099177 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:36.826086 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6f1ae840-ff73-4a31-9880-f78d9c099177 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:36.835027 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6f1ae840-ff73-4a31-9880-f78d9c099177 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:36.836551 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6f1ae840-ff73-4a31-9880-f78d9c099177 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:36.837969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6f1ae840-ff73-4a31-9880-f78d9c099177 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151837 Jul 21 22:08:36.838515 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 454/942] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:36 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:36.842959 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-47779318-51e0-4ddd-8103-61fee6008807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:36.843883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-47779318-51e0-4ddd-8103-61fee6008807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:36.849980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-47779318-51e0-4ddd-8103-61fee6008807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:36.850482 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-47779318-51e0-4ddd-8103-61fee6008807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:36.851282 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-47779318-51e0-4ddd-8103-61fee6008807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:36.851721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-47779318-51e0-4ddd-8103-61fee6008807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:36.880449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-47779318-51e0-4ddd-8103-61fee6008807 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040953 Jul 21 22:08:36.880998 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 455/943] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:36 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:36.885267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-19d92dbd-5e39-49f1-b5aa-94cd82683fd0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:36.885866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-19d92dbd-5e39-49f1-b5aa-94cd82683fd0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:36.891286 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-19d92dbd-5e39-49f1-b5aa-94cd82683fd0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:36.891740 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-19d92dbd-5e39-49f1-b5aa-94cd82683fd0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:36.893110 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-19d92dbd-5e39-49f1-b5aa-94cd82683fd0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:36.893543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-19d92dbd-5e39-49f1-b5aa-94cd82683fd0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:36.955835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-19d92dbd-5e39-49f1-b5aa-94cd82683fd0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:36.963462 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-19d92dbd-5e39-49f1-b5aa-94cd82683fd0 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081512 Jul 21 22:08:36.964023 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 456/944] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:36 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:36.968420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-48805bcb-ebe7-42bb-9dc3-43d9a8e7ddeb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:36.969320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-48805bcb-ebe7-42bb-9dc3-43d9a8e7ddeb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:36.974834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-48805bcb-ebe7-42bb-9dc3-43d9a8e7ddeb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:36.975315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-48805bcb-ebe7-42bb-9dc3-43d9a8e7ddeb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:36.976073 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-48805bcb-ebe7-42bb-9dc3-43d9a8e7ddeb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:36.976509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-48805bcb-ebe7-42bb-9dc3-43d9a8e7ddeb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:37.005216 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-48805bcb-ebe7-42bb-9dc3-43d9a8e7ddeb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040234 Jul 21 22:08:37.005749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 457/945] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:36 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:37.857119 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-44cad173-1981-483e-aa46-dbb673259cf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:37.857863 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-44cad173-1981-483e-aa46-dbb673259cf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:37.864386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-44cad173-1981-483e-aa46-dbb673259cf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:37.864835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-44cad173-1981-483e-aa46-dbb673259cf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:37.865602 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-44cad173-1981-483e-aa46-dbb673259cf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:37.866038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-44cad173-1981-483e-aa46-dbb673259cf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:37.992843 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-44cad173-1981-483e-aa46-dbb673259cf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:38.001235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-44cad173-1981-483e-aa46-dbb673259cf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:38.002739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-44cad173-1981-483e-aa46-dbb673259cf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:38.003904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-44cad173-1981-483e-aa46-dbb673259cf2 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.150747 Jul 21 22:08:38.004456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 458/946] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:37 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:38.008840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2ad6a8ed-d697-42b1-8f9e-4f0e2d3d73bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:38.009760 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2ad6a8ed-d697-42b1-8f9e-4f0e2d3d73bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:38.015344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2ad6a8ed-d697-42b1-8f9e-4f0e2d3d73bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:38.015795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2ad6a8ed-d697-42b1-8f9e-4f0e2d3d73bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:38.016563 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2ad6a8ed-d697-42b1-8f9e-4f0e2d3d73bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:38.017493 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2ad6a8ed-d697-42b1-8f9e-4f0e2d3d73bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:38.045989 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2ad6a8ed-d697-42b1-8f9e-4f0e2d3d73bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040565 Jul 21 22:08:38.046527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 459/947] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:38 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:38.051088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b71fa28a-e923-422e-bc23-8c109df93e26 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:38.051689 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b71fa28a-e923-422e-bc23-8c109df93e26 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:38.057275 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b71fa28a-e923-422e-bc23-8c109df93e26 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:38.057724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b71fa28a-e923-422e-bc23-8c109df93e26 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:38.058483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b71fa28a-e923-422e-bc23-8c109df93e26 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:38.058918 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b71fa28a-e923-422e-bc23-8c109df93e26 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:38.118143 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b71fa28a-e923-422e-bc23-8c109df93e26 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:38.125634 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b71fa28a-e923-422e-bc23-8c109df93e26 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078193 Jul 21 22:08:38.126699 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 460/948] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:38 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:38.131172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-59d4219a-ea97-4e5c-a4bd-1f3821e76e8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:38.132079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-59d4219a-ea97-4e5c-a4bd-1f3821e76e8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:38.137565 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-59d4219a-ea97-4e5c-a4bd-1f3821e76e8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:38.138013 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-59d4219a-ea97-4e5c-a4bd-1f3821e76e8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:38.138774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-59d4219a-ea97-4e5c-a4bd-1f3821e76e8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:38.139235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-59d4219a-ea97-4e5c-a4bd-1f3821e76e8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:38.168585 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-59d4219a-ea97-4e5c-a4bd-1f3821e76e8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040860 Jul 21 22:08:38.169132 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 461/949] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:38 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:39.022358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-34610281-74b5-46cd-be12-74de98efede9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:39.023043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-34610281-74b5-46cd-be12-74de98efede9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:39.029541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-34610281-74b5-46cd-be12-74de98efede9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:39.029991 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-34610281-74b5-46cd-be12-74de98efede9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:39.030752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-34610281-74b5-46cd-be12-74de98efede9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:39.031217 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-34610281-74b5-46cd-be12-74de98efede9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:39.159289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-34610281-74b5-46cd-be12-74de98efede9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:39.167678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-34610281-74b5-46cd-be12-74de98efede9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:39.169174 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-34610281-74b5-46cd-be12-74de98efede9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:39.170307 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-34610281-74b5-46cd-be12-74de98efede9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151843 Jul 21 22:08:39.170858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 462/950] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:39 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:39.176445 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cff5e85d-70d1-471a-93ed-cc815ccdcbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:39.177359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cff5e85d-70d1-471a-93ed-cc815ccdcbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:39.183205 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cff5e85d-70d1-471a-93ed-cc815ccdcbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:39.183649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cff5e85d-70d1-471a-93ed-cc815ccdcbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:39.184410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cff5e85d-70d1-471a-93ed-cc815ccdcbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:39.184840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cff5e85d-70d1-471a-93ed-cc815ccdcbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:39.213326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cff5e85d-70d1-471a-93ed-cc815ccdcbbf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041238 Jul 21 22:08:39.213858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 463/951] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:39 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:39.218166 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5989d5da-85ac-45b0-8b36-577544235868 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:39.218753 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5989d5da-85ac-45b0-8b36-577544235868 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:39.224266 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5989d5da-85ac-45b0-8b36-577544235868 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:39.224705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5989d5da-85ac-45b0-8b36-577544235868 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:39.225460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5989d5da-85ac-45b0-8b36-577544235868 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:39.225889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5989d5da-85ac-45b0-8b36-577544235868 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:39.284827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5989d5da-85ac-45b0-8b36-577544235868 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:39.292221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5989d5da-85ac-45b0-8b36-577544235868 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.077363 Jul 21 22:08:39.292772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 464/952] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:39 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:39.297221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ceb0f55e-2f14-4ed9-9fe3-31d87ba236e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:39.298653 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ceb0f55e-2f14-4ed9-9fe3-31d87ba236e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:39.304333 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ceb0f55e-2f14-4ed9-9fe3-31d87ba236e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:39.304788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ceb0f55e-2f14-4ed9-9fe3-31d87ba236e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:39.305559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ceb0f55e-2f14-4ed9-9fe3-31d87ba236e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:39.305997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ceb0f55e-2f14-4ed9-9fe3-31d87ba236e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:39.322663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:39.335329 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ceb0f55e-2f14-4ed9-9fe3-31d87ba236e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041565 Jul 21 22:08:39.335859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 465/953] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:39 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:40.189755 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-837ea5b9-60b6-43e0-b13d-da7e10ff4bee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:40.190533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-837ea5b9-60b6-43e0-b13d-da7e10ff4bee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:40.197104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-837ea5b9-60b6-43e0-b13d-da7e10ff4bee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:40.197561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-837ea5b9-60b6-43e0-b13d-da7e10ff4bee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:40.198332 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-837ea5b9-60b6-43e0-b13d-da7e10ff4bee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:40.198768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-837ea5b9-60b6-43e0-b13d-da7e10ff4bee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:40.323846 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-837ea5b9-60b6-43e0-b13d-da7e10ff4bee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:40.332150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-837ea5b9-60b6-43e0-b13d-da7e10ff4bee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:40.333666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-837ea5b9-60b6-43e0-b13d-da7e10ff4bee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:40.334814 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-837ea5b9-60b6-43e0-b13d-da7e10ff4bee tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.149665 Jul 21 22:08:40.335404 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 466/954] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:40 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:40.340099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-892b6631-4ac8-4f9f-9a2c-e3bb86ed7d8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:40.341004 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-892b6631-4ac8-4f9f-9a2c-e3bb86ed7d8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:40.347165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-892b6631-4ac8-4f9f-9a2c-e3bb86ed7d8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:40.347619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-892b6631-4ac8-4f9f-9a2c-e3bb86ed7d8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:40.348384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-892b6631-4ac8-4f9f-9a2c-e3bb86ed7d8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:40.348820 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-892b6631-4ac8-4f9f-9a2c-e3bb86ed7d8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:40.376895 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-892b6631-4ac8-4f9f-9a2c-e3bb86ed7d8a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040529 Jul 21 22:08:40.377433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 467/955] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:40 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:40.381641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6c960cd5-8526-4d12-a96c-6fdf4de46bc9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:40.382236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6c960cd5-8526-4d12-a96c-6fdf4de46bc9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:40.387670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c960cd5-8526-4d12-a96c-6fdf4de46bc9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:40.388118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c960cd5-8526-4d12-a96c-6fdf4de46bc9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:40.388877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c960cd5-8526-4d12-a96c-6fdf4de46bc9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:40.389475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c960cd5-8526-4d12-a96c-6fdf4de46bc9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:40.474705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6c960cd5-8526-4d12-a96c-6fdf4de46bc9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:40.482391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6c960cd5-8526-4d12-a96c-6fdf4de46bc9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.104007 Jul 21 22:08:40.482960 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 468/956] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:40 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:40.488082 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9e6bd15d-0159-4680-8649-71453c9021c9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:40.488993 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9e6bd15d-0159-4680-8649-71453c9021c9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:40.495121 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e6bd15d-0159-4680-8649-71453c9021c9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:40.495577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e6bd15d-0159-4680-8649-71453c9021c9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:40.496384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e6bd15d-0159-4680-8649-71453c9021c9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:40.496822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e6bd15d-0159-4680-8649-71453c9021c9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:40.525098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9e6bd15d-0159-4680-8649-71453c9021c9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041145 Jul 21 22:08:40.525650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 469/957] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:40 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:41.353756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a1104010-9e85-4736-af3e-6781d28fc746 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:41.354436 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a1104010-9e85-4736-af3e-6781d28fc746 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:41.361544 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1104010-9e85-4736-af3e-6781d28fc746 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:41.362038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1104010-9e85-4736-af3e-6781d28fc746 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:41.362796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1104010-9e85-4736-af3e-6781d28fc746 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:41.363252 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1104010-9e85-4736-af3e-6781d28fc746 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:41.491658 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a1104010-9e85-4736-af3e-6781d28fc746 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:41.500013 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a1104010-9e85-4736-af3e-6781d28fc746 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:41.501542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a1104010-9e85-4736-af3e-6781d28fc746 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:41.502715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a1104010-9e85-4736-af3e-6781d28fc746 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.152843 Jul 21 22:08:41.503301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 470/958] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:41 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:41.507711 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2285bfb4-625b-445c-a1d5-5318babc2564 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:41.508650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2285bfb4-625b-445c-a1d5-5318babc2564 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:41.514183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2285bfb4-625b-445c-a1d5-5318babc2564 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:41.514635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2285bfb4-625b-445c-a1d5-5318babc2564 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:41.515427 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2285bfb4-625b-445c-a1d5-5318babc2564 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:41.515864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2285bfb4-625b-445c-a1d5-5318babc2564 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:41.544567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2285bfb4-625b-445c-a1d5-5318babc2564 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040289 Jul 21 22:08:41.545101 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 471/959] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:41 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:41.549330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2e4a78a4-3f72-4fff-acce-fb3a6c437e5f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:41.549923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2e4a78a4-3f72-4fff-acce-fb3a6c437e5f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:41.555316 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e4a78a4-3f72-4fff-acce-fb3a6c437e5f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:41.555766 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e4a78a4-3f72-4fff-acce-fb3a6c437e5f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:41.556520 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e4a78a4-3f72-4fff-acce-fb3a6c437e5f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:41.556956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e4a78a4-3f72-4fff-acce-fb3a6c437e5f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:41.618906 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2e4a78a4-3f72-4fff-acce-fb3a6c437e5f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:41.626357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2e4a78a4-3f72-4fff-acce-fb3a6c437e5f tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080347 Jul 21 22:08:41.626915 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 472/960] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:41 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:41.631739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-01d9a6d2-3a57-44e5-9ea7-59c32569de47 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:41.632449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-01d9a6d2-3a57-44e5-9ea7-59c32569de47 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:41.638098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-01d9a6d2-3a57-44e5-9ea7-59c32569de47 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:41.638590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-01d9a6d2-3a57-44e5-9ea7-59c32569de47 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:41.639392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-01d9a6d2-3a57-44e5-9ea7-59c32569de47 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:41.639832 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-01d9a6d2-3a57-44e5-9ea7-59c32569de47 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:41.668990 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-01d9a6d2-3a57-44e5-9ea7-59c32569de47 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041069 Jul 21 22:08:41.669539 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 473/961] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:41 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:42.520802 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3462265c-a405-42c9-94c0-30f948639392 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:42.521415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3462265c-a405-42c9-94c0-30f948639392 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:42.527888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3462265c-a405-42c9-94c0-30f948639392 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:42.528429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3462265c-a405-42c9-94c0-30f948639392 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:42.529191 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3462265c-a405-42c9-94c0-30f948639392 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:42.529622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3462265c-a405-42c9-94c0-30f948639392 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:42.659257 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3462265c-a405-42c9-94c0-30f948639392 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:42.667843 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3462265c-a405-42c9-94c0-30f948639392 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:42.669361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3462265c-a405-42c9-94c0-30f948639392 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:42.670510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3462265c-a405-42c9-94c0-30f948639392 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.153672 Jul 21 22:08:42.671083 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 474/962] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:42 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:42.676583 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-19f0d2f3-0057-4118-8e52-0cd4a1522402 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:42.677493 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-19f0d2f3-0057-4118-8e52-0cd4a1522402 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:42.683218 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-19f0d2f3-0057-4118-8e52-0cd4a1522402 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:42.683700 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-19f0d2f3-0057-4118-8e52-0cd4a1522402 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:42.684467 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-19f0d2f3-0057-4118-8e52-0cd4a1522402 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:42.684905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-19f0d2f3-0057-4118-8e52-0cd4a1522402 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:42.712579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-19f0d2f3-0057-4118-8e52-0cd4a1522402 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040538 Jul 21 22:08:42.713378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 475/963] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:42 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:42.717691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-114cb29b-5bc8-4305-a3dc-08ac16271896 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:42.718289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-114cb29b-5bc8-4305-a3dc-08ac16271896 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:42.724216 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-114cb29b-5bc8-4305-a3dc-08ac16271896 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:42.724669 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-114cb29b-5bc8-4305-a3dc-08ac16271896 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:42.725423 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-114cb29b-5bc8-4305-a3dc-08ac16271896 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:42.725862 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-114cb29b-5bc8-4305-a3dc-08ac16271896 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:42.892830 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-114cb29b-5bc8-4305-a3dc-08ac16271896 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:42.900334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-114cb29b-5bc8-4305-a3dc-08ac16271896 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.185994 Jul 21 22:08:42.900887 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 476/964] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:42 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:42.905344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d3d1ed76-c035-4548-9dc3-c2be4bacb690 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:42.906421 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d3d1ed76-c035-4548-9dc3-c2be4bacb690 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:42.912648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d3d1ed76-c035-4548-9dc3-c2be4bacb690 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:42.913087 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d3d1ed76-c035-4548-9dc3-c2be4bacb690 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:42.913840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d3d1ed76-c035-4548-9dc3-c2be4bacb690 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:42.914270 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d3d1ed76-c035-4548-9dc3-c2be4bacb690 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:42.942094 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d3d1ed76-c035-4548-9dc3-c2be4bacb690 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040257 Jul 21 22:08:42.942629 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 477/965] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:42 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:43.689723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-81cfdd07-e5ab-48e9-9e3f-05f585c30b90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:43.690350 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-81cfdd07-e5ab-48e9-9e3f-05f585c30b90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:43.697077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81cfdd07-e5ab-48e9-9e3f-05f585c30b90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:43.697521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81cfdd07-e5ab-48e9-9e3f-05f585c30b90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:43.698276 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81cfdd07-e5ab-48e9-9e3f-05f585c30b90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:43.698705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81cfdd07-e5ab-48e9-9e3f-05f585c30b90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:43.823665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-81cfdd07-e5ab-48e9-9e3f-05f585c30b90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:43.831961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-81cfdd07-e5ab-48e9-9e3f-05f585c30b90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:43.833462 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-81cfdd07-e5ab-48e9-9e3f-05f585c30b90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:43.834591 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-81cfdd07-e5ab-48e9-9e3f-05f585c30b90 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.149462 Jul 21 22:08:43.835165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 478/966] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:43 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:43.840108 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ca71e460-e5d1-4502-9391-a2f2e250a857 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:43.841001 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ca71e460-e5d1-4502-9391-a2f2e250a857 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:43.846612 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ca71e460-e5d1-4502-9391-a2f2e250a857 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:43.847091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ca71e460-e5d1-4502-9391-a2f2e250a857 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:43.847847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ca71e460-e5d1-4502-9391-a2f2e250a857 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:43.848277 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ca71e460-e5d1-4502-9391-a2f2e250a857 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:43.877287 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ca71e460-e5d1-4502-9391-a2f2e250a857 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041153 Jul 21 22:08:43.877824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 479/967] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:43 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:43.916649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6cd2b680-3449-45b0-8c91-0d3c2853cc2c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:43.917241 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6cd2b680-3449-45b0-8c91-0d3c2853cc2c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:43.922959 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6cd2b680-3449-45b0-8c91-0d3c2853cc2c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:43.923428 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6cd2b680-3449-45b0-8c91-0d3c2853cc2c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:43.924183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6cd2b680-3449-45b0-8c91-0d3c2853cc2c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:43.924614 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6cd2b680-3449-45b0-8c91-0d3c2853cc2c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:43.988879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6cd2b680-3449-45b0-8c91-0d3c2853cc2c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:43.996254 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6cd2b680-3449-45b0-8c91-0d3c2853cc2c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083228 Jul 21 22:08:43.996809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 480/968] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:43 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:08:44.001490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4c3d78ff-5bf1-4fd5-b4e2-181ac736ef69 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:44.002387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4c3d78ff-5bf1-4fd5-b4e2-181ac736ef69 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:44.008091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c3d78ff-5bf1-4fd5-b4e2-181ac736ef69 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:44.008665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c3d78ff-5bf1-4fd5-b4e2-181ac736ef69 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:44.009449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c3d78ff-5bf1-4fd5-b4e2-181ac736ef69 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:44.009923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c3d78ff-5bf1-4fd5-b4e2-181ac736ef69 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:44.039029 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4c3d78ff-5bf1-4fd5-b4e2-181ac736ef69 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041237 Jul 21 22:08:44.039573 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 481/969] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:43 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:44.852977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ba35e109-acba-4071-902c-216a748202e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:44.853591 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ba35e109-acba-4071-902c-216a748202e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:44.860076 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba35e109-acba-4071-902c-216a748202e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:44.861116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba35e109-acba-4071-902c-216a748202e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:44.861891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba35e109-acba-4071-902c-216a748202e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:44.862334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba35e109-acba-4071-902c-216a748202e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:44.866222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:44.990512 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ba35e109-acba-4071-902c-216a748202e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:44.999265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ba35e109-acba-4071-902c-216a748202e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:45.000778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ba35e109-acba-4071-902c-216a748202e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:45.002465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ba35e109-acba-4071-902c-216a748202e1 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.153480 Jul 21 22:08:45.003037 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 482/970] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:44 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:45.007454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a9e5ee97-b9b2-4d00-8f4d-58e9142bd2b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:45.008361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a9e5ee97-b9b2-4d00-8f4d-58e9142bd2b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:45.014223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a9e5ee97-b9b2-4d00-8f4d-58e9142bd2b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:45.014708 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a9e5ee97-b9b2-4d00-8f4d-58e9142bd2b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:45.015512 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a9e5ee97-b9b2-4d00-8f4d-58e9142bd2b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:45.015986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a9e5ee97-b9b2-4d00-8f4d-58e9142bd2b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:45.044573 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a9e5ee97-b9b2-4d00-8f4d-58e9142bd2b5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040549 Jul 21 22:08:45.045112 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 483/971] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:45 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:45.049327 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a582a912-0800-447d-94ed-f7085a249528 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:45.049922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a582a912-0800-447d-94ed-f7085a249528 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:45.055480 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a582a912-0800-447d-94ed-f7085a249528 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:45.055929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a582a912-0800-447d-94ed-f7085a249528 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:45.056690 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a582a912-0800-447d-94ed-f7085a249528 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:45.057126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a582a912-0800-447d-94ed-f7085a249528 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:45.116429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a582a912-0800-447d-94ed-f7085a249528 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:45.123788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a582a912-0800-447d-94ed-f7085a249528 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.077766 Jul 21 22:08:45.124346 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 484/972] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:45 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:45.129314 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a0bb6ecb-7825-4296-9b69-2de32c7c5f5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:45.130207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a0bb6ecb-7825-4296-9b69-2de32c7c5f5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:45.135909 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a0bb6ecb-7825-4296-9b69-2de32c7c5f5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:45.136365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a0bb6ecb-7825-4296-9b69-2de32c7c5f5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:45.137142 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a0bb6ecb-7825-4296-9b69-2de32c7c5f5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:45.137586 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a0bb6ecb-7825-4296-9b69-2de32c7c5f5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:45.166069 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a0bb6ecb-7825-4296-9b69-2de32c7c5f5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040764 Jul 21 22:08:45.166605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 485/973] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:45 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:46.020778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-120aabdd-ab71-4aed-a221-ad884f9d5950 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:46.021368 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-120aabdd-ab71-4aed-a221-ad884f9d5950 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:46.027545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-120aabdd-ab71-4aed-a221-ad884f9d5950 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:46.027995 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-120aabdd-ab71-4aed-a221-ad884f9d5950 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:46.028759 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-120aabdd-ab71-4aed-a221-ad884f9d5950 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:46.029196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-120aabdd-ab71-4aed-a221-ad884f9d5950 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:46.157501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-120aabdd-ab71-4aed-a221-ad884f9d5950 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:46.165733 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-120aabdd-ab71-4aed-a221-ad884f9d5950 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:46.167263 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-120aabdd-ab71-4aed-a221-ad884f9d5950 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:46.168407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-120aabdd-ab71-4aed-a221-ad884f9d5950 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151533 Jul 21 22:08:46.168961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 486/974] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:46 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:46.173973 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-86f546e9-d012-4695-98a6-f3879a4c9926 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:46.174884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-86f546e9-d012-4695-98a6-f3879a4c9926 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:46.180538 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86f546e9-d012-4695-98a6-f3879a4c9926 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:46.181007 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86f546e9-d012-4695-98a6-f3879a4c9926 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:46.181778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86f546e9-d012-4695-98a6-f3879a4c9926 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:46.182215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86f546e9-d012-4695-98a6-f3879a4c9926 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:46.213209 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-86f546e9-d012-4695-98a6-f3879a4c9926 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042974 Jul 21 22:08:46.213768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 487/975] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:46 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:46.218093 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1f3ae762-2bad-4fe1-ae25-b2e3726bf910 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:46.218691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1f3ae762-2bad-4fe1-ae25-b2e3726bf910 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:46.225342 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f3ae762-2bad-4fe1-ae25-b2e3726bf910 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:46.225789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f3ae762-2bad-4fe1-ae25-b2e3726bf910 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:46.226908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f3ae762-2bad-4fe1-ae25-b2e3726bf910 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:46.227744 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f3ae762-2bad-4fe1-ae25-b2e3726bf910 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:46.291679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1f3ae762-2bad-4fe1-ae25-b2e3726bf910 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:46.299681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1f3ae762-2bad-4fe1-ae25-b2e3726bf910 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.084985 Jul 21 22:08:46.300238 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 488/976] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:46 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:46.304647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fa34d563-4f64-4414-a590-9cc797cc1805 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:46.305543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fa34d563-4f64-4414-a590-9cc797cc1805 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:46.311404 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa34d563-4f64-4414-a590-9cc797cc1805 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:46.311860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa34d563-4f64-4414-a590-9cc797cc1805 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:46.312637 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa34d563-4f64-4414-a590-9cc797cc1805 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:46.313075 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa34d563-4f64-4414-a590-9cc797cc1805 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:46.341175 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fa34d563-4f64-4414-a590-9cc797cc1805 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039975 Jul 21 22:08:46.341718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 489/977] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:46 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:47.187039 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-60038429-f774-449a-bec6-73b1acca1f93 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:47.187726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-60038429-f774-449a-bec6-73b1acca1f93 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:47.194691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60038429-f774-449a-bec6-73b1acca1f93 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:47.195182 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60038429-f774-449a-bec6-73b1acca1f93 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:47.195958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60038429-f774-449a-bec6-73b1acca1f93 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:47.196476 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60038429-f774-449a-bec6-73b1acca1f93 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:47.325810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-60038429-f774-449a-bec6-73b1acca1f93 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:47.334661 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-60038429-f774-449a-bec6-73b1acca1f93 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:47.336305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-60038429-f774-449a-bec6-73b1acca1f93 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:47.337450 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-60038429-f774-449a-bec6-73b1acca1f93 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.154338 Jul 21 22:08:47.338257 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 490/978] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:47 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:47.342811 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4b2d6131-d7bb-4fc1-9b96-2e27c82ffaa3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:47.343737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4b2d6131-d7bb-4fc1-9b96-2e27c82ffaa3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:47.349668 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b2d6131-d7bb-4fc1-9b96-2e27c82ffaa3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:47.350119 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b2d6131-d7bb-4fc1-9b96-2e27c82ffaa3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:47.350882 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b2d6131-d7bb-4fc1-9b96-2e27c82ffaa3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:47.351338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b2d6131-d7bb-4fc1-9b96-2e27c82ffaa3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:47.380061 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4b2d6131-d7bb-4fc1-9b96-2e27c82ffaa3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040804 Jul 21 22:08:47.380610 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 491/979] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:47 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:47.385047 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b9d40cb0-90bd-41c1-a27d-03f3ed456f0c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:47.385649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b9d40cb0-90bd-41c1-a27d-03f3ed456f0c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:47.391312 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9d40cb0-90bd-41c1-a27d-03f3ed456f0c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:47.391831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9d40cb0-90bd-41c1-a27d-03f3ed456f0c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:47.393107 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9d40cb0-90bd-41c1-a27d-03f3ed456f0c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:47.393541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9d40cb0-90bd-41c1-a27d-03f3ed456f0c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:47.458961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b9d40cb0-90bd-41c1-a27d-03f3ed456f0c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:47.466799 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b9d40cb0-90bd-41c1-a27d-03f3ed456f0c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.085263 Jul 21 22:08:47.467378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 492/980] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:47 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:47.472086 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-26a6c5ee-a537-4266-b97d-957c859a11d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:47.472987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-26a6c5ee-a537-4266-b97d-957c859a11d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:47.478886 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26a6c5ee-a537-4266-b97d-957c859a11d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:47.479362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26a6c5ee-a537-4266-b97d-957c859a11d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:47.480142 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26a6c5ee-a537-4266-b97d-957c859a11d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:47.480576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26a6c5ee-a537-4266-b97d-957c859a11d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:47.511339 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-26a6c5ee-a537-4266-b97d-957c859a11d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042902 Jul 21 22:08:47.511902 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 493/981] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:47 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:48.355963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1c311d22-219a-433b-b450-b82c5ce55dbb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:48.356691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1c311d22-219a-433b-b450-b82c5ce55dbb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:48.359028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:48.364943 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1c311d22-219a-433b-b450-b82c5ce55dbb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:48.365385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1c311d22-219a-433b-b450-b82c5ce55dbb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:48.366143 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1c311d22-219a-433b-b450-b82c5ce55dbb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:48.366576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1c311d22-219a-433b-b450-b82c5ce55dbb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:48.496791 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1c311d22-219a-433b-b450-b82c5ce55dbb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:48.505433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1c311d22-219a-433b-b450-b82c5ce55dbb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:48.506987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1c311d22-219a-433b-b450-b82c5ce55dbb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:48.508166 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1c311d22-219a-433b-b450-b82c5ce55dbb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.156106 Jul 21 22:08:48.508722 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 494/982] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:48 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:48.513326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bc2f6e8b-3792-4973-9b08-8c8c85b2553b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:48.514226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bc2f6e8b-3792-4973-9b08-8c8c85b2553b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:48.520345 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bc2f6e8b-3792-4973-9b08-8c8c85b2553b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:48.520791 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bc2f6e8b-3792-4973-9b08-8c8c85b2553b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:48.521555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bc2f6e8b-3792-4973-9b08-8c8c85b2553b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:48.521986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bc2f6e8b-3792-4973-9b08-8c8c85b2553b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:48.551240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bc2f6e8b-3792-4973-9b08-8c8c85b2553b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041479 Jul 21 22:08:48.551786 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 495/983] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:48 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:48.556170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dc4bd4fb-d9dd-4fb8-a156-a9cf9bb3eb1e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:48.556766 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dc4bd4fb-d9dd-4fb8-a156-a9cf9bb3eb1e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:48.562172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc4bd4fb-d9dd-4fb8-a156-a9cf9bb3eb1e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:48.562617 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc4bd4fb-d9dd-4fb8-a156-a9cf9bb3eb1e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:48.563406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc4bd4fb-d9dd-4fb8-a156-a9cf9bb3eb1e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:48.563869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc4bd4fb-d9dd-4fb8-a156-a9cf9bb3eb1e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:48.624247 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dc4bd4fb-d9dd-4fb8-a156-a9cf9bb3eb1e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:48.631772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dc4bd4fb-d9dd-4fb8-a156-a9cf9bb3eb1e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079056 Jul 21 22:08:48.632353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 496/984] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:48 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:48.636839 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-487c52ea-bf4a-4668-8957-f7861fa7a628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:48.637750 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-487c52ea-bf4a-4668-8957-f7861fa7a628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:48.643830 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-487c52ea-bf4a-4668-8957-f7861fa7a628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:48.644279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-487c52ea-bf4a-4668-8957-f7861fa7a628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:48.645040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-487c52ea-bf4a-4668-8957-f7861fa7a628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:48.645473 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-487c52ea-bf4a-4668-8957-f7861fa7a628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:48.675667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-487c52ea-bf4a-4668-8957-f7861fa7a628 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042325 Jul 21 22:08:48.676218 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 497/985] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:48 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:49.204040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:08:49.204304 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:08:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:08:49.528201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-53b3092c-3d1c-4c1b-8c90-7ce9f00b2644 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:49.528855 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-53b3092c-3d1c-4c1b-8c90-7ce9f00b2644 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:49.535873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-53b3092c-3d1c-4c1b-8c90-7ce9f00b2644 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:49.536325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-53b3092c-3d1c-4c1b-8c90-7ce9f00b2644 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:49.537085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-53b3092c-3d1c-4c1b-8c90-7ce9f00b2644 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:49.537518 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-53b3092c-3d1c-4c1b-8c90-7ce9f00b2644 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:49.668550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-53b3092c-3d1c-4c1b-8c90-7ce9f00b2644 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:49.672042 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:49.678444 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-53b3092c-3d1c-4c1b-8c90-7ce9f00b2644 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:49.680016 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-53b3092c-3d1c-4c1b-8c90-7ce9f00b2644 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:49.681177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-53b3092c-3d1c-4c1b-8c90-7ce9f00b2644 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.156816 Jul 21 22:08:49.681729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 498/986] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:49 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:49.686395 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5987f0f4-ac15-4d2e-927d-91577a09441f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:49.687433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5987f0f4-ac15-4d2e-927d-91577a09441f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:49.693190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5987f0f4-ac15-4d2e-927d-91577a09441f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:49.693641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5987f0f4-ac15-4d2e-927d-91577a09441f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:49.694410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5987f0f4-ac15-4d2e-927d-91577a09441f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:49.694856 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5987f0f4-ac15-4d2e-927d-91577a09441f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:49.723756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5987f0f4-ac15-4d2e-927d-91577a09441f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041056 Jul 21 22:08:49.724302 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 499/987] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:49 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:49.728651 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e112ce5d-f8e0-490c-a362-2686e8d97d2e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:49.729241 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e112ce5d-f8e0-490c-a362-2686e8d97d2e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:49.734656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e112ce5d-f8e0-490c-a362-2686e8d97d2e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:49.735145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e112ce5d-f8e0-490c-a362-2686e8d97d2e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:49.736542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e112ce5d-f8e0-490c-a362-2686e8d97d2e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:49.736979 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e112ce5d-f8e0-490c-a362-2686e8d97d2e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:49.796375 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e112ce5d-f8e0-490c-a362-2686e8d97d2e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:49.804439 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e112ce5d-f8e0-490c-a362-2686e8d97d2e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079155 Jul 21 22:08:49.805000 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 500/988] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:49 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:49.809508 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-db103c45-8526-4908-9f19-7397013ceda3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:49.810422 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-db103c45-8526-4908-9f19-7397013ceda3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:49.816226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db103c45-8526-4908-9f19-7397013ceda3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:49.816704 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db103c45-8526-4908-9f19-7397013ceda3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:49.817473 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db103c45-8526-4908-9f19-7397013ceda3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:49.817917 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db103c45-8526-4908-9f19-7397013ceda3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:49.846276 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-db103c45-8526-4908-9f19-7397013ceda3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040309 Jul 21 22:08:49.846812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 501/989] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:49 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:50.699534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7c11d01c-11ad-497c-94da-b7e8c64bd62f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:50.700173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7c11d01c-11ad-497c-94da-b7e8c64bd62f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:50.706687 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7c11d01c-11ad-497c-94da-b7e8c64bd62f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:50.707168 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7c11d01c-11ad-497c-94da-b7e8c64bd62f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:50.707929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7c11d01c-11ad-497c-94da-b7e8c64bd62f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:50.708360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7c11d01c-11ad-497c-94da-b7e8c64bd62f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:50.833005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7c11d01c-11ad-497c-94da-b7e8c64bd62f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:50.841529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7c11d01c-11ad-497c-94da-b7e8c64bd62f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:50.843051 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7c11d01c-11ad-497c-94da-b7e8c64bd62f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:50.844195 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7c11d01c-11ad-497c-94da-b7e8c64bd62f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.148515 Jul 21 22:08:50.844772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 502/990] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:50 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:50.849800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f66690a5-0121-4612-a185-6f335722e305 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:50.850906 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f66690a5-0121-4612-a185-6f335722e305 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:50.856527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f66690a5-0121-4612-a185-6f335722e305 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:50.856983 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f66690a5-0121-4612-a185-6f335722e305 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:50.857753 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f66690a5-0121-4612-a185-6f335722e305 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:50.858188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f66690a5-0121-4612-a185-6f335722e305 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:50.885968 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f66690a5-0121-4612-a185-6f335722e305 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039677 Jul 21 22:08:50.886516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 503/991] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:50 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:50.890741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9894f0c3-a85b-41fd-8573-f67f68c7ed6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:50.891360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9894f0c3-a85b-41fd-8573-f67f68c7ed6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:50.897262 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9894f0c3-a85b-41fd-8573-f67f68c7ed6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:50.897712 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9894f0c3-a85b-41fd-8573-f67f68c7ed6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:50.898469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9894f0c3-a85b-41fd-8573-f67f68c7ed6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:50.898904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9894f0c3-a85b-41fd-8573-f67f68c7ed6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:50.961193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9894f0c3-a85b-41fd-8573-f67f68c7ed6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:50.969114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9894f0c3-a85b-41fd-8573-f67f68c7ed6d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081563 Jul 21 22:08:50.969699 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 504/992] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:50 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:50.974258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d1bfa48d-de73-42a4-89db-b9f960dbd2cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:50.975695 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d1bfa48d-de73-42a4-89db-b9f960dbd2cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:50.981395 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d1bfa48d-de73-42a4-89db-b9f960dbd2cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:50.981839 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d1bfa48d-de73-42a4-89db-b9f960dbd2cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:50.982589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d1bfa48d-de73-42a4-89db-b9f960dbd2cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:50.983036 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d1bfa48d-de73-42a4-89db-b9f960dbd2cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:51.010548 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d1bfa48d-de73-42a4-89db-b9f960dbd2cf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039807 Jul 21 22:08:51.011104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 505/993] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:50 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:51.863527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-61ec3909-c2d5-4898-b2ba-431d62cec91b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:51.864190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-61ec3909-c2d5-4898-b2ba-431d62cec91b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:51.870780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-61ec3909-c2d5-4898-b2ba-431d62cec91b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:51.871345 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-61ec3909-c2d5-4898-b2ba-431d62cec91b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:51.872115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-61ec3909-c2d5-4898-b2ba-431d62cec91b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:51.872561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-61ec3909-c2d5-4898-b2ba-431d62cec91b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:52.001005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-61ec3909-c2d5-4898-b2ba-431d62cec91b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:52.009468 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-61ec3909-c2d5-4898-b2ba-431d62cec91b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:52.010991 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-61ec3909-c2d5-4898-b2ba-431d62cec91b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:52.012165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-61ec3909-c2d5-4898-b2ba-431d62cec91b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.153078 Jul 21 22:08:52.012722 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 506/994] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:51 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:52.017200 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f9d7536a-cfe1-4990-b95d-b66c24905ccf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:52.018110 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f9d7536a-cfe1-4990-b95d-b66c24905ccf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:52.023837 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9d7536a-cfe1-4990-b95d-b66c24905ccf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:52.024319 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9d7536a-cfe1-4990-b95d-b66c24905ccf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:52.025088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9d7536a-cfe1-4990-b95d-b66c24905ccf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:52.025529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9d7536a-cfe1-4990-b95d-b66c24905ccf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:52.054358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f9d7536a-cfe1-4990-b95d-b66c24905ccf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040663 Jul 21 22:08:52.054911 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 507/995] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:52 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:52.059167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-da31690a-b974-4f3b-85ae-2562f9adbf8c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:52.059770 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-da31690a-b974-4f3b-85ae-2562f9adbf8c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:52.065246 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-da31690a-b974-4f3b-85ae-2562f9adbf8c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:52.065701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-da31690a-b974-4f3b-85ae-2562f9adbf8c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:52.066463 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-da31690a-b974-4f3b-85ae-2562f9adbf8c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:52.066904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-da31690a-b974-4f3b-85ae-2562f9adbf8c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:52.126860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-da31690a-b974-4f3b-85ae-2562f9adbf8c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:52.134368 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-da31690a-b974-4f3b-85ae-2562f9adbf8c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078516 Jul 21 22:08:52.134929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 508/996] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:52 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:52.139404 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8be507c8-9201-499d-a59f-cc5be2e0730b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:52.140315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8be507c8-9201-499d-a59f-cc5be2e0730b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:52.145871 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8be507c8-9201-499d-a59f-cc5be2e0730b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:52.146326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8be507c8-9201-499d-a59f-cc5be2e0730b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:52.147120 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8be507c8-9201-499d-a59f-cc5be2e0730b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:52.147562 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8be507c8-9201-499d-a59f-cc5be2e0730b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:52.177308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8be507c8-9201-499d-a59f-cc5be2e0730b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041382 Jul 21 22:08:52.177852 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 509/997] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:52 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:53.030149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-03ba7d75-77eb-41c0-94c7-969f1cc0dd27 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:53.030778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-03ba7d75-77eb-41c0-94c7-969f1cc0dd27 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:53.037400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-03ba7d75-77eb-41c0-94c7-969f1cc0dd27 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:53.037855 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-03ba7d75-77eb-41c0-94c7-969f1cc0dd27 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:53.038627 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-03ba7d75-77eb-41c0-94c7-969f1cc0dd27 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:53.039099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-03ba7d75-77eb-41c0-94c7-969f1cc0dd27 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:53.168032 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-03ba7d75-77eb-41c0-94c7-969f1cc0dd27 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:53.176798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-03ba7d75-77eb-41c0-94c7-969f1cc0dd27 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:53.178298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-03ba7d75-77eb-41c0-94c7-969f1cc0dd27 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:53.179464 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-03ba7d75-77eb-41c0-94c7-969f1cc0dd27 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.153201 Jul 21 22:08:53.180016 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 510/998] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:53 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:53.184613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-147bb8db-8a57-4184-8b25-a7ec2f4936ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:53.185509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-147bb8db-8a57-4184-8b25-a7ec2f4936ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:53.191912 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-147bb8db-8a57-4184-8b25-a7ec2f4936ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:53.192357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-147bb8db-8a57-4184-8b25-a7ec2f4936ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:53.193114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-147bb8db-8a57-4184-8b25-a7ec2f4936ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:53.193543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-147bb8db-8a57-4184-8b25-a7ec2f4936ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:53.221348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-147bb8db-8a57-4184-8b25-a7ec2f4936ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040281 Jul 21 22:08:53.221882 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 511/999] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:53 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:53.226037 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4c837c3e-7214-4067-886a-9882793b199d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:53.226626 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4c837c3e-7214-4067-886a-9882793b199d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:53.232082 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c837c3e-7214-4067-886a-9882793b199d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:53.232525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c837c3e-7214-4067-886a-9882793b199d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:53.233321 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c837c3e-7214-4067-886a-9882793b199d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:53.233751 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c837c3e-7214-4067-886a-9882793b199d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:53.292250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4c837c3e-7214-4067-886a-9882793b199d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:53.300068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4c837c3e-7214-4067-886a-9882793b199d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.077289 Jul 21 22:08:53.300622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 512/1000] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:53 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:53.305075 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6052b373-6e38-4bde-9c9b-36c65746c3c5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:53.306058 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6052b373-6e38-4bde-9c9b-36c65746c3c5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:53.311584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6052b373-6e38-4bde-9c9b-36c65746c3c5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:53.312032 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6052b373-6e38-4bde-9c9b-36c65746c3c5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:53.312780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6052b373-6e38-4bde-9c9b-36c65746c3c5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:53.313212 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6052b373-6e38-4bde-9c9b-36c65746c3c5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:53.343432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6052b373-6e38-4bde-9c9b-36c65746c3c5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041121 Jul 21 22:08:53.343432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 513/1001] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:53 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:54.198805 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9c83addb-474d-43b6-950e-8be6f8280dbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:54.199471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9c83addb-474d-43b6-950e-8be6f8280dbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:54.206602 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9c83addb-474d-43b6-950e-8be6f8280dbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:54.207104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9c83addb-474d-43b6-950e-8be6f8280dbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:54.207873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9c83addb-474d-43b6-950e-8be6f8280dbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:54.208309 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9c83addb-474d-43b6-950e-8be6f8280dbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:54.335399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9c83addb-474d-43b6-950e-8be6f8280dbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:54.343998 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9c83addb-474d-43b6-950e-8be6f8280dbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:54.346028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9c83addb-474d-43b6-950e-8be6f8280dbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:54.347224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9c83addb-474d-43b6-950e-8be6f8280dbd tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.152272 Jul 21 22:08:54.347808 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 514/1002] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:54 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:54.352242 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7baa28ba-fbe9-4148-ab9b-d1833aa0a47b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:54.353145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7baa28ba-fbe9-4148-ab9b-d1833aa0a47b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:54.358731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7baa28ba-fbe9-4148-ab9b-d1833aa0a47b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:54.359225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7baa28ba-fbe9-4148-ab9b-d1833aa0a47b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:54.359991 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7baa28ba-fbe9-4148-ab9b-d1833aa0a47b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:54.361012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7baa28ba-fbe9-4148-ab9b-d1833aa0a47b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:54.376804 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:54.389439 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7baa28ba-fbe9-4148-ab9b-d1833aa0a47b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040686 Jul 21 22:08:54.389979 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 515/1003] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:54 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:54.394157 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f103cf34-63c9-4751-be45-8c167752e5ab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:54.394749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f103cf34-63c9-4751-be45-8c167752e5ab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:54.400225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f103cf34-63c9-4751-be45-8c167752e5ab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:54.400675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f103cf34-63c9-4751-be45-8c167752e5ab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:54.401433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f103cf34-63c9-4751-be45-8c167752e5ab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:54.401869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f103cf34-63c9-4751-be45-8c167752e5ab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:54.464822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f103cf34-63c9-4751-be45-8c167752e5ab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:54.472801 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f103cf34-63c9-4751-be45-8c167752e5ab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081910 Jul 21 22:08:54.473359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 516/1004] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:54 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:54.477945 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ec7c97eb-fdb9-4bb9-b894-d65d1fe0f759 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:54.478857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ec7c97eb-fdb9-4bb9-b894-d65d1fe0f759 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:54.484711 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec7c97eb-fdb9-4bb9-b894-d65d1fe0f759 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:54.485161 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec7c97eb-fdb9-4bb9-b894-d65d1fe0f759 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:54.486030 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec7c97eb-fdb9-4bb9-b894-d65d1fe0f759 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:54.486955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec7c97eb-fdb9-4bb9-b894-d65d1fe0f759 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:54.515828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ec7c97eb-fdb9-4bb9-b894-d65d1fe0f759 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041499 Jul 21 22:08:54.516372 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 517/1005] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:54 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:55.365387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9e477972-f9c4-4c37-9da7-c635f7830118 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:55.366074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9e477972-f9c4-4c37-9da7-c635f7830118 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:55.372585 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e477972-f9c4-4c37-9da7-c635f7830118 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:55.373033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e477972-f9c4-4c37-9da7-c635f7830118 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:55.373790 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e477972-f9c4-4c37-9da7-c635f7830118 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:55.374224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9e477972-f9c4-4c37-9da7-c635f7830118 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:55.501052 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9e477972-f9c4-4c37-9da7-c635f7830118 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:55.509356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9e477972-f9c4-4c37-9da7-c635f7830118 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:55.510858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9e477972-f9c4-4c37-9da7-c635f7830118 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:55.512031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9e477972-f9c4-4c37-9da7-c635f7830118 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.150573 Jul 21 22:08:55.512583 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 518/1006] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:55 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:55.517432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8e3dbc04-304f-4ae6-ae25-10e216c6226f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:55.518325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8e3dbc04-304f-4ae6-ae25-10e216c6226f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:55.523975 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8e3dbc04-304f-4ae6-ae25-10e216c6226f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:55.524487 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8e3dbc04-304f-4ae6-ae25-10e216c6226f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:55.525232 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8e3dbc04-304f-4ae6-ae25-10e216c6226f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:55.525660 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8e3dbc04-304f-4ae6-ae25-10e216c6226f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:55.554014 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8e3dbc04-304f-4ae6-ae25-10e216c6226f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040487 Jul 21 22:08:55.554556 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 519/1007] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:55 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:55.558689 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3eff0100-3095-4e4b-a64c-6277807ef0c9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:55.559324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3eff0100-3095-4e4b-a64c-6277807ef0c9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:55.564695 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3eff0100-3095-4e4b-a64c-6277807ef0c9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:55.565143 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3eff0100-3095-4e4b-a64c-6277807ef0c9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:55.565884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3eff0100-3095-4e4b-a64c-6277807ef0c9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:55.566314 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3eff0100-3095-4e4b-a64c-6277807ef0c9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:55.635695 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3eff0100-3095-4e4b-a64c-6277807ef0c9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:55.643730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3eff0100-3095-4e4b-a64c-6277807ef0c9 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.088267 Jul 21 22:08:55.644285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 520/1008] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:55 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:55.648726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ce5c4e79-158f-4b71-b948-dbf72d9723bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:55.649631 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ce5c4e79-158f-4b71-b948-dbf72d9723bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:55.655414 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ce5c4e79-158f-4b71-b948-dbf72d9723bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:55.655861 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ce5c4e79-158f-4b71-b948-dbf72d9723bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:55.656618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ce5c4e79-158f-4b71-b948-dbf72d9723bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:55.657049 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ce5c4e79-158f-4b71-b948-dbf72d9723bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:55.685509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ce5c4e79-158f-4b71-b948-dbf72d9723bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040243 Jul 21 22:08:55.686048 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 521/1009] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:55 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:56.530387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8355b483-a387-4772-8a36-b1512713a1c5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:56.530988 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8355b483-a387-4772-8a36-b1512713a1c5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:56.538089 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8355b483-a387-4772-8a36-b1512713a1c5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:56.538537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8355b483-a387-4772-8a36-b1512713a1c5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:56.539328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8355b483-a387-4772-8a36-b1512713a1c5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:56.539773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8355b483-a387-4772-8a36-b1512713a1c5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:56.890426 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8355b483-a387-4772-8a36-b1512713a1c5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:56.899449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8355b483-a387-4772-8a36-b1512713a1c5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:56.900994 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8355b483-a387-4772-8a36-b1512713a1c5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:56.902144 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8355b483-a387-4772-8a36-b1512713a1c5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.375628 Jul 21 22:08:56.902720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 522/1010] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:56 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:56.907130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1cf6fd6a-d780-434b-a66d-04b63732d1f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:56.908037 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1cf6fd6a-d780-434b-a66d-04b63732d1f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:56.913814 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1cf6fd6a-d780-434b-a66d-04b63732d1f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:56.914265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1cf6fd6a-d780-434b-a66d-04b63732d1f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:56.915191 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1cf6fd6a-d780-434b-a66d-04b63732d1f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:56.915651 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1cf6fd6a-d780-434b-a66d-04b63732d1f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:56.944221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1cf6fd6a-d780-434b-a66d-04b63732d1f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040530 Jul 21 22:08:56.944763 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 523/1011] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:56 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:56.949010 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-988324a6-903b-417c-9832-67c35302c7b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:56.949598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-988324a6-903b-417c-9832-67c35302c7b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:56.955546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-988324a6-903b-417c-9832-67c35302c7b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:56.955989 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-988324a6-903b-417c-9832-67c35302c7b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:56.956738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-988324a6-903b-417c-9832-67c35302c7b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:56.957170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-988324a6-903b-417c-9832-67c35302c7b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:57.025412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-988324a6-903b-417c-9832-67c35302c7b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:57.032929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-988324a6-903b-417c-9832-67c35302c7b3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.087248 Jul 21 22:08:57.033484 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 524/1012] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:56 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:57.037965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f0b880b9-dd43-48ba-9527-077535f20344 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:57.038867 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f0b880b9-dd43-48ba-9527-077535f20344 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:57.044427 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0b880b9-dd43-48ba-9527-077535f20344 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:57.044879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0b880b9-dd43-48ba-9527-077535f20344 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:57.045641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0b880b9-dd43-48ba-9527-077535f20344 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:57.046076 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0b880b9-dd43-48ba-9527-077535f20344 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:57.074297 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f0b880b9-dd43-48ba-9527-077535f20344 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039842 Jul 21 22:08:57.074856 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 525/1013] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:57 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:57.919049 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e3113761-58ce-4aa4-99a1-e170a75c1fd5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:57.919650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e3113761-58ce-4aa4-99a1-e170a75c1fd5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:57.926980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e3113761-58ce-4aa4-99a1-e170a75c1fd5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:57.927420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e3113761-58ce-4aa4-99a1-e170a75c1fd5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:57.928194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e3113761-58ce-4aa4-99a1-e170a75c1fd5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:57.928626 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e3113761-58ce-4aa4-99a1-e170a75c1fd5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:58.053372 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e3113761-58ce-4aa4-99a1-e170a75c1fd5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:58.062458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e3113761-58ce-4aa4-99a1-e170a75c1fd5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:58.064101 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e3113761-58ce-4aa4-99a1-e170a75c1fd5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:58.065245 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e3113761-58ce-4aa4-99a1-e170a75c1fd5 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.150071 Jul 21 22:08:58.073605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 526/1014] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:57 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:58.073605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-32847dca-51e7-4032-803f-4714f14fec22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:58.073605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-32847dca-51e7-4032-803f-4714f14fec22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:58.077034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32847dca-51e7-4032-803f-4714f14fec22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:58.077558 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32847dca-51e7-4032-803f-4714f14fec22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:58.078314 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32847dca-51e7-4032-803f-4714f14fec22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:58.078745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32847dca-51e7-4032-803f-4714f14fec22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:58.107943 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-32847dca-51e7-4032-803f-4714f14fec22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041142 Jul 21 22:08:58.108475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 527/1015] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:58 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:58.112687 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e2e3d1e6-0f9e-4e56-bac3-1af674e26291 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:58.113279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e2e3d1e6-0f9e-4e56-bac3-1af674e26291 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:58.118754 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2e3d1e6-0f9e-4e56-bac3-1af674e26291 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:58.119249 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2e3d1e6-0f9e-4e56-bac3-1af674e26291 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:58.120001 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2e3d1e6-0f9e-4e56-bac3-1af674e26291 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:58.120433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2e3d1e6-0f9e-4e56-bac3-1af674e26291 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:58.183116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e2e3d1e6-0f9e-4e56-bac3-1af674e26291 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:58.190529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e2e3d1e6-0f9e-4e56-bac3-1af674e26291 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081142 Jul 21 22:08:58.191106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 528/1016] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:58 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:58.195541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0b953944-c280-40c1-80f3-0cb56b99ca94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:58.196496 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0b953944-c280-40c1-80f3-0cb56b99ca94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:58.201979 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b953944-c280-40c1-80f3-0cb56b99ca94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:58.202426 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b953944-c280-40c1-80f3-0cb56b99ca94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:58.203226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b953944-c280-40c1-80f3-0cb56b99ca94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:58.203666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b953944-c280-40c1-80f3-0cb56b99ca94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:58.232905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0b953944-c280-40c1-80f3-0cb56b99ca94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040833 Jul 21 22:08:58.233444 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 529/1017] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:58 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:59.145378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a7883ed0-18a1-4ba6-ae59-3eb661e0ab4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:59.145990 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a7883ed0-18a1-4ba6-ae59-3eb661e0ab4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:59.152000 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7883ed0-18a1-4ba6-ae59-3eb661e0ab4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:59.152455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7883ed0-18a1-4ba6-ae59-3eb661e0ab4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:59.153224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7883ed0-18a1-4ba6-ae59-3eb661e0ab4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:59.153661 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7883ed0-18a1-4ba6-ae59-3eb661e0ab4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:59.277210 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a7883ed0-18a1-4ba6-ae59-3eb661e0ab4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:59.285985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a7883ed0-18a1-4ba6-ae59-3eb661e0ab4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:59.287532 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a7883ed0-18a1-4ba6-ae59-3eb661e0ab4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:59.288682 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a7883ed0-18a1-4ba6-ae59-3eb661e0ab4d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.209982 Jul 21 22:08:59.289234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 530/1018] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:08:59 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:08:59.293669 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a843a93d-7ba4-4f24-ad6a-cab79c9ae7da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:59.294624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a843a93d-7ba4-4f24-ad6a-cab79c9ae7da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:59.300894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a843a93d-7ba4-4f24-ad6a-cab79c9ae7da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:59.301343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a843a93d-7ba4-4f24-ad6a-cab79c9ae7da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:59.302109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a843a93d-7ba4-4f24-ad6a-cab79c9ae7da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:59.302546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a843a93d-7ba4-4f24-ad6a-cab79c9ae7da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:59.330200 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a843a93d-7ba4-4f24-ad6a-cab79c9ae7da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039966 Jul 21 22:08:59.330738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 531/1019] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:59 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:08:59.334964 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-15818bab-1890-4f6d-836f-cf5eec0d734a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:59.335527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-15818bab-1890-4f6d-836f-cf5eec0d734a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:59.341177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15818bab-1890-4f6d-836f-cf5eec0d734a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:59.341633 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15818bab-1890-4f6d-836f-cf5eec0d734a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:59.342384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15818bab-1890-4f6d-836f-cf5eec0d734a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:59.342817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15818bab-1890-4f6d-836f-cf5eec0d734a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:59.347101 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:08:59.402026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-15818bab-1890-4f6d-836f-cf5eec0d734a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:08:59.410574 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-15818bab-1890-4f6d-836f-cf5eec0d734a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078875 Jul 21 22:08:59.411164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 532/1020] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:08:59 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:08:59.415725 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b0ef3b56-5d88-49de-8177-8fb01edbad34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:08:59.416675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b0ef3b56-5d88-49de-8177-8fb01edbad34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:08:59.422358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0ef3b56-5d88-49de-8177-8fb01edbad34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:59.422808 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0ef3b56-5d88-49de-8177-8fb01edbad34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:59.424181 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0ef3b56-5d88-49de-8177-8fb01edbad34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:08:59.424669 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0ef3b56-5d88-49de-8177-8fb01edbad34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:08:59.452434 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b0ef3b56-5d88-49de-8177-8fb01edbad34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040312 Jul 21 22:08:59.452977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 533/1021] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:08:59 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:00.307657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-377b2887-7a5e-4153-b727-9d003cdfe3b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:00.308309 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-377b2887-7a5e-4153-b727-9d003cdfe3b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:00.315274 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-377b2887-7a5e-4153-b727-9d003cdfe3b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:00.315726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-377b2887-7a5e-4153-b727-9d003cdfe3b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:00.316491 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-377b2887-7a5e-4153-b727-9d003cdfe3b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:00.316928 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-377b2887-7a5e-4153-b727-9d003cdfe3b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:00.444388 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-377b2887-7a5e-4153-b727-9d003cdfe3b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:00.452752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-377b2887-7a5e-4153-b727-9d003cdfe3b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:00.454789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-377b2887-7a5e-4153-b727-9d003cdfe3b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:00.455961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-377b2887-7a5e-4153-b727-9d003cdfe3b9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.152183 Jul 21 22:09:00.456512 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 534/1022] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:00 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:00.460932 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b92adeb0-a659-4ebe-b54d-92aa0ba36d7e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:00.464005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b92adeb0-a659-4ebe-b54d-92aa0ba36d7e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:00.470854 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b92adeb0-a659-4ebe-b54d-92aa0ba36d7e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:00.471336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b92adeb0-a659-4ebe-b54d-92aa0ba36d7e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:00.472113 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b92adeb0-a659-4ebe-b54d-92aa0ba36d7e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:00.472549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b92adeb0-a659-4ebe-b54d-92aa0ba36d7e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:00.500797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b92adeb0-a659-4ebe-b54d-92aa0ba36d7e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043300 Jul 21 22:09:00.501350 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 535/1023] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:00 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:00.505748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8a4c1d34-74c5-43d2-a3fb-4a951c1eba9e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:00.506348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8a4c1d34-74c5-43d2-a3fb-4a951c1eba9e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:00.511982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8a4c1d34-74c5-43d2-a3fb-4a951c1eba9e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:00.512433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8a4c1d34-74c5-43d2-a3fb-4a951c1eba9e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:00.513191 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8a4c1d34-74c5-43d2-a3fb-4a951c1eba9e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:00.513627 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8a4c1d34-74c5-43d2-a3fb-4a951c1eba9e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:00.574219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8a4c1d34-74c5-43d2-a3fb-4a951c1eba9e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:00.582317 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8a4c1d34-74c5-43d2-a3fb-4a951c1eba9e tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080002 Jul 21 22:09:00.582871 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 536/1024] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:00 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:00.587330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7862a1f0-f98c-481a-bf29-79c7e02e55c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:00.588229 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7862a1f0-f98c-481a-bf29-79c7e02e55c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:00.593997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7862a1f0-f98c-481a-bf29-79c7e02e55c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:00.594446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7862a1f0-f98c-481a-bf29-79c7e02e55c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:00.595281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7862a1f0-f98c-481a-bf29-79c7e02e55c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:00.595720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7862a1f0-f98c-481a-bf29-79c7e02e55c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:00.623590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7862a1f0-f98c-481a-bf29-79c7e02e55c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039741 Jul 21 22:09:00.624128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 537/1025] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:00 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:01.473636 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8c3406ac-0e45-46ef-a84f-7e874ab3b6ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:01.474275 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8c3406ac-0e45-46ef-a84f-7e874ab3b6ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:01.480883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c3406ac-0e45-46ef-a84f-7e874ab3b6ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:01.481341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c3406ac-0e45-46ef-a84f-7e874ab3b6ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:01.482114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c3406ac-0e45-46ef-a84f-7e874ab3b6ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:01.482554 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c3406ac-0e45-46ef-a84f-7e874ab3b6ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:01.608922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8c3406ac-0e45-46ef-a84f-7e874ab3b6ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:01.617919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8c3406ac-0e45-46ef-a84f-7e874ab3b6ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:01.619467 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8c3406ac-0e45-46ef-a84f-7e874ab3b6ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:01.620654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8c3406ac-0e45-46ef-a84f-7e874ab3b6ed tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.150971 Jul 21 22:09:01.621264 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 538/1026] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:01 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:01.625766 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c8aee95a-a102-40ab-a238-cee33971c66c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:01.627303 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c8aee95a-a102-40ab-a238-cee33971c66c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:01.634337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8aee95a-a102-40ab-a238-cee33971c66c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:01.634793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8aee95a-a102-40ab-a238-cee33971c66c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:01.635588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8aee95a-a102-40ab-a238-cee33971c66c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:01.636031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8aee95a-a102-40ab-a238-cee33971c66c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:01.664009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c8aee95a-a102-40ab-a238-cee33971c66c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041720 Jul 21 22:09:01.664554 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 539/1027] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:01 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:01.668777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b9a5cbc3-31d1-479c-bf09-cefb313a627d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:01.669374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b9a5cbc3-31d1-479c-bf09-cefb313a627d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:01.675386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9a5cbc3-31d1-479c-bf09-cefb313a627d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:01.675832 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9a5cbc3-31d1-479c-bf09-cefb313a627d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:01.676595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9a5cbc3-31d1-479c-bf09-cefb313a627d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:01.677030 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9a5cbc3-31d1-479c-bf09-cefb313a627d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:01.741012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b9a5cbc3-31d1-479c-bf09-cefb313a627d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:01.748521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b9a5cbc3-31d1-479c-bf09-cefb313a627d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083061 Jul 21 22:09:01.749074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 540/1028] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:01 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:01.754052 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6bca2d4b-832f-468b-9f5e-b112d28589a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:01.754982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6bca2d4b-832f-468b-9f5e-b112d28589a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:01.761355 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6bca2d4b-832f-468b-9f5e-b112d28589a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:01.761816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6bca2d4b-832f-468b-9f5e-b112d28589a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:01.762592 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6bca2d4b-832f-468b-9f5e-b112d28589a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:01.763056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6bca2d4b-832f-468b-9f5e-b112d28589a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:01.791243 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6bca2d4b-832f-468b-9f5e-b112d28589a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041162 Jul 21 22:09:01.791795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 541/1029] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:01 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:02.639380 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-396ab804-58b3-4347-9cce-8b074754cdf9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:02.640003 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-396ab804-58b3-4347-9cce-8b074754cdf9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:02.647249 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-396ab804-58b3-4347-9cce-8b074754cdf9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:02.647695 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-396ab804-58b3-4347-9cce-8b074754cdf9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:02.648482 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-396ab804-58b3-4347-9cce-8b074754cdf9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:02.648915 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-396ab804-58b3-4347-9cce-8b074754cdf9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:02.773306 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-396ab804-58b3-4347-9cce-8b074754cdf9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:02.781726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-396ab804-58b3-4347-9cce-8b074754cdf9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:02.783287 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-396ab804-58b3-4347-9cce-8b074754cdf9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:02.784434 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-396ab804-58b3-4347-9cce-8b074754cdf9 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.148954 Jul 21 22:09:02.784985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 542/1030] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:02 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:02.789397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a73ecfb1-ac39-4ae8-92e1-2188524198fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:02.790382 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a73ecfb1-ac39-4ae8-92e1-2188524198fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:02.795912 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a73ecfb1-ac39-4ae8-92e1-2188524198fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:02.796361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a73ecfb1-ac39-4ae8-92e1-2188524198fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:02.797122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a73ecfb1-ac39-4ae8-92e1-2188524198fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:02.797555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a73ecfb1-ac39-4ae8-92e1-2188524198fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:02.825732 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a73ecfb1-ac39-4ae8-92e1-2188524198fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039797 Jul 21 22:09:02.826267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 543/1031] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:02 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:02.831129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3ea23d47-b54e-41d2-b52b-50d5643b54a3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:02.831719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3ea23d47-b54e-41d2-b52b-50d5643b54a3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:02.833228 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:09:02.838131 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ea23d47-b54e-41d2-b52b-50d5643b54a3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:02.838829 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ea23d47-b54e-41d2-b52b-50d5643b54a3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:02.839607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ea23d47-b54e-41d2-b52b-50d5643b54a3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:02.840040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ea23d47-b54e-41d2-b52b-50d5643b54a3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:02.899676 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3ea23d47-b54e-41d2-b52b-50d5643b54a3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:02.906976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3ea23d47-b54e-41d2-b52b-50d5643b54a3 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079814 Jul 21 22:09:02.907581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 544/1032] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:02 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:02.911962 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-60224638-d67b-4f33-af46-30498f0e5689 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:02.912852 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-60224638-d67b-4f33-af46-30498f0e5689 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:02.918762 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60224638-d67b-4f33-af46-30498f0e5689 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:02.919249 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60224638-d67b-4f33-af46-30498f0e5689 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:02.920017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60224638-d67b-4f33-af46-30498f0e5689 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:02.920454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60224638-d67b-4f33-af46-30498f0e5689 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:02.948343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-60224638-d67b-4f33-af46-30498f0e5689 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039812 Jul 21 22:09:02.948884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 545/1033] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:02 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:03.802347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-37686c62-fb02-4647-b252-55473ede08d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:03.802986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-37686c62-fb02-4647-b252-55473ede08d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:03.809951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37686c62-fb02-4647-b252-55473ede08d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:03.810404 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37686c62-fb02-4647-b252-55473ede08d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:03.811199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37686c62-fb02-4647-b252-55473ede08d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:03.811639 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37686c62-fb02-4647-b252-55473ede08d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:03.941552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-37686c62-fb02-4647-b252-55473ede08d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:03.949820 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-37686c62-fb02-4647-b252-55473ede08d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:03.951341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-37686c62-fb02-4647-b252-55473ede08d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:03.952494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-37686c62-fb02-4647-b252-55473ede08d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.154127 Jul 21 22:09:03.954589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 546/1034] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:03 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:03.959265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-059754b5-bed4-47c9-b653-b0d9c604eca7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:03.960166 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-059754b5-bed4-47c9-b653-b0d9c604eca7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:03.966226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-059754b5-bed4-47c9-b653-b0d9c604eca7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:03.966673 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-059754b5-bed4-47c9-b653-b0d9c604eca7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:03.967464 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-059754b5-bed4-47c9-b653-b0d9c604eca7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:03.967897 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-059754b5-bed4-47c9-b653-b0d9c604eca7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:03.999847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-059754b5-bed4-47c9-b653-b0d9c604eca7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044169 Jul 21 22:09:04.000403 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 547/1035] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:03 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:04.004706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1f4e56ca-6cd3-4c15-9146-9f280a348454 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:04.005297 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1f4e56ca-6cd3-4c15-9146-9f280a348454 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:04.011016 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f4e56ca-6cd3-4c15-9146-9f280a348454 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:04.011536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f4e56ca-6cd3-4c15-9146-9f280a348454 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:04.012291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f4e56ca-6cd3-4c15-9146-9f280a348454 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:04.012724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f4e56ca-6cd3-4c15-9146-9f280a348454 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:04.072579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1f4e56ca-6cd3-4c15-9146-9f280a348454 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:04.075926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:09:04.081125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1f4e56ca-6cd3-4c15-9146-9f280a348454 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079787 Jul 21 22:09:04.081686 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 548/1036] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:04 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:04.086370 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-71ba4eb8-8b1e-4ebd-872c-7123b15ffe30 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:04.087300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-71ba4eb8-8b1e-4ebd-872c-7123b15ffe30 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:04.093148 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71ba4eb8-8b1e-4ebd-872c-7123b15ffe30 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:04.093593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71ba4eb8-8b1e-4ebd-872c-7123b15ffe30 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:04.094378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71ba4eb8-8b1e-4ebd-872c-7123b15ffe30 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:04.095486 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71ba4eb8-8b1e-4ebd-872c-7123b15ffe30 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:04.123268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-71ba4eb8-8b1e-4ebd-872c-7123b15ffe30 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040592 Jul 21 22:09:04.123799 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 549/1037] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:04 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:04.972409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-467a89a4-4fbd-43d7-8df9-58f447fec2d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:04.973084 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-467a89a4-4fbd-43d7-8df9-58f447fec2d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:04.979730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-467a89a4-4fbd-43d7-8df9-58f447fec2d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:04.980186 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-467a89a4-4fbd-43d7-8df9-58f447fec2d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:04.980951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-467a89a4-4fbd-43d7-8df9-58f447fec2d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:04.981393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-467a89a4-4fbd-43d7-8df9-58f447fec2d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:05.109108 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-467a89a4-4fbd-43d7-8df9-58f447fec2d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:05.117495 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-467a89a4-4fbd-43d7-8df9-58f447fec2d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:05.119244 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-467a89a4-4fbd-43d7-8df9-58f447fec2d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:05.120385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-467a89a4-4fbd-43d7-8df9-58f447fec2d0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151927 Jul 21 22:09:05.120945 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 550/1038] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:04 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:05.125457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b6b3a0fe-ce2b-4abb-be02-76bd7c0273a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:05.126847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b6b3a0fe-ce2b-4abb-be02-76bd7c0273a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:05.132593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b6b3a0fe-ce2b-4abb-be02-76bd7c0273a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:05.133034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b6b3a0fe-ce2b-4abb-be02-76bd7c0273a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:05.133867 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b6b3a0fe-ce2b-4abb-be02-76bd7c0273a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:05.134298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b6b3a0fe-ce2b-4abb-be02-76bd7c0273a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:05.162551 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b6b3a0fe-ce2b-4abb-be02-76bd7c0273a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040648 Jul 21 22:09:05.163105 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 551/1039] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:05 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:05.167501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e2760fe6-67e8-4eab-860e-fe76cbe9de55 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:05.168098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e2760fe6-67e8-4eab-860e-fe76cbe9de55 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:05.173452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2760fe6-67e8-4eab-860e-fe76cbe9de55 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:05.173896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2760fe6-67e8-4eab-860e-fe76cbe9de55 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:05.174641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2760fe6-67e8-4eab-860e-fe76cbe9de55 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:05.175105 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2760fe6-67e8-4eab-860e-fe76cbe9de55 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:05.238418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e2760fe6-67e8-4eab-860e-fe76cbe9de55 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:05.246083 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e2760fe6-67e8-4eab-860e-fe76cbe9de55 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082053 Jul 21 22:09:05.246649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 552/1040] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:05 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:05.251782 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4b2969f7-802f-4544-a288-221d46dc634b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:05.252678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4b2969f7-802f-4544-a288-221d46dc634b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:05.258246 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b2969f7-802f-4544-a288-221d46dc634b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:05.258694 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b2969f7-802f-4544-a288-221d46dc634b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:05.259497 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b2969f7-802f-4544-a288-221d46dc634b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:05.259956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b2969f7-802f-4544-a288-221d46dc634b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:05.288480 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4b2969f7-802f-4544-a288-221d46dc634b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040803 Jul 21 22:09:05.289039 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 553/1041] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:05 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:06.138089 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2fd8010a-1211-445e-9dda-a9db317830c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:06.138745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2fd8010a-1211-445e-9dda-a9db317830c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:06.145344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2fd8010a-1211-445e-9dda-a9db317830c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:06.145790 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2fd8010a-1211-445e-9dda-a9db317830c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:06.146554 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2fd8010a-1211-445e-9dda-a9db317830c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:06.147018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2fd8010a-1211-445e-9dda-a9db317830c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:06.272682 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2fd8010a-1211-445e-9dda-a9db317830c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:06.281001 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2fd8010a-1211-445e-9dda-a9db317830c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:06.282512 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2fd8010a-1211-445e-9dda-a9db317830c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:06.283692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2fd8010a-1211-445e-9dda-a9db317830c7 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.149530 Jul 21 22:09:06.284258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 554/1042] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:06 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:06.288695 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-825795f4-c0b9-42c3-8e55-f6ee11c8e5a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:06.289623 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-825795f4-c0b9-42c3-8e55-f6ee11c8e5a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:06.295227 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-825795f4-c0b9-42c3-8e55-f6ee11c8e5a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:06.295664 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-825795f4-c0b9-42c3-8e55-f6ee11c8e5a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:06.296460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-825795f4-c0b9-42c3-8e55-f6ee11c8e5a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:06.296925 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-825795f4-c0b9-42c3-8e55-f6ee11c8e5a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:06.325678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-825795f4-c0b9-42c3-8e55-f6ee11c8e5a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040460 Jul 21 22:09:06.326216 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 555/1043] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:06 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:06.330476 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fc0be987-a29d-40f2-8f4c-9fcbb769a83b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:06.331105 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fc0be987-a29d-40f2-8f4c-9fcbb769a83b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:06.336529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fc0be987-a29d-40f2-8f4c-9fcbb769a83b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:06.336976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fc0be987-a29d-40f2-8f4c-9fcbb769a83b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:06.337734 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fc0be987-a29d-40f2-8f4c-9fcbb769a83b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:06.338171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fc0be987-a29d-40f2-8f4c-9fcbb769a83b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:06.398390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fc0be987-a29d-40f2-8f4c-9fcbb769a83b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:06.405900 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fc0be987-a29d-40f2-8f4c-9fcbb769a83b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078776 Jul 21 22:09:06.406457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 556/1044] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:06 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:06.411403 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3fb6283a-e5ac-4c05-8336-e151060439d1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:06.412310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3fb6283a-e5ac-4c05-8336-e151060439d1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:06.417873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3fb6283a-e5ac-4c05-8336-e151060439d1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:06.418325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3fb6283a-e5ac-4c05-8336-e151060439d1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:06.419120 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3fb6283a-e5ac-4c05-8336-e151060439d1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:06.419560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3fb6283a-e5ac-4c05-8336-e151060439d1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:06.448886 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3fb6283a-e5ac-4c05-8336-e151060439d1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041466 Jul 21 22:09:06.449429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 557/1045] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:06 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:07.302485 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6874222d-8d2a-46b2-bf81-a16e4f0aae16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:07.303261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6874222d-8d2a-46b2-bf81-a16e4f0aae16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:07.309751 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6874222d-8d2a-46b2-bf81-a16e4f0aae16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:07.310201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6874222d-8d2a-46b2-bf81-a16e4f0aae16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:07.310965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6874222d-8d2a-46b2-bf81-a16e4f0aae16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:07.311426 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6874222d-8d2a-46b2-bf81-a16e4f0aae16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:07.445358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6874222d-8d2a-46b2-bf81-a16e4f0aae16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:07.453844 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6874222d-8d2a-46b2-bf81-a16e4f0aae16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:07.455999 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6874222d-8d2a-46b2-bf81-a16e4f0aae16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:07.457167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6874222d-8d2a-46b2-bf81-a16e4f0aae16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.159215 Jul 21 22:09:07.457724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 558/1046] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:07 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:07.462397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-07fb1a38-3477-4d6c-8b3e-c37fc0a255bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:07.463343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-07fb1a38-3477-4d6c-8b3e-c37fc0a255bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:07.469656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-07fb1a38-3477-4d6c-8b3e-c37fc0a255bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:07.470779 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-07fb1a38-3477-4d6c-8b3e-c37fc0a255bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:07.471608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-07fb1a38-3477-4d6c-8b3e-c37fc0a255bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:07.472051 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-07fb1a38-3477-4d6c-8b3e-c37fc0a255bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:07.500389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-07fb1a38-3477-4d6c-8b3e-c37fc0a255bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041661 Jul 21 22:09:07.500946 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 559/1047] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:07 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:07.505366 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c2590013-47ff-4125-a250-361b15eff56b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:07.505974 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c2590013-47ff-4125-a250-361b15eff56b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:07.511465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2590013-47ff-4125-a250-361b15eff56b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:07.511919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2590013-47ff-4125-a250-361b15eff56b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:07.512685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2590013-47ff-4125-a250-361b15eff56b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:07.513123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2590013-47ff-4125-a250-361b15eff56b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:07.573017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c2590013-47ff-4125-a250-361b15eff56b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:07.580980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c2590013-47ff-4125-a250-361b15eff56b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079107 Jul 21 22:09:07.581546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 560/1048] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:07 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:07.586044 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cdb4ea30-25d5-433a-bd3d-486d8de3b68e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:07.586954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cdb4ea30-25d5-433a-bd3d-486d8de3b68e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:07.592836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cdb4ea30-25d5-433a-bd3d-486d8de3b68e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:07.593289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cdb4ea30-25d5-433a-bd3d-486d8de3b68e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:07.594120 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cdb4ea30-25d5-433a-bd3d-486d8de3b68e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:07.594499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cdb4ea30-25d5-433a-bd3d-486d8de3b68e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:07.623969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cdb4ea30-25d5-433a-bd3d-486d8de3b68e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041420 Jul 21 22:09:07.624527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 561/1049] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:07 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:08.475610 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-195ee56e-2f65-4012-97ea-ee0702789b0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:08.476272 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-195ee56e-2f65-4012-97ea-ee0702789b0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:08.482834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-195ee56e-2f65-4012-97ea-ee0702789b0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:08.483326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-195ee56e-2f65-4012-97ea-ee0702789b0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:08.484099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-195ee56e-2f65-4012-97ea-ee0702789b0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:08.484536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-195ee56e-2f65-4012-97ea-ee0702789b0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:08.611917 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-195ee56e-2f65-4012-97ea-ee0702789b0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:08.620353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-195ee56e-2f65-4012-97ea-ee0702789b0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:08.621881 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-195ee56e-2f65-4012-97ea-ee0702789b0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:08.623051 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-195ee56e-2f65-4012-97ea-ee0702789b0b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151490 Jul 21 22:09:08.623614 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 562/1050] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:08 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:08.630624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2df04f75-297d-413d-919b-bb6bbcdf719e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:08.630624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2df04f75-297d-413d-919b-bb6bbcdf719e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:08.636560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2df04f75-297d-413d-919b-bb6bbcdf719e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:08.637087 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2df04f75-297d-413d-919b-bb6bbcdf719e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:08.637992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2df04f75-297d-413d-919b-bb6bbcdf719e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:08.638471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2df04f75-297d-413d-919b-bb6bbcdf719e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:08.668629 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2df04f75-297d-413d-919b-bb6bbcdf719e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044022 Jul 21 22:09:08.669224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 563/1051] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:08 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:08.674323 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2cee52d9-6cef-4a0c-991d-88a390e33297 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:08.674922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2cee52d9-6cef-4a0c-991d-88a390e33297 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:08.680558 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2cee52d9-6cef-4a0c-991d-88a390e33297 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:08.681011 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2cee52d9-6cef-4a0c-991d-88a390e33297 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:08.681777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2cee52d9-6cef-4a0c-991d-88a390e33297 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:08.682218 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2cee52d9-6cef-4a0c-991d-88a390e33297 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:08.745353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2cee52d9-6cef-4a0c-991d-88a390e33297 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:08.752756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2cee52d9-6cef-4a0c-991d-88a390e33297 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.082603 Jul 21 22:09:08.753319 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 564/1052] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:08 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:08.758049 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f77476ba-ed67-4406-ab52-03e3c7235fa8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:08.758957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f77476ba-ed67-4406-ab52-03e3c7235fa8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:08.764470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f77476ba-ed67-4406-ab52-03e3c7235fa8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:08.764924 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f77476ba-ed67-4406-ab52-03e3c7235fa8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:08.765695 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f77476ba-ed67-4406-ab52-03e3c7235fa8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:08.766134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f77476ba-ed67-4406-ab52-03e3c7235fa8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:08.782860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:09:08.795950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f77476ba-ed67-4406-ab52-03e3c7235fa8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041647 Jul 21 22:09:08.796530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 565/1053] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:08 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:09.641129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-95ca42bd-515b-4874-a09c-6cf752742887 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:09.642521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-95ca42bd-515b-4874-a09c-6cf752742887 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:09.649731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-95ca42bd-515b-4874-a09c-6cf752742887 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:09.650174 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-95ca42bd-515b-4874-a09c-6cf752742887 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:09.650940 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-95ca42bd-515b-4874-a09c-6cf752742887 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:09.651394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-95ca42bd-515b-4874-a09c-6cf752742887 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:09.778941 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-95ca42bd-515b-4874-a09c-6cf752742887 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:09.787160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-95ca42bd-515b-4874-a09c-6cf752742887 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:09.788666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-95ca42bd-515b-4874-a09c-6cf752742887 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:09.789810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-95ca42bd-515b-4874-a09c-6cf752742887 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.152584 Jul 21 22:09:09.790357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 566/1054] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:09 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:09.794756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2170bea5-2023-43d3-bcd0-db63da05e4c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:09.795796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2170bea5-2023-43d3-bcd0-db63da05e4c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:09.802239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2170bea5-2023-43d3-bcd0-db63da05e4c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:09.802693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2170bea5-2023-43d3-bcd0-db63da05e4c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:09.803501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2170bea5-2023-43d3-bcd0-db63da05e4c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:09.803945 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2170bea5-2023-43d3-bcd0-db63da05e4c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:09.832638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2170bea5-2023-43d3-bcd0-db63da05e4c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041299 Jul 21 22:09:09.833186 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 567/1055] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:09 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:09.837455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e897d6b8-6fbd-485f-8527-ceb902906e1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:09.838054 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e897d6b8-6fbd-485f-8527-ceb902906e1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:09.843846 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e897d6b8-6fbd-485f-8527-ceb902906e1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:09.844294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e897d6b8-6fbd-485f-8527-ceb902906e1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:09.845056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e897d6b8-6fbd-485f-8527-ceb902906e1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:09.845494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e897d6b8-6fbd-485f-8527-ceb902906e1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:09.905937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e897d6b8-6fbd-485f-8527-ceb902906e1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:09.913434 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e897d6b8-6fbd-485f-8527-ceb902906e1b tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079325 Jul 21 22:09:09.913995 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 568/1056] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:09 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:09.918435 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4c29a396-0523-4fd8-a3e0-56bc19df6045 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:09.919374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4c29a396-0523-4fd8-a3e0-56bc19df6045 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:09.925496 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c29a396-0523-4fd8-a3e0-56bc19df6045 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:09.925945 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c29a396-0523-4fd8-a3e0-56bc19df6045 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:09.926714 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c29a396-0523-4fd8-a3e0-56bc19df6045 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:09.927201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c29a396-0523-4fd8-a3e0-56bc19df6045 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:09.955763 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4c29a396-0523-4fd8-a3e0-56bc19df6045 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040807 Jul 21 22:09:09.956308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 569/1057] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:09 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:10.807942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a53da1c6-5c93-4811-9bd4-086729f6c685 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:10.808580 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a53da1c6-5c93-4811-9bd4-086729f6c685 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:10.815585 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a53da1c6-5c93-4811-9bd4-086729f6c685 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:10.816038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a53da1c6-5c93-4811-9bd4-086729f6c685 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:10.816801 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a53da1c6-5c93-4811-9bd4-086729f6c685 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:10.817239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a53da1c6-5c93-4811-9bd4-086729f6c685 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:10.947577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a53da1c6-5c93-4811-9bd4-086729f6c685 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:10.955845 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a53da1c6-5c93-4811-9bd4-086729f6c685 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:10.957357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a53da1c6-5c93-4811-9bd4-086729f6c685 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:10.958510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a53da1c6-5c93-4811-9bd4-086729f6c685 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.154592 Jul 21 22:09:10.959086 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 570/1058] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:10 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:10.963905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-76ee3138-f1c7-4f9a-8a9d-c64be08412dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:10.964816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-76ee3138-f1c7-4f9a-8a9d-c64be08412dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:10.970830 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-76ee3138-f1c7-4f9a-8a9d-c64be08412dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:10.971322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-76ee3138-f1c7-4f9a-8a9d-c64be08412dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:10.972124 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-76ee3138-f1c7-4f9a-8a9d-c64be08412dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:10.972590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-76ee3138-f1c7-4f9a-8a9d-c64be08412dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:11.000898 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-76ee3138-f1c7-4f9a-8a9d-c64be08412dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040845 Jul 21 22:09:11.001465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 571/1059] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:10 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:11.005832 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-783d08e8-a1d9-40c4-b640-e96046855143 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:11.006431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-783d08e8-a1d9-40c4-b640-e96046855143 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:11.011969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-783d08e8-a1d9-40c4-b640-e96046855143 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:11.012418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-783d08e8-a1d9-40c4-b640-e96046855143 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:11.013173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-783d08e8-a1d9-40c4-b640-e96046855143 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:11.013611 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-783d08e8-a1d9-40c4-b640-e96046855143 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:11.087409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-783d08e8-a1d9-40c4-b640-e96046855143 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:11.097235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-783d08e8-a1d9-40c4-b640-e96046855143 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.094800 Jul 21 22:09:11.097801 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 572/1060] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:11 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:11.102896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8a170651-94af-4971-8bf0-0b88b702de2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:11.103825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8a170651-94af-4971-8bf0-0b88b702de2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:11.110051 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8a170651-94af-4971-8bf0-0b88b702de2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:11.110564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8a170651-94af-4971-8bf0-0b88b702de2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:11.112050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8a170651-94af-4971-8bf0-0b88b702de2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:11.112479 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8a170651-94af-4971-8bf0-0b88b702de2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:11.141403 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8a170651-94af-4971-8bf0-0b88b702de2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042517 Jul 21 22:09:11.141963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 573/1061] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:11 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:11.977217 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-41348372-4fd1-4fca-9743-6bf7fa4ae667 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:11.977867 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-41348372-4fd1-4fca-9743-6bf7fa4ae667 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:11.984339 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41348372-4fd1-4fca-9743-6bf7fa4ae667 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:11.984784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41348372-4fd1-4fca-9743-6bf7fa4ae667 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:11.986136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41348372-4fd1-4fca-9743-6bf7fa4ae667 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:11.986573 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41348372-4fd1-4fca-9743-6bf7fa4ae667 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:12.118767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-41348372-4fd1-4fca-9743-6bf7fa4ae667 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:12.127984 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-41348372-4fd1-4fca-9743-6bf7fa4ae667 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:12.129484 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-41348372-4fd1-4fca-9743-6bf7fa4ae667 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:12.130623 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-41348372-4fd1-4fca-9743-6bf7fa4ae667 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.157328 Jul 21 22:09:12.131193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 574/1062] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:11 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:12.135604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-80cb8b9a-52e1-41dc-8509-5cca65ab3a53 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:12.136505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-80cb8b9a-52e1-41dc-8509-5cca65ab3a53 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:12.142090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-80cb8b9a-52e1-41dc-8509-5cca65ab3a53 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:12.142535 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-80cb8b9a-52e1-41dc-8509-5cca65ab3a53 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:12.143318 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-80cb8b9a-52e1-41dc-8509-5cca65ab3a53 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:12.143745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-80cb8b9a-52e1-41dc-8509-5cca65ab3a53 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:12.171595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-80cb8b9a-52e1-41dc-8509-5cca65ab3a53 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039429 Jul 21 22:09:12.172139 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 575/1063] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:12 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:12.176821 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8294861a-8e05-4ecd-bab9-fd96ba90feff tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:12.177409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8294861a-8e05-4ecd-bab9-fd96ba90feff tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:12.182836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8294861a-8e05-4ecd-bab9-fd96ba90feff tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:12.183331 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8294861a-8e05-4ecd-bab9-fd96ba90feff tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:12.184087 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8294861a-8e05-4ecd-bab9-fd96ba90feff tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:12.184517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8294861a-8e05-4ecd-bab9-fd96ba90feff tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:12.248627 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8294861a-8e05-4ecd-bab9-fd96ba90feff tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:12.256739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8294861a-8e05-4ecd-bab9-fd96ba90feff tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.083699 Jul 21 22:09:12.257294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 576/1064] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:12 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:12.261683 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-af4173e0-b8cf-460c-89d6-d5f2165b6bdd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:12.262587 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-af4173e0-b8cf-460c-89d6-d5f2165b6bdd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:12.268410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af4173e0-b8cf-460c-89d6-d5f2165b6bdd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:12.268858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af4173e0-b8cf-460c-89d6-d5f2165b6bdd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:12.269621 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af4173e0-b8cf-460c-89d6-d5f2165b6bdd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:12.270057 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af4173e0-b8cf-460c-89d6-d5f2165b6bdd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:12.299637 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-af4173e0-b8cf-460c-89d6-d5f2165b6bdd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041320 Jul 21 22:09:12.300245 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 577/1065] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:12 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:13.148813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-600773be-5c9c-4025-8fe8-4422240100c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:13.149499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-600773be-5c9c-4025-8fe8-4422240100c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:13.156017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-600773be-5c9c-4025-8fe8-4422240100c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:13.156472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-600773be-5c9c-4025-8fe8-4422240100c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:13.157242 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-600773be-5c9c-4025-8fe8-4422240100c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:13.157680 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-600773be-5c9c-4025-8fe8-4422240100c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:13.283644 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-600773be-5c9c-4025-8fe8-4422240100c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:13.292090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-600773be-5c9c-4025-8fe8-4422240100c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:13.293602 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-600773be-5c9c-4025-8fe8-4422240100c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:13.294756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-600773be-5c9c-4025-8fe8-4422240100c6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.149910 Jul 21 22:09:13.295352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 578/1066] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:13 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:13.300396 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-18700485-6ac4-428a-9ff4-17c0e8182667 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:13.301301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-18700485-6ac4-428a-9ff4-17c0e8182667 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:13.307294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-18700485-6ac4-428a-9ff4-17c0e8182667 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:13.307749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-18700485-6ac4-428a-9ff4-17c0e8182667 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:13.308534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-18700485-6ac4-428a-9ff4-17c0e8182667 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:13.308970 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-18700485-6ac4-428a-9ff4-17c0e8182667 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:13.336893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-18700485-6ac4-428a-9ff4-17c0e8182667 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040576 Jul 21 22:09:13.337431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 579/1067] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:13 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:13.341853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-31150838-61e5-453a-90d1-abf46bc0a119 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:13.342447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-31150838-61e5-453a-90d1-abf46bc0a119 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:13.348324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31150838-61e5-453a-90d1-abf46bc0a119 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:13.348767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31150838-61e5-453a-90d1-abf46bc0a119 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:13.349512 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31150838-61e5-453a-90d1-abf46bc0a119 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:13.349980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31150838-61e5-453a-90d1-abf46bc0a119 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:13.409258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-31150838-61e5-453a-90d1-abf46bc0a119 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:13.416574 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-31150838-61e5-453a-90d1-abf46bc0a119 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078241 Jul 21 22:09:13.417147 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 580/1068] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:13 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:13.421565 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-73591922-5010-4ab0-a4ba-38da71b57691 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:13.422469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-73591922-5010-4ab0-a4ba-38da71b57691 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:13.428745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73591922-5010-4ab0-a4ba-38da71b57691 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:13.429192 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73591922-5010-4ab0-a4ba-38da71b57691 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:13.429956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73591922-5010-4ab0-a4ba-38da71b57691 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:13.430463 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73591922-5010-4ab0-a4ba-38da71b57691 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:13.458874 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-73591922-5010-4ab0-a4ba-38da71b57691 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040755 Jul 21 22:09:13.459457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 581/1069] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:13 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:14.314224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6cbf48b2-7297-4a27-922e-08f8b4df4a16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:14.314858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6cbf48b2-7297-4a27-922e-08f8b4df4a16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:14.321418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6cbf48b2-7297-4a27-922e-08f8b4df4a16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:14.321864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6cbf48b2-7297-4a27-922e-08f8b4df4a16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:14.322623 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6cbf48b2-7297-4a27-922e-08f8b4df4a16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:14.323085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6cbf48b2-7297-4a27-922e-08f8b4df4a16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:14.327044 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:09:14.451866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6cbf48b2-7297-4a27-922e-08f8b4df4a16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:14.460110 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6cbf48b2-7297-4a27-922e-08f8b4df4a16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:14.461624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6cbf48b2-7297-4a27-922e-08f8b4df4a16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:14.462772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6cbf48b2-7297-4a27-922e-08f8b4df4a16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.153001 Jul 21 22:09:14.464789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 582/1070] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:14 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:14.468838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-420323f5-f46e-4345-b84a-308c667e598a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:14.469757 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-420323f5-f46e-4345-b84a-308c667e598a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:14.475752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-420323f5-f46e-4345-b84a-308c667e598a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:14.476204 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-420323f5-f46e-4345-b84a-308c667e598a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:14.476979 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-420323f5-f46e-4345-b84a-308c667e598a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:14.477417 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-420323f5-f46e-4345-b84a-308c667e598a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:14.506390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-420323f5-f46e-4345-b84a-308c667e598a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041782 Jul 21 22:09:14.506940 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 583/1071] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:14 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:14.511208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-be16c0ff-a8d5-4b5b-95f1-d62ff375daab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:14.511814 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-be16c0ff-a8d5-4b5b-95f1-d62ff375daab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:14.517310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-be16c0ff-a8d5-4b5b-95f1-d62ff375daab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:14.517756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-be16c0ff-a8d5-4b5b-95f1-d62ff375daab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:14.518521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-be16c0ff-a8d5-4b5b-95f1-d62ff375daab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:14.518959 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-be16c0ff-a8d5-4b5b-95f1-d62ff375daab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:14.580020 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-be16c0ff-a8d5-4b5b-95f1-d62ff375daab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:14.587298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-be16c0ff-a8d5-4b5b-95f1-d62ff375daab tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079392 Jul 21 22:09:14.587859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 584/1072] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:14 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:14.592552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2fbed13f-2668-4ddf-9808-17b9bb006924 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:14.593455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2fbed13f-2668-4ddf-9808-17b9bb006924 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:14.599451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2fbed13f-2668-4ddf-9808-17b9bb006924 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:14.599904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2fbed13f-2668-4ddf-9808-17b9bb006924 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:14.600667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2fbed13f-2668-4ddf-9808-17b9bb006924 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:14.601102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2fbed13f-2668-4ddf-9808-17b9bb006924 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:14.630529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2fbed13f-2668-4ddf-9808-17b9bb006924 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041696 Jul 21 22:09:14.631091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 585/1073] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:14 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:15.481546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6528dc97-2120-416c-bc97-88f51dea277a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:15.482177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6528dc97-2120-416c-bc97-88f51dea277a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:15.488253 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6528dc97-2120-416c-bc97-88f51dea277a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:15.488705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6528dc97-2120-416c-bc97-88f51dea277a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:15.489471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6528dc97-2120-416c-bc97-88f51dea277a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:15.489905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6528dc97-2120-416c-bc97-88f51dea277a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:15.615373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6528dc97-2120-416c-bc97-88f51dea277a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:15.623629 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6528dc97-2120-416c-bc97-88f51dea277a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:15.625145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6528dc97-2120-416c-bc97-88f51dea277a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:15.626812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6528dc97-2120-416c-bc97-88f51dea277a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.149374 Jul 21 22:09:15.627395 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 586/1074] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:15 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:15.631820 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-aeda15a6-7785-4f2d-9231-e8a64d4b63ad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:15.632726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-aeda15a6-7785-4f2d-9231-e8a64d4b63ad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:15.638283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aeda15a6-7785-4f2d-9231-e8a64d4b63ad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:15.638731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aeda15a6-7785-4f2d-9231-e8a64d4b63ad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:15.639531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aeda15a6-7785-4f2d-9231-e8a64d4b63ad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:15.639967 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aeda15a6-7785-4f2d-9231-e8a64d4b63ad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:15.668413 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-aeda15a6-7785-4f2d-9231-e8a64d4b63ad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040058 Jul 21 22:09:15.668954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 587/1075] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:15 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:15.673152 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f9cc348f-2b89-420b-bd82-e2f5dcd0fdd8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:15.673749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f9cc348f-2b89-420b-bd82-e2f5dcd0fdd8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:15.679221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9cc348f-2b89-420b-bd82-e2f5dcd0fdd8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:15.679667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9cc348f-2b89-420b-bd82-e2f5dcd0fdd8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:15.680424 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9cc348f-2b89-420b-bd82-e2f5dcd0fdd8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:15.680859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9cc348f-2b89-420b-bd82-e2f5dcd0fdd8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:15.746098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f9cc348f-2b89-420b-bd82-e2f5dcd0fdd8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:15.754133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f9cc348f-2b89-420b-bd82-e2f5dcd0fdd8 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.084270 Jul 21 22:09:15.754691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 588/1076] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:15 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:15.759125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a3da6c08-b799-4eb3-9347-dcec10af9d49 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:15.760033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a3da6c08-b799-4eb3-9347-dcec10af9d49 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:15.765603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3da6c08-b799-4eb3-9347-dcec10af9d49 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:15.766050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3da6c08-b799-4eb3-9347-dcec10af9d49 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:15.766855 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3da6c08-b799-4eb3-9347-dcec10af9d49 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:15.767322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3da6c08-b799-4eb3-9347-dcec10af9d49 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:15.795492 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a3da6c08-b799-4eb3-9347-dcec10af9d49 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039778 Jul 21 22:09:15.796035 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 589/1077] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:15 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:16.644851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-77595607-7194-48f2-ad4c-a9c958fe36df tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:16.645481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-77595607-7194-48f2-ad4c-a9c958fe36df tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:16.652077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77595607-7194-48f2-ad4c-a9c958fe36df tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:16.652530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77595607-7194-48f2-ad4c-a9c958fe36df tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:16.653289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77595607-7194-48f2-ad4c-a9c958fe36df tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:16.653725 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77595607-7194-48f2-ad4c-a9c958fe36df tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:16.785017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-77595607-7194-48f2-ad4c-a9c958fe36df tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:16.793234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-77595607-7194-48f2-ad4c-a9c958fe36df tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:16.794769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-77595607-7194-48f2-ad4c-a9c958fe36df tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:16.795930 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-77595607-7194-48f2-ad4c-a9c958fe36df tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.155449 Jul 21 22:09:16.796483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 590/1078] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:16 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:16.801073 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-aa04d094-748a-4473-bd90-13d7ae6942e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:16.801973 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-aa04d094-748a-4473-bd90-13d7ae6942e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:16.807948 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa04d094-748a-4473-bd90-13d7ae6942e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:16.808399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa04d094-748a-4473-bd90-13d7ae6942e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:16.809166 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa04d094-748a-4473-bd90-13d7ae6942e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:16.809597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa04d094-748a-4473-bd90-13d7ae6942e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:16.839139 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-aa04d094-748a-4473-bd90-13d7ae6942e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041378 Jul 21 22:09:16.839683 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 591/1079] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:16 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:16.844133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e37fccd3-efcb-4879-b985-4509c1b7e4c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:16.844724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e37fccd3-efcb-4879-b985-4509c1b7e4c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:16.850128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e37fccd3-efcb-4879-b985-4509c1b7e4c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:16.850572 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e37fccd3-efcb-4879-b985-4509c1b7e4c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:16.851363 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e37fccd3-efcb-4879-b985-4509c1b7e4c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:16.851798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e37fccd3-efcb-4879-b985-4509c1b7e4c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:16.911449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e37fccd3-efcb-4879-b985-4509c1b7e4c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:16.918751 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e37fccd3-efcb-4879-b985-4509c1b7e4c2 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078012 Jul 21 22:09:16.919344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 592/1080] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:16 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:16.923982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fd213222-54d7-46b1-8c18-ceb02643f457 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:16.924876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fd213222-54d7-46b1-8c18-ceb02643f457 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:16.930397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fd213222-54d7-46b1-8c18-ceb02643f457 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:16.930840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fd213222-54d7-46b1-8c18-ceb02643f457 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:16.931624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fd213222-54d7-46b1-8c18-ceb02643f457 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:16.932058 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fd213222-54d7-46b1-8c18-ceb02643f457 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:16.961025 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fd213222-54d7-46b1-8c18-ceb02643f457 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040722 Jul 21 22:09:16.961564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 593/1081] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:16 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:17.813994 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-683ec062-3a32-497c-b032-6cee16f79ca3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:17.814706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-683ec062-3a32-497c-b032-6cee16f79ca3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:17.816934 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:09:17.822419 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-683ec062-3a32-497c-b032-6cee16f79ca3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:17.822879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-683ec062-3a32-497c-b032-6cee16f79ca3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:17.823693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-683ec062-3a32-497c-b032-6cee16f79ca3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:17.824138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-683ec062-3a32-497c-b032-6cee16f79ca3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:17.957709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-683ec062-3a32-497c-b032-6cee16f79ca3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:17.966399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-683ec062-3a32-497c-b032-6cee16f79ca3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:17.968034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-683ec062-3a32-497c-b032-6cee16f79ca3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:17.969277 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-683ec062-3a32-497c-b032-6cee16f79ca3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.159271 Jul 21 22:09:17.969842 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 594/1082] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:17 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:17.974808 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5eab117a-0e2b-4f95-aaa4-b628be8496ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:17.975748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5eab117a-0e2b-4f95-aaa4-b628be8496ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:17.981670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5eab117a-0e2b-4f95-aaa4-b628be8496ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:17.982125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5eab117a-0e2b-4f95-aaa4-b628be8496ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:17.982894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5eab117a-0e2b-4f95-aaa4-b628be8496ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:17.983371 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5eab117a-0e2b-4f95-aaa4-b628be8496ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:18.013437 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5eab117a-0e2b-4f95-aaa4-b628be8496ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042620 Jul 21 22:09:18.013979 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 595/1083] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:17 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:18.018471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-69950e4a-52fe-490c-804a-717fb4fd6b80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:18.019106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-69950e4a-52fe-490c-804a-717fb4fd6b80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:18.024451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69950e4a-52fe-490c-804a-717fb4fd6b80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:18.024906 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69950e4a-52fe-490c-804a-717fb4fd6b80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:18.025667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69950e4a-52fe-490c-804a-717fb4fd6b80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:18.026109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69950e4a-52fe-490c-804a-717fb4fd6b80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:18.085666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-69950e4a-52fe-490c-804a-717fb4fd6b80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:18.093599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-69950e4a-52fe-490c-804a-717fb4fd6b80 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078675 Jul 21 22:09:18.094165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 596/1084] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:18 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:18.098741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-75ed9be1-9cbf-4263-8bf3-17bb12267357 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:18.099673 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-75ed9be1-9cbf-4263-8bf3-17bb12267357 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:18.105327 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-75ed9be1-9cbf-4263-8bf3-17bb12267357 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:18.105771 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-75ed9be1-9cbf-4263-8bf3-17bb12267357 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:18.106536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-75ed9be1-9cbf-4263-8bf3-17bb12267357 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:18.106966 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-75ed9be1-9cbf-4263-8bf3-17bb12267357 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:18.136390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-75ed9be1-9cbf-4263-8bf3-17bb12267357 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041244 Jul 21 22:09:18.136937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 597/1085] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:18 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:18.527206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:09:18.527684 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:09:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 (ip 10.222.0.44) !!! Jul 21 22:09:18.986620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-531b819c-c56b-4f4a-b804-9a37f20ecf08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:18.987314 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-531b819c-c56b-4f4a-b804-9a37f20ecf08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:18.994121 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-531b819c-c56b-4f4a-b804-9a37f20ecf08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:18.994576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-531b819c-c56b-4f4a-b804-9a37f20ecf08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:18.995385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-531b819c-c56b-4f4a-b804-9a37f20ecf08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:18.995825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-531b819c-c56b-4f4a-b804-9a37f20ecf08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:19.123512 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-531b819c-c56b-4f4a-b804-9a37f20ecf08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:19.127703 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:09:19.135041 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-531b819c-c56b-4f4a-b804-9a37f20ecf08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:19.136555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-531b819c-c56b-4f4a-b804-9a37f20ecf08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:19.137728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-531b819c-c56b-4f4a-b804-9a37f20ecf08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.154985 Jul 21 22:09:19.138272 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 598/1086] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:18 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:19.143715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2bbad993-d8fd-451e-8731-3c565c841ceb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:19.144633 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2bbad993-d8fd-451e-8731-3c565c841ceb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:19.150425 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2bbad993-d8fd-451e-8731-3c565c841ceb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:19.150877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2bbad993-d8fd-451e-8731-3c565c841ceb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:19.151684 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2bbad993-d8fd-451e-8731-3c565c841ceb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:19.152122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2bbad993-d8fd-451e-8731-3c565c841ceb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:19.179957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2bbad993-d8fd-451e-8731-3c565c841ceb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040720 Jul 21 22:09:19.180498 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 599/1087] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:19 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:19.184715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e84b3134-f8c8-4648-854a-6e61e5925f07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:19.185310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e84b3134-f8c8-4648-854a-6e61e5925f07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:19.191160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e84b3134-f8c8-4648-854a-6e61e5925f07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:19.191610 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e84b3134-f8c8-4648-854a-6e61e5925f07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:19.192366 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e84b3134-f8c8-4648-854a-6e61e5925f07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:19.192798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e84b3134-f8c8-4648-854a-6e61e5925f07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:19.255543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e84b3134-f8c8-4648-854a-6e61e5925f07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:19.262908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e84b3134-f8c8-4648-854a-6e61e5925f07 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081498 Jul 21 22:09:19.263505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 600/1088] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:19 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:19.268489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-47775079-3094-45e0-be10-8fe268f1b07f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:19.269398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-47775079-3094-45e0-be10-8fe268f1b07f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:19.274879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-47775079-3094-45e0-be10-8fe268f1b07f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:19.275357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-47775079-3094-45e0-be10-8fe268f1b07f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:19.276126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-47775079-3094-45e0-be10-8fe268f1b07f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:19.276562 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-47775079-3094-45e0-be10-8fe268f1b07f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:19.304321 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-47775079-3094-45e0-be10-8fe268f1b07f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039863 Jul 21 22:09:19.304863 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 601/1089] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:19 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:20.155713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9eb8b987-ba43-468d-8868-dc17dcfc541d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:20.156329 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9eb8b987-ba43-468d-8868-dc17dcfc541d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:20.162903 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9eb8b987-ba43-468d-8868-dc17dcfc541d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:20.163387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9eb8b987-ba43-468d-8868-dc17dcfc541d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:20.164159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9eb8b987-ba43-468d-8868-dc17dcfc541d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:20.164592 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9eb8b987-ba43-468d-8868-dc17dcfc541d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:20.290784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9eb8b987-ba43-468d-8868-dc17dcfc541d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:20.299871 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9eb8b987-ba43-468d-8868-dc17dcfc541d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:20.301679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9eb8b987-ba43-468d-8868-dc17dcfc541d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:20.302831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9eb8b987-ba43-468d-8868-dc17dcfc541d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.150970 Jul 21 22:09:20.303429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 602/1090] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:20 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:20.307873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1cfc627f-f513-4859-91ae-8599776be476 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:20.308786 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1cfc627f-f513-4859-91ae-8599776be476 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:20.315171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1cfc627f-f513-4859-91ae-8599776be476 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:20.315626 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1cfc627f-f513-4859-91ae-8599776be476 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:20.316397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1cfc627f-f513-4859-91ae-8599776be476 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:20.316834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1cfc627f-f513-4859-91ae-8599776be476 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:20.344875 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1cfc627f-f513-4859-91ae-8599776be476 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040496 Jul 21 22:09:20.345459 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 603/1091] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:20 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:20.349650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-04380307-d84c-43ba-9743-55e12206ac44 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:20.350245 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-04380307-d84c-43ba-9743-55e12206ac44 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:20.355660 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04380307-d84c-43ba-9743-55e12206ac44 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:20.356110 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04380307-d84c-43ba-9743-55e12206ac44 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:20.356894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04380307-d84c-43ba-9743-55e12206ac44 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:20.357332 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04380307-d84c-43ba-9743-55e12206ac44 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:20.416848 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-04380307-d84c-43ba-9743-55e12206ac44 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:20.424782 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-04380307-d84c-43ba-9743-55e12206ac44 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078415 Jul 21 22:09:20.425346 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 604/1092] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:20 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:20.429783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-94c11c35-0c4a-4217-b1df-341e1ac25771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:20.430717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-94c11c35-0c4a-4217-b1df-341e1ac25771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:20.436239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-94c11c35-0c4a-4217-b1df-341e1ac25771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:20.436690 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-94c11c35-0c4a-4217-b1df-341e1ac25771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:20.437454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-94c11c35-0c4a-4217-b1df-341e1ac25771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:20.437892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-94c11c35-0c4a-4217-b1df-341e1ac25771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:20.468281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-94c11c35-0c4a-4217-b1df-341e1ac25771 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041939 Jul 21 22:09:20.468834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 605/1093] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:20 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:21.321440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-adca11ac-1ee4-4f24-8f49-f01ffe7da85f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:21.322067 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-adca11ac-1ee4-4f24-8f49-f01ffe7da85f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:21.328432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-adca11ac-1ee4-4f24-8f49-f01ffe7da85f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:21.328875 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-adca11ac-1ee4-4f24-8f49-f01ffe7da85f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:21.329635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-adca11ac-1ee4-4f24-8f49-f01ffe7da85f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:21.330060 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-adca11ac-1ee4-4f24-8f49-f01ffe7da85f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:21.458130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-adca11ac-1ee4-4f24-8f49-f01ffe7da85f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:21.466724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-adca11ac-1ee4-4f24-8f49-f01ffe7da85f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:21.468256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-adca11ac-1ee4-4f24-8f49-f01ffe7da85f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:21.469403 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-adca11ac-1ee4-4f24-8f49-f01ffe7da85f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151948 Jul 21 22:09:21.469955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 606/1094] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:21 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:21.475193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-18bd366c-d58b-44fa-a06c-8529bf443ae3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:21.476104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-18bd366c-d58b-44fa-a06c-8529bf443ae3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:21.481996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-18bd366c-d58b-44fa-a06c-8529bf443ae3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:21.482445 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-18bd366c-d58b-44fa-a06c-8529bf443ae3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:21.483236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-18bd366c-d58b-44fa-a06c-8529bf443ae3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:21.483669 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-18bd366c-d58b-44fa-a06c-8529bf443ae3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:21.512262 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-18bd366c-d58b-44fa-a06c-8529bf443ae3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040779 Jul 21 22:09:21.512802 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 607/1095] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:21 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:21.517196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6f153dd7-8eac-496b-9f50-b29dc2ce51eb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:21.517788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6f153dd7-8eac-496b-9f50-b29dc2ce51eb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:21.523526 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f153dd7-8eac-496b-9f50-b29dc2ce51eb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:21.523980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f153dd7-8eac-496b-9f50-b29dc2ce51eb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:21.524745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f153dd7-8eac-496b-9f50-b29dc2ce51eb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:21.525183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f153dd7-8eac-496b-9f50-b29dc2ce51eb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:21.584609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6f153dd7-8eac-496b-9f50-b29dc2ce51eb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:21.592183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6f153dd7-8eac-496b-9f50-b29dc2ce51eb tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078469 Jul 21 22:09:21.592742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 608/1096] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:21 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:21.597675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-357c232e-4fee-4ec1-9cac-bedd77c60d6e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:21.598575 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-357c232e-4fee-4ec1-9cac-bedd77c60d6e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:21.604091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-357c232e-4fee-4ec1-9cac-bedd77c60d6e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:21.604542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-357c232e-4fee-4ec1-9cac-bedd77c60d6e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:21.605301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-357c232e-4fee-4ec1-9cac-bedd77c60d6e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:21.605734 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-357c232e-4fee-4ec1-9cac-bedd77c60d6e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:21.634042 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-357c232e-4fee-4ec1-9cac-bedd77c60d6e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040340 Jul 21 22:09:21.634581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 609/1097] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:21 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:22.491519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7b2840e9-cc2b-46b1-be06-b5964251777d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:22.492135 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7b2840e9-cc2b-46b1-be06-b5964251777d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:22.501490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7b2840e9-cc2b-46b1-be06-b5964251777d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:22.501947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7b2840e9-cc2b-46b1-be06-b5964251777d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:22.502726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7b2840e9-cc2b-46b1-be06-b5964251777d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:22.503215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7b2840e9-cc2b-46b1-be06-b5964251777d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:22.630181 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7b2840e9-cc2b-46b1-be06-b5964251777d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:22.638527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7b2840e9-cc2b-46b1-be06-b5964251777d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:22.640346 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7b2840e9-cc2b-46b1-be06-b5964251777d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:22.641260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7b2840e9-cc2b-46b1-be06-b5964251777d tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.156641 Jul 21 22:09:22.641819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 610/1098] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:22 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:09:22.647106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-86bcc927-cb93-4c25-933e-60bfaba25ea8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:22.648024 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-86bcc927-cb93-4c25-933e-60bfaba25ea8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:22.653722 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86bcc927-cb93-4c25-933e-60bfaba25ea8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:22.654176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86bcc927-cb93-4c25-933e-60bfaba25ea8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:22.654946 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86bcc927-cb93-4c25-933e-60bfaba25ea8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:22.655537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-86bcc927-cb93-4c25-933e-60bfaba25ea8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:22.684085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-86bcc927-cb93-4c25-933e-60bfaba25ea8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040800 Jul 21 22:09:22.684630 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 611/1099] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:22 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:22.688916 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e5f8865f-4ef9-4bb9-8e51-ef4d685ebf84 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:22.689521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e5f8865f-4ef9-4bb9-8e51-ef4d685ebf84 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:22.695022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e5f8865f-4ef9-4bb9-8e51-ef4d685ebf84 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:22.695492 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e5f8865f-4ef9-4bb9-8e51-ef4d685ebf84 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:22.696256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e5f8865f-4ef9-4bb9-8e51-ef4d685ebf84 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:22.696693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e5f8865f-4ef9-4bb9-8e51-ef4d685ebf84 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:22.759484 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e5f8865f-4ef9-4bb9-8e51-ef4d685ebf84 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:22.766878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e5f8865f-4ef9-4bb9-8e51-ef4d685ebf84 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.081331 Jul 21 22:09:22.768005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 612/1100] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:22 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:22.775681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d6c98461-4263-4edc-8be5-b7f5ab4ce96b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:22.775681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d6c98461-4263-4edc-8be5-b7f5ab4ce96b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:22.782007 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d6c98461-4263-4edc-8be5-b7f5ab4ce96b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:22.782871 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d6c98461-4263-4edc-8be5-b7f5ab4ce96b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:22.784804 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d6c98461-4263-4edc-8be5-b7f5ab4ce96b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:22.785613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d6c98461-4263-4edc-8be5-b7f5ab4ce96b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:22.821525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d6c98461-4263-4edc-8be5-b7f5ab4ce96b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052495 Jul 21 22:09:22.822091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 613/1101] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:22 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:22.902462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-fc4c4083-0152-430a-8357-c8324aaf909e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lazy-loading 'services' on Instance uuid b34275f2-dfb0-4cd8-bac0-3e182fcb2fca {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:09:23.659950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-69b30588-019a-4739-938b-563e7f7fbf96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:23.660558 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-69b30588-019a-4739-938b-563e7f7fbf96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:23.667258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69b30588-019a-4739-938b-563e7f7fbf96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:23.667710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69b30588-019a-4739-938b-563e7f7fbf96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:23.668473 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69b30588-019a-4739-938b-563e7f7fbf96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:23.668914 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69b30588-019a-4739-938b-563e7f7fbf96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:23.796018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-69b30588-019a-4739-938b-563e7f7fbf96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:23.805011 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-69b30588-019a-4739-938b-563e7f7fbf96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:23.806534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-69b30588-019a-4739-938b-563e7f7fbf96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:23.807793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-69b30588-019a-4739-938b-563e7f7fbf96 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.151731 Jul 21 22:09:23.808355 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 614/1102] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:09:23 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:09:23.812775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9f808a97-55c4-4da0-a6d5-d960b8130fc9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:23.813681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9f808a97-55c4-4da0-a6d5-d960b8130fc9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:23.819278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9f808a97-55c4-4da0-a6d5-d960b8130fc9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:23.819726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9f808a97-55c4-4da0-a6d5-d960b8130fc9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:23.820487 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9f808a97-55c4-4da0-a6d5-d960b8130fc9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:23.820922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9f808a97-55c4-4da0-a6d5-d960b8130fc9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:23.836853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:09:23.850424 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9f808a97-55c4-4da0-a6d5-d960b8130fc9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041117 Jul 21 22:09:23.850973 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 615/1103] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:23 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:23.855223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d10976b4-a804-4c33-8a85-5fceeb451290 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:23.855824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d10976b4-a804-4c33-8a85-5fceeb451290 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:23.861953 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d10976b4-a804-4c33-8a85-5fceeb451290 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:23.862438 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d10976b4-a804-4c33-8a85-5fceeb451290 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:23.863244 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d10976b4-a804-4c33-8a85-5fceeb451290 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:23.863681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d10976b4-a804-4c33-8a85-5fceeb451290 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:23.924198 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d10976b4-a804-4c33-8a85-5fceeb451290 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:23.932329 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d10976b4-a804-4c33-8a85-5fceeb451290 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.080416 Jul 21 22:09:23.932895 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 616/1104] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:23 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:09:23.937595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-78563e3f-3671-4ebf-a298-b0b205b0103a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:23.938483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-78563e3f-3671-4ebf-a298-b0b205b0103a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:23.944460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-78563e3f-3671-4ebf-a298-b0b205b0103a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:23.944925 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-78563e3f-3671-4ebf-a298-b0b205b0103a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:23.945755 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-78563e3f-3671-4ebf-a298-b0b205b0103a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:23.946803 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-78563e3f-3671-4ebf-a298-b0b205b0103a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:23.975438 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-78563e3f-3671-4ebf-a298-b0b205b0103a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041528 Jul 21 22:09:23.975989 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 617/1105] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:09:23 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:09:24.026627 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5a0ad94e-5428-4edb-8c10-db51d038a4f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:24.027158 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5a0ad94e-5428-4edb-8c10-db51d038a4f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:24.033169 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a0ad94e-5428-4edb-8c10-db51d038a4f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:24.033621 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a0ad94e-5428-4edb-8c10-db51d038a4f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:24.034390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a0ad94e-5428-4edb-8c10-db51d038a4f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:24.034831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a0ad94e-5428-4edb-8c10-db51d038a4f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:24.059366 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5a0ad94e-5428-4edb-8c10-db51d038a4f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Going to try to terminate instance {{(pid=117979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:09:24.133930 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5a0ad94e-5428-4edb-8c10-db51d038a4f1 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 204 len: 0 microversion: 2.1 time: 0.110420 Jul 21 22:09:24.134619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 618/1106] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:09:24 2022] DELETE /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:09:24.143815 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c960e1f3-dfd1-4610-abb4-7db159fcc216 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:24.144509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c960e1f3-dfd1-4610-abb4-7db159fcc216 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:24.150634 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c960e1f3-dfd1-4610-abb4-7db159fcc216 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:24.151156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c960e1f3-dfd1-4610-abb4-7db159fcc216 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:24.151949 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c960e1f3-dfd1-4610-abb4-7db159fcc216 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:24.152429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c960e1f3-dfd1-4610-abb4-7db159fcc216 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:24.281914 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c960e1f3-dfd1-4610-abb4-7db159fcc216 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:09:24.290011 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c960e1f3-dfd1-4610-abb4-7db159fcc216 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 200 len: 1689 microversion: 2.1 time: 0.150646 Jul 21 22:09:24.290580 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 619/1107] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:09:24 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:09:24.346738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-af164907-b5e4-48a7-9f0e-8826b3f187fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:09:24.347282 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-af164907-b5e4-48a7-9f0e-8826b3f187fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:09:24.353206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af164907-b5e4-48a7-9f0e-8826b3f187fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:24.353661 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af164907-b5e4-48a7-9f0e-8826b3f187fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:24.354430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af164907-b5e4-48a7-9f0e-8826b3f187fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:09:24.354872 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af164907-b5e4-48a7-9f0e-8826b3f187fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:09:32.906254 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:09:34.350432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:09:34.372720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:10:24.365141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc4c4083-0152-430a-8357-c8324aaf909e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [b1ffc7d7-0ead-4c66-babe-6bd07f51a5d4] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 22:10:24.402291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.objects.instance [None req-af164907-b5e4-48a7-9f0e-8826b3f187fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lazy-loading 'services' on Instance uuid b34275f2-dfb0-4cd8-bac0-3e182fcb2fca {{(pid=117979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:10:25.372719 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc4c4083-0152-430a-8357-c8324aaf909e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [b1ffc7d7-0ead-4c66-babe-6bd07f51a5d4] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 57792. Jul 21 22:10:25.376371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fc4c4083-0152-430a-8357-c8324aaf909e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1" status: 202 len: 0 microversion: 2.1 time: 121.094016 Jul 21 22:10:25.377104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 489/1108] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:08:24 2022] DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 => generated 0 bytes in 121095 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:10:25.382857 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a4d19fe0-18cf-474a-b95c-809e23c35deb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:10:25.383587 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a4d19fe0-18cf-474a-b95c-809e23c35deb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:10:25.390389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4d19fe0-18cf-474a-b95c-809e23c35deb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:10:25.390585 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4d19fe0-18cf-474a-b95c-809e23c35deb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:10:25.391410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4d19fe0-18cf-474a-b95c-809e23c35deb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:10:25.391854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4d19fe0-18cf-474a-b95c-809e23c35deb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:10:25.529065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a4d19fe0-18cf-474a-b95c-809e23c35deb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:10:25.537808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a4d19fe0-18cf-474a-b95c-809e23c35deb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:10:25.539433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a4d19fe0-18cf-474a-b95c-809e23c35deb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:10:25.540604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a4d19fe0-18cf-474a-b95c-809e23c35deb tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.162330 Jul 21 22:10:25.541164 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 490/1109] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:10:25 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:10:25.609208 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-629792c6-bb6f-45f0-8fc7-876a48b08baf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:10:25.610189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-629792c6-bb6f-45f0-8fc7-876a48b08baf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:10:25.616673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-629792c6-bb6f-45f0-8fc7-876a48b08baf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:10:25.617119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-629792c6-bb6f-45f0-8fc7-876a48b08baf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:10:25.617876 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-629792c6-bb6f-45f0-8fc7-876a48b08baf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:10:25.618315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-629792c6-bb6f-45f0-8fc7-876a48b08baf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:10:25.646492 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-629792c6-bb6f-45f0-8fc7-876a48b08baf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104362 Jul 21 22:10:25.647048 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 491/1110] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:10:25 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:10:25.651387 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c1ef1039-ed4f-4a67-93ed-15e06ae5828c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:10:25.651980 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c1ef1039-ed4f-4a67-93ed-15e06ae5828c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:10:25.657339 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c1ef1039-ed4f-4a67-93ed-15e06ae5828c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:10:25.657784 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c1ef1039-ed4f-4a67-93ed-15e06ae5828c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:10:25.658535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c1ef1039-ed4f-4a67-93ed-15e06ae5828c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:10:25.658969 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c1ef1039-ed4f-4a67-93ed-15e06ae5828c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:10:25.719343 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c1ef1039-ed4f-4a67-93ed-15e06ae5828c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:10:25.727310 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c1ef1039-ed4f-4a67-93ed-15e06ae5828c tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.079035 Jul 21 22:10:25.727870 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 492/1111] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:10:25 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:10:25.795951 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4ed8b06f-81c5-41dd-9088-83df85993f13 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:10:25.796949 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4ed8b06f-81c5-41dd-9088-83df85993f13 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:10:25.803561 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ed8b06f-81c5-41dd-9088-83df85993f13 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:10:25.804009 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ed8b06f-81c5-41dd-9088-83df85993f13 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:10:25.804774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ed8b06f-81c5-41dd-9088-83df85993f13 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:10:25.805209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ed8b06f-81c5-41dd-9088-83df85993f13 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:10:25.833401 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4ed8b06f-81c5-41dd-9088-83df85993f13 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104507 Jul 21 22:10:25.833941 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 493/1112] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:10:25 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:10:25.838073 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bcf4a2e0-7754-4238-953c-b0972c89d4e4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:10:25.838665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bcf4a2e0-7754-4238-953c-b0972c89d4e4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:10:25.844218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bcf4a2e0-7754-4238-953c-b0972c89d4e4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:10:25.844657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bcf4a2e0-7754-4238-953c-b0972c89d4e4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:10:25.845399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bcf4a2e0-7754-4238-953c-b0972c89d4e4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:10:25.845828 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bcf4a2e0-7754-4238-953c-b0972c89d4e4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:10:25.858276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-bcf4a2e0-7754-4238-953c-b0972c89d4e4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] HTTP exception thrown: Instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 could not be found. Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bcf4a2e0-7754-4238-953c-b0972c89d4e4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Request method failure captured: Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 HTTP/1.1 Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwVKH3x76CuLrQiil_QeqLJlRAYmSLUZHyhOwQk8sbRI-otzlDmTsC_Kctl2BV_e4qPytbOqhX6MbzWcOccb260GCFJXJWi9_H7Q1wUqQIfe0FZjyO5tA1W0EjbS6iilwzkwC6l8IrYXJGCWbBByR_yHau1s1AOt2UBKhdQaZNk9xo Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 3f8010f68f0c4fd4ac77cb9221777078 Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:10:25.859831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:10:25.861405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f8010f68f0c4fd4ac77cb9221777078", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:10:25.861405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:10:25.861405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 3f8010f68f0c4fd4ac77cb9221777078 Jul 21 22:10:25.861405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:10:25.861405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-ServerRescueNegativeTestJSON-900258742-project Jul 21 22:10:25.861405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:10:25.861405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:10:25.861405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 40f128f6095f425eb5b2f7bcce092e5a Jul 21 22:10:25.861405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-ServerRescueNegativeTestJSON-900258742-project Jul 21 22:10:25.861405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:10:25.861405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 could not be found. Jul 21 22:10:25.861405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': '6534b28d-a96e-4bda-bf05-14b2da7ea0f1'} Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 could not be found. Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:10:25.862356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 could not be found. Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 could not be found. Jul 21 22:10:25.864445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:10:25.865744 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bcf4a2e0-7754-4238-953c-b0972c89d4e4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Returning 404 to user: Instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:10:25.865744 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bcf4a2e0-7754-4238-953c-b0972c89d4e4 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 404 len: 111 microversion: 2.1 time: 0.026338 Jul 21 22:10:25.865744 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 494/1113] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:10:25 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:10:25.912389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-a09c36f5-603a-4c49-a628-f2932751c369 req-2cec8a0a-f5b1-4db0-a0ac-c9004c2620d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6534b28d-a96e-4bda-bf05-14b2da7ea0f1", "name": "network-vif-deleted", "tag": "1507a60f-758e-4f76-9b6e-6495171e3c21"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:10:25.920467 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a09c36f5-603a-4c49-a628-f2932751c369 req-2cec8a0a-f5b1-4db0-a0ac-c9004c2620d5 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:10:25.920906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a09c36f5-603a-4c49-a628-f2932751c369 req-2cec8a0a-f5b1-4db0-a0ac-c9004c2620d5 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:10:25.932218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-a09c36f5-603a-4c49-a628-f2932751c369 req-2cec8a0a-f5b1-4db0-a0ac-c9004c2620d5 service nova] Creating event network-vif-deleted:1507a60f-758e-4f76-9b6e-6495171e3c21 for instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 on hv-cinder-82002 Jul 21 22:10:25.936897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-a09c36f5-603a-4c49-a628-f2932751c369 req-2cec8a0a-f5b1-4db0-a0ac-c9004c2620d5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074256 Jul 21 22:10:25.937470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 495/1114] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:10:25.943183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a07e101a-2c46-4840-9ad7-af43f5696465 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:10:25.943762 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a07e101a-2c46-4840-9ad7-af43f5696465 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:10:25.949820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a07e101a-2c46-4840-9ad7-af43f5696465 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:10:25.950275 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a07e101a-2c46-4840-9ad7-af43f5696465 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:10:25.951140 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a07e101a-2c46-4840-9ad7-af43f5696465 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:10:25.951585 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a07e101a-2c46-4840-9ad7-af43f5696465 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:10:34.406813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=4 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:10:35.947480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=14 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:10:35.972121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:10:39.512360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:10:39.512963 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:10:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 (ip 10.222.0.44) !!! Jul 21 22:10:59.604472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:10:59.605085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:10:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 (ip 10.222.0.44) !!! Jul 21 22:11:23.057948 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-af164907-b5e4-48a7-9f0e-8826b3f187fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1f92ba77-221c-408d-9779-42c175f70e0d) Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-af164907-b5e4-48a7-9f0e-8826b3f187fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Request method failure captured: Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 HTTP/1.1 Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cyyfh6OzSmSUrwRLZFLhgVmQoNJMml0oGVNixMorPt-hqraIXlaFCC5vjcaPfVaj-j8I9s2cQJh0zf2x5-fAV8ErGn8mmrGWv6Tb61L0FTcyD1Hew1PiITKJ47grW-glQXBviZ-OHHOuCR9Qb0zlqqY6UdO0BleJxusUbSMyntphvE Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:11:23.060280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:11:23.061977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fd46d5bdfd044627bcd71cd16b99649b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:11:23.061977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:11:23.061977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:11:23.061977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:11:23.061977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:11:23.061977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:11:23.061977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:11:23.061977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 17d33bb455874228bcc76644b24272de Jul 21 22:11:23.061977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:11:23.061977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1f92ba77-221c-408d-9779-42c175f70e0d) Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'server_id': 'b34275f2-dfb0-4cd8-bac0-3e182fcb2fca', 'id': 'f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1'} Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:11:23.062824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1f92ba77-221c-408d-9779-42c175f70e0d) Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:11:23.064328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1f92ba77-221c-408d-9779-42c175f70e0d) Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:11:23.065600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1f92ba77-221c-408d-9779-42c175f70e0d) Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:11:23.066899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1f92ba77-221c-408d-9779-42c175f70e0d) Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1f92ba77-221c-408d-9779-42c175f70e0d) Jul 21 22:11:23.068298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.070934 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-af164907-b5e4-48a7-9f0e-8826b3f187fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1f92ba77-221c-408d-9779-42c175f70e0d) {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:11:23.070934 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-af164907-b5e4-48a7-9f0e-8826b3f187fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1" status: 400 len: 269 microversion: 2.1 time: 118.718788 Jul 21 22:11:23.070934 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 620/1115] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:09:24 2022] DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 => generated 269 bytes in 118720 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 22:11:23.070934 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-25252500-e2a8-4244-91b3-a1aacbb0f298 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:11:23.071288 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-25252500-e2a8-4244-91b3-a1aacbb0f298 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:11:23.075300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-25252500-e2a8-4244-91b3-a1aacbb0f298 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:23.075761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-25252500-e2a8-4244-91b3-a1aacbb0f298 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:23.076596 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-25252500-e2a8-4244-91b3-a1aacbb0f298 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:23.076992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-25252500-e2a8-4244-91b3-a1aacbb0f298 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:23.110904 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-a07e101a-2c46-4840-9ad7-af43f5696465 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lazy-loading 'services' on Instance uuid b34275f2-dfb0-4cd8-bac0-3e182fcb2fca {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:11:23.209984 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-25252500-e2a8-4244-91b3-a1aacbb0f298 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:11:23.218648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-25252500-e2a8-4244-91b3-a1aacbb0f298 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:11:23.220207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-25252500-e2a8-4244-91b3-a1aacbb0f298 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:11:23.221431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-25252500-e2a8-4244-91b3-a1aacbb0f298 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 200 len: 1744 microversion: 2.20 time: 0.158260 Jul 21 22:11:23.221984 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 621/1116] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:11:23 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:11:23.226937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a718838a-c2bd-4e6b-a270-1c333d2d1f03 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:11:23.227931 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a718838a-c2bd-4e6b-a270-1c333d2d1f03 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:11:23.233546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a718838a-c2bd-4e6b-a270-1c333d2d1f03 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:23.234005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a718838a-c2bd-4e6b-a270-1c333d2d1f03 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:23.234778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a718838a-c2bd-4e6b-a270-1c333d2d1f03 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:23.235250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a718838a-c2bd-4e6b-a270-1c333d2d1f03 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:23.264007 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a718838a-c2bd-4e6b-a270-1c333d2d1f03 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040484 Jul 21 22:11:23.264474 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 622/1117] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:11:23 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:11:23.268707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-af004bfa-0af6-4b3d-99b0-bde9889269e1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:11:23.269798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-af004bfa-0af6-4b3d-99b0-bde9889269e1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:11:23.275275 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af004bfa-0af6-4b3d-99b0-bde9889269e1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:23.275736 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af004bfa-0af6-4b3d-99b0-bde9889269e1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:23.276489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af004bfa-0af6-4b3d-99b0-bde9889269e1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:23.276928 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-af004bfa-0af6-4b3d-99b0-bde9889269e1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:23.336640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-af004bfa-0af6-4b3d-99b0-bde9889269e1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:11:23.344384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-af004bfa-0af6-4b3d-99b0-bde9889269e1 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.078989 Jul 21 22:11:23.344945 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 623/1118] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:11:23 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:11:23.350047 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f95ef2bf-aa48-4cf8-ac58-ba92ab64f102 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:11:23.351025 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f95ef2bf-aa48-4cf8-ac58-ba92ab64f102 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:11:23.358458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f95ef2bf-aa48-4cf8-ac58-ba92ab64f102 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:23.359299 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f95ef2bf-aa48-4cf8-ac58-ba92ab64f102 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:23.360658 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f95ef2bf-aa48-4cf8-ac58-ba92ab64f102 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:23.361432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f95ef2bf-aa48-4cf8-ac58-ba92ab64f102 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:23.395612 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f95ef2bf-aa48-4cf8-ac58-ba92ab64f102 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049133 Jul 21 22:11:23.396303 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 624/1119] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:11:23 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:11:23.401190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-accf6255-e0ba-430e-9acb-898e3eea9b02 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:11:23.401797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-accf6255-e0ba-430e-9acb-898e3eea9b02 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 6534b28d-a96e-4bda-bf05-14b2da7ea0f1] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:11:23.408915 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-accf6255-e0ba-430e-9acb-898e3eea9b02 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:23.409362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-accf6255-e0ba-430e-9acb-898e3eea9b02 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:23.410742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-accf6255-e0ba-430e-9acb-898e3eea9b02 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:23.411203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-accf6255-e0ba-430e-9acb-898e3eea9b02 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:23.424606 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-accf6255-e0ba-430e-9acb-898e3eea9b02 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] HTTP exception thrown: Instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 could not be found. Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-accf6255-e0ba-430e-9acb-898e3eea9b02 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Request method failure captured: Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 HTTP/1.1 Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwVKH3x76CuLrQiil_QeqLJlRAYmSLUZHyhOwQk8sbRI-otzlDmTsC_Kctl2BV_e4qPytbOqhX6MbzWcOccb260GCFJXJWi9_H7Q1wUqQIfe0FZjyO5tA1W0EjbS6iilwzkwC6l8IrYXJGCWbBByR_yHau1s1AOt2UBKhdQaZNk9xo Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 3f8010f68f0c4fd4ac77cb9221777078 Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:11:23.426164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:11:23.427800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f8010f68f0c4fd4ac77cb9221777078", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:11:23.427800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:11:23.427800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 3f8010f68f0c4fd4ac77cb9221777078 Jul 21 22:11:23.427800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:11:23.427800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-ServerRescueNegativeTestJSON-900258742-project Jul 21 22:11:23.427800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:11:23.427800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:11:23.427800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 40f128f6095f425eb5b2f7bcce092e5a Jul 21 22:11:23.427800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-ServerRescueNegativeTestJSON-900258742-project Jul 21 22:11:23.427800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:11:23.427800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 could not be found. Jul 21 22:11:23.427800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '6534b28d-a96e-4bda-bf05-14b2da7ea0f1'} Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 could not be found. Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:11:23.431772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 could not be found. Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 could not be found. Jul 21 22:11:23.432981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:11:23.434079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-accf6255-e0ba-430e-9acb-898e3eea9b02 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Returning 404 to user: Instance 6534b28d-a96e-4bda-bf05-14b2da7ea0f1 could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:11:23.434079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-accf6255-e0ba-430e-9acb-898e3eea9b02 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1" status: 404 len: 111 microversion: 2.1 time: 0.030363 Jul 21 22:11:23.434079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 625/1120] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:11:23 2022] GET /compute/v2.1/servers/6534b28d-a96e-4bda-bf05-14b2da7ea0f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:11:23.435823 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cd4c9f73-d3f6-45bf-82b1-373acecc47cd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '.version_select at 0x7faca3149ee0>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:11:23.458816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cd4c9f73-d3f6-45bf-82b1-373acecc47cd tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-504316105" status: 202 len: 0 microversion: 2.1 time: 0.026382 Jul 21 22:11:23.459448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 626/1121] 10.222.0.44 () {58 vars in 1217 bytes} [Thu Jul 21 22:11:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-504316105 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:11:23.981031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2f725269-2617-48b7-955e-f6cb68a9c908 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:11:23.981516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2f725269-2617-48b7-955e-f6cb68a9c908 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:11:23.990399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2f725269-2617-48b7-955e-f6cb68a9c908 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:23.990857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2f725269-2617-48b7-955e-f6cb68a9c908 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:23.991667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2f725269-2617-48b7-955e-f6cb68a9c908 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:23.992106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2f725269-2617-48b7-955e-f6cb68a9c908 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:24.016581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2f725269-2617-48b7-955e-f6cb68a9c908 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Going to try to terminate instance {{(pid=117979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:11:24.066690 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.compute.api [None req-2f725269-2617-48b7-955e-f6cb68a9c908 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Instance is already in deleting state, ignoring this request Jul 21 22:11:24.067490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2f725269-2617-48b7-955e-f6cb68a9c908 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 204 len: 0 microversion: 2.1 time: 0.090447 Jul 21 22:11:24.068073 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 627/1122] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:11:23 2022] DELETE /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:11:24.075867 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2225f46e-25e7-4561-a1ca-4773b168220a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:11:24.076465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2225f46e-25e7-4561-a1ca-4773b168220a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:11:24.082301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2225f46e-25e7-4561-a1ca-4773b168220a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:24.082744 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2225f46e-25e7-4561-a1ca-4773b168220a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:24.083542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2225f46e-25e7-4561-a1ca-4773b168220a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:24.083976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2225f46e-25e7-4561-a1ca-4773b168220a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:24.152331 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2225f46e-25e7-4561-a1ca-4773b168220a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:11:24.160876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2225f46e-25e7-4561-a1ca-4773b168220a tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.088677 Jul 21 22:11:24.161457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 628/1123] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:11:24 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:11:24.274355 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2af32677-3d9e-468c-9589-3ae8a169c5f6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:11:24.275317 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2af32677-3d9e-468c-9589-3ae8a169c5f6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:11:24.281406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2af32677-3d9e-468c-9589-3ae8a169c5f6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:24.281857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2af32677-3d9e-468c-9589-3ae8a169c5f6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:24.282625 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2af32677-3d9e-468c-9589-3ae8a169c5f6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:24.283088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2af32677-3d9e-468c-9589-3ae8a169c5f6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:24.312730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2af32677-3d9e-468c-9589-3ae8a169c5f6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042352 Jul 21 22:11:24.313279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 629/1124] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:11:24 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:11:24.407113 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-577814e2-28a8-4e9f-a744-974dff860598 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:11:24.408179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-577814e2-28a8-4e9f-a744-974dff860598 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:11:24.414759 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-577814e2-28a8-4e9f-a744-974dff860598 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:24.415253 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-577814e2-28a8-4e9f-a744-974dff860598 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:24.416043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-577814e2-28a8-4e9f-a744-974dff860598 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:24.416472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-577814e2-28a8-4e9f-a744-974dff860598 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:24.445592 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-577814e2-28a8-4e9f-a744-974dff860598 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042372 Jul 21 22:11:24.446149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 630/1125] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:11:24 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:11:24.528908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d6785889-d52d-4b23-b5de-bc5d98841484 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:11:24.529411 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d6785889-d52d-4b23-b5de-bc5d98841484 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:11:24.536050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d6785889-d52d-4b23-b5de-bc5d98841484 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:24.536506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d6785889-d52d-4b23-b5de-bc5d98841484 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:24.537277 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d6785889-d52d-4b23-b5de-bc5d98841484 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:11:24.537715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d6785889-d52d-4b23-b5de-bc5d98841484 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:11:33.115579 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:11:34.532901 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:11:34.556511 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:12:09.212281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:12:09.213091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:12:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 (ip 10.222.0.44) !!! Jul 21 22:12:24.558419 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-a07e101a-2c46-4840-9ad7-af43f5696465 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddaf3f4a-68a1-4622-9085-4eccf221911a) Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a07e101a-2c46-4840-9ad7-af43f5696465 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Request method failure captured: Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 HTTP/1.1 Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cyyfh6OzSmSUrwRLZFLhgVmQoNJMml0oGVNixMorPt-hqraIXlaFCC5vjcaPfVaj-j8I9s2cQJh0zf2x5-fAV8ErGn8mmrGWv6Tb61L0FTcyD1Hew1PiITKJ47grW-glQXBviZ-OHHOuCR9Qb0zlqqY6UdO0BleJxusUbSMyntphvE Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:12:24.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:12:24.562274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fd46d5bdfd044627bcd71cd16b99649b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:12:24.562274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:12:24.562274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:12:24.562274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:12:24.562274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:12:24.562274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:12:24.562274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:12:24.562274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 17d33bb455874228bcc76644b24272de Jul 21 22:12:24.562274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:12:24.562274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddaf3f4a-68a1-4622-9085-4eccf221911a) Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'server_id': 'b34275f2-dfb0-4cd8-bac0-3e182fcb2fca', 'id': 'f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1'} Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:12:24.563119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddaf3f4a-68a1-4622-9085-4eccf221911a) Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:12:24.564226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddaf3f4a-68a1-4622-9085-4eccf221911a) Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:12:24.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddaf3f4a-68a1-4622-9085-4eccf221911a) Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:12:24.566344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddaf3f4a-68a1-4622-9085-4eccf221911a) Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddaf3f4a-68a1-4622-9085-4eccf221911a) Jul 21 22:12:24.567465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:12:24.568529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a07e101a-2c46-4840-9ad7-af43f5696465 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-ddaf3f4a-68a1-4622-9085-4eccf221911a) {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:12:24.568529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a07e101a-2c46-4840-9ad7-af43f5696465 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1" status: 400 len: 269 microversion: 2.1 time: 118.623612 Jul 21 22:12:24.568529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 496/1126] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:10:25 2022] DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 => generated 269 bytes in 118625 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:12:24.569751 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-093a0b70-05a1-4453-951f-8ba52865e2ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:12:24.570360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-093a0b70-05a1-4453-951f-8ba52865e2ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:12:24.577100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-093a0b70-05a1-4453-951f-8ba52865e2ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:12:24.577555 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-093a0b70-05a1-4453-951f-8ba52865e2ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:12:24.578323 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-093a0b70-05a1-4453-951f-8ba52865e2ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:12:24.578761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-093a0b70-05a1-4453-951f-8ba52865e2ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:12:24.644562 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-093a0b70-05a1-4453-951f-8ba52865e2ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:12:24.652836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-093a0b70-05a1-4453-951f-8ba52865e2ef tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1226 microversion: 2.1 time: 0.088846 Jul 21 22:12:24.653397 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 497/1127] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:12:24 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:12:24.660053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1cc43cee-b09d-4db6-9b2b-fa38c78eb678 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:12:24.661031 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1cc43cee-b09d-4db6-9b2b-fa38c78eb678 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:12:24.667688 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1cc43cee-b09d-4db6-9b2b-fa38c78eb678 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:12:24.668156 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1cc43cee-b09d-4db6-9b2b-fa38c78eb678 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:12:24.668931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1cc43cee-b09d-4db6-9b2b-fa38c78eb678 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:12:24.669391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1cc43cee-b09d-4db6-9b2b-fa38c78eb678 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:12:24.700799 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1cc43cee-b09d-4db6-9b2b-fa38c78eb678 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046267 Jul 21 22:12:24.701236 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 498/1128] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:12:24 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:12:24.701552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.objects.instance [None req-d6785889-d52d-4b23-b5de-bc5d98841484 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lazy-loading 'services' on Instance uuid b34275f2-dfb0-4cd8-bac0-3e182fcb2fca {{(pid=117979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:12:24.705688 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e3c6f93a-9044-4017-9ae8-1a69c8d986ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:12:24.706601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e3c6f93a-9044-4017-9ae8-1a69c8d986ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:12:24.712898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3c6f93a-9044-4017-9ae8-1a69c8d986ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:12:24.713349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3c6f93a-9044-4017-9ae8-1a69c8d986ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:12:24.714122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3c6f93a-9044-4017-9ae8-1a69c8d986ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:12:24.714555 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3c6f93a-9044-4017-9ae8-1a69c8d986ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:12:24.745369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e3c6f93a-9044-4017-9ae8-1a69c8d986ba tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043037 Jul 21 22:12:24.745927 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 499/1129] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:12:24 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:12:24.750659 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-95e03684-a767-4016-aebc-447973ad5c06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:12:24.751171 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-95e03684-a767-4016-aebc-447973ad5c06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:12:24.758635 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95e03684-a767-4016-aebc-447973ad5c06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:12:24.758927 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95e03684-a767-4016-aebc-447973ad5c06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:12:24.759750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95e03684-a767-4016-aebc-447973ad5c06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:12:24.760187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95e03684-a767-4016-aebc-447973ad5c06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:12:34.706964 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=4 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:12:34.754563 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=8 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:12:34.779554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=22 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:12:38.535934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:12:38.536961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:12:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 (ip 10.222.0.44) !!! Jul 21 22:13:23.171378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-d6785889-d52d-4b23-b5de-bc5d98841484 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b70a54b-2571-4524-8c05-805d2bea2fbd) Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d6785889-d52d-4b23-b5de-bc5d98841484 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Request method failure captured: Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 HTTP/1.1 Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cyyfh6OzSmSUrwRLZFLhgVmQoNJMml0oGVNixMorPt-hqraIXlaFCC5vjcaPfVaj-j8I9s2cQJh0zf2x5-fAV8ErGn8mmrGWv6Tb61L0FTcyD1Hew1PiITKJ47grW-glQXBviZ-OHHOuCR9Qb0zlqqY6UdO0BleJxusUbSMyntphvE Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:13:23.173505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:13:23.175156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fd46d5bdfd044627bcd71cd16b99649b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:13:23.175156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:13:23.175156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:13:23.175156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:13:23.175156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:13:23.175156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:13:23.175156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:13:23.175156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 17d33bb455874228bcc76644b24272de Jul 21 22:13:23.175156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:13:23.175156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b70a54b-2571-4524-8c05-805d2bea2fbd) Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'server_id': 'b34275f2-dfb0-4cd8-bac0-3e182fcb2fca', 'id': 'f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1'} Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:13:23.176136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b70a54b-2571-4524-8c05-805d2bea2fbd) Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:13:23.178369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b70a54b-2571-4524-8c05-805d2bea2fbd) Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:13:23.179796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b70a54b-2571-4524-8c05-805d2bea2fbd) Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:13:23.181077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b70a54b-2571-4524-8c05-805d2bea2fbd) Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b70a54b-2571-4524-8c05-805d2bea2fbd) Jul 21 22:13:23.182430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:13:23.184070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d6785889-d52d-4b23-b5de-bc5d98841484 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8b70a54b-2571-4524-8c05-805d2bea2fbd) {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:13:23.184070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d6785889-d52d-4b23-b5de-bc5d98841484 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1" status: 400 len: 269 microversion: 2.1 time: 118.713344 Jul 21 22:13:23.184070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 631/1130] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:11:24 2022] DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 => generated 269 bytes in 118714 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 21 22:13:23.184070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-42c91048-5c3f-47cd-86c3-effcd1b75905 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:13:23.184434 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-42c91048-5c3f-47cd-86c3-effcd1b75905 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:13:23.190045 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-42c91048-5c3f-47cd-86c3-effcd1b75905 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:13:23.190495 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-42c91048-5c3f-47cd-86c3-effcd1b75905 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:13:23.191284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-42c91048-5c3f-47cd-86c3-effcd1b75905 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:13:23.191717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-42c91048-5c3f-47cd-86c3-effcd1b75905 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:13:23.256674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-95e03684-a767-4016-aebc-447973ad5c06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lazy-loading 'services' on Instance uuid b34275f2-dfb0-4cd8-bac0-3e182fcb2fca {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:13:33.188102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:13:33.209549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=4 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:13:33.260691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:13:59.521067 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:13:59.521661 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:13:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 (ip 10.222.0.44) !!! Jul 21 22:14:19.612616 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:14:19.613734 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:14:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-volume_attachments/62429cd7-9017-4dc8-a93b-18e307b00f22 (ip 10.222.0.44) !!! Jul 21 22:14:25.217568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-95e03684-a767-4016-aebc-447973ad5c06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60f10204-59d9-48b8-a112-aafc38d40291) Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-95e03684-a767-4016-aebc-447973ad5c06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Request method failure captured: Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 HTTP/1.1 Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cyyfh6OzSmSUrwRLZFLhgVmQoNJMml0oGVNixMorPt-hqraIXlaFCC5vjcaPfVaj-j8I9s2cQJh0zf2x5-fAV8ErGn8mmrGWv6Tb61L0FTcyD1Hew1PiITKJ47grW-glQXBviZ-OHHOuCR9Qb0zlqqY6UdO0BleJxusUbSMyntphvE Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:14:25.220043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:14:25.221424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fd46d5bdfd044627bcd71cd16b99649b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:14:25.221424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:14:25.221424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:14:25.221424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:14:25.221424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:14:25.221424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:14:25.221424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:14:25.221424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 17d33bb455874228bcc76644b24272de Jul 21 22:14:25.221424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:14:25.221424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60f10204-59d9-48b8-a112-aafc38d40291) Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'server_id': 'b34275f2-dfb0-4cd8-bac0-3e182fcb2fca', 'id': 'f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1'} Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:14:25.222053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60f10204-59d9-48b8-a112-aafc38d40291) Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:14:25.223699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60f10204-59d9-48b8-a112-aafc38d40291) Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.224925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60f10204-59d9-48b8-a112-aafc38d40291) Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:25.225908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60f10204-59d9-48b8-a112-aafc38d40291) Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60f10204-59d9-48b8-a112-aafc38d40291) Jul 21 22:14:25.227432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.228696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-95e03684-a767-4016-aebc-447973ad5c06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-60f10204-59d9-48b8-a112-aafc38d40291) {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:14:25.228696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-95e03684-a767-4016-aebc-447973ad5c06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1" status: 400 len: 269 microversion: 2.1 time: 120.474422 Jul 21 22:14:25.228696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 500/1131] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:12:24 2022] DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 => generated 269 bytes in 120476 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:14:25.228696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0db66c5d-1b15-4899-a0d9-0aed42b08295 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:25.229062 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0db66c5d-1b15-4899-a0d9-0aed42b08295 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:25.235583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0db66c5d-1b15-4899-a0d9-0aed42b08295 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.236039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0db66c5d-1b15-4899-a0d9-0aed42b08295 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.236809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0db66c5d-1b15-4899-a0d9-0aed42b08295 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.237248 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0db66c5d-1b15-4899-a0d9-0aed42b08295 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.269158 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0db66c5d-1b15-4899-a0d9-0aed42b08295 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.269613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0db66c5d-1b15-4899-a0d9-0aed42b08295 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.270187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-0db66c5d-1b15-4899-a0d9-0aed42b08295 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lazy-loading 'fault' on Instance uuid bc368e51-a804-44e7-8341-b5a36c3173a5 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:14:25.318461 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0db66c5d-1b15-4899-a0d9-0aed42b08295 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd019ca1630544a14b0170e2c873012a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70b0dd669508462c8302c8107bb0f5f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:25.327866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0db66c5d-1b15-4899-a0d9-0aed42b08295 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 200 len: 1185 microversion: 2.1 time: 0.103713 Jul 21 22:14:25.329237 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 501/1132] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:14:25 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 1185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:14:25.337255 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f0327817-7e13-4ca0-a943-7a8907e32c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:25.338375 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f0327817-7e13-4ca0-a943-7a8907e32c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:25.345440 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0327817-7e13-4ca0-a943-7a8907e32c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.345892 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0327817-7e13-4ca0-a943-7a8907e32c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.346791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0327817-7e13-4ca0-a943-7a8907e32c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.347853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0327817-7e13-4ca0-a943-7a8907e32c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.382082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f0327817-7e13-4ca0-a943-7a8907e32c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050620 Jul 21 22:14:25.382648 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 502/1133] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:14:25 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:14:25.387877 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b4a325d2-0d1e-41f1-ae22-c7381327369b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:25.388971 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b4a325d2-0d1e-41f1-ae22-c7381327369b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:25.395263 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b4a325d2-0d1e-41f1-ae22-c7381327369b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.396610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b4a325d2-0d1e-41f1-ae22-c7381327369b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.397933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b4a325d2-0d1e-41f1-ae22-c7381327369b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.398714 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b4a325d2-0d1e-41f1-ae22-c7381327369b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.429973 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b4a325d2-0d1e-41f1-ae22-c7381327369b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045985 Jul 21 22:14:25.430705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 503/1134] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:14:25 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:14:25.435276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-095f5d1a-010e-4376-9f50-b41b8cc4cf3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:25.435831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-095f5d1a-010e-4376-9f50-b41b8cc4cf3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:25.441850 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-095f5d1a-010e-4376-9f50-b41b8cc4cf3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.442303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-095f5d1a-010e-4376-9f50-b41b8cc4cf3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.443100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-095f5d1a-010e-4376-9f50-b41b8cc4cf3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.443539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-095f5d1a-010e-4376-9f50-b41b8cc4cf3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.577741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-42c91048-5c3f-47cd-86c3-effcd1b75905 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "DELETE /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-volume_attachments/62429cd7-9017-4dc8-a93b-18e307b00f22" status: 202 len: 0 microversion: 2.20 time: 62.400851 Jul 21 22:14:25.578765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 632/1135] 10.222.0.44 () {60 vars in 1456 bytes} [Thu Jul 21 22:13:23 2022] DELETE /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-volume_attachments/62429cd7-9017-4dc8-a93b-18e307b00f22 => generated 0 bytes in 62403 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:14:25.584729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-90cfa880-78b0-4119-8a20-4302b30e9d81 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:25.585236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-90cfa880-78b0-4119-8a20-4302b30e9d81 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:25.590910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-90cfa880-78b0-4119-8a20-4302b30e9d81 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.591396 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-90cfa880-78b0-4119-8a20-4302b30e9d81 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.592143 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-90cfa880-78b0-4119-8a20-4302b30e9d81 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.592570 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-90cfa880-78b0-4119-8a20-4302b30e9d81 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.606644 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-095f5d1a-010e-4376-9f50-b41b8cc4cf3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lazy-loading 'services' on Instance uuid b34275f2-dfb0-4cd8-bac0-3e182fcb2fca {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:14:25.671123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-90cfa880-78b0-4119-8a20-4302b30e9d81 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] HTTP exception thrown: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 is not attached to volume 62429cd7-9017-4dc8-a93b-18e307b00f22 Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-90cfa880-78b0-4119-8a20-4302b30e9d81 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Request method failure captured: Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: DELETE /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-volume_attachments/62429cd7-9017-4dc8-a93b-18e307b00f22 HTTP/1.1 Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwhZgP2lKPueRsocGvaeMq7ROSs_8wgYETfg7lnpeTphjU1mZBhgSWUCnPew9ATJxnZrdwROuYzDAxEYKfUoMY0z8OoM9keregwq9KJtQz6YeDH9JwkorofRQ47251yiOVRYTWxjeL63B-O49ANd9ZAyv-_JpV7cnuTmGDLsrRp3uM Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:14:25.673369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:14:25.674866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36a85f96959d48c5810ea0d38f65f22c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:14:25.674866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:14:25.674866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:14:25.674866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:14:25.674866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:14:25.674866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:14:25.674866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:14:25.674866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 1c86ce2899b6485da1517e3b5a1c64de Jul 21 22:14:25.674866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:14:25.674866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:14:25.674866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 is not attached to volume 62429cd7-9017-4dc8-a93b-18e307b00f22 Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'server_id': '84e2efbe-11d4-4ecc-8825-11f420d36f03', 'id': '62429cd7-9017-4dc8-a93b-18e307b00f22'} Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 62429cd7-9017-4dc8-a93b-18e307b00f22. Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:14:25.675827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 is not attached to volume 62429cd7-9017-4dc8-a93b-18e307b00f22 Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 is not attached to volume 62429cd7-9017-4dc8-a93b-18e307b00f22 Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.677615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-90cfa880-78b0-4119-8a20-4302b30e9d81 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Returning 404 to user: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 is not attached to volume 62429cd7-9017-4dc8-a93b-18e307b00f22 {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:14:25.678545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-90cfa880-78b0-4119-8a20-4302b30e9d81 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "DELETE /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-volume_attachments/62429cd7-9017-4dc8-a93b-18e307b00f22" status: 404 len: 154 microversion: 2.20 time: 0.095152 Jul 21 22:14:25.678545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 633/1136] 10.222.0.44 () {60 vars in 1456 bytes} [Thu Jul 21 22:14:25 2022] DELETE /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-volume_attachments/62429cd7-9017-4dc8-a93b-18e307b00f22 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:14:25.679977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-023af7f5-de56-42f9-a1c9-ef2ef3555a71 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:25.680576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-023af7f5-de56-42f9-a1c9-ef2ef3555a71 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [instance: bc368e51-a804-44e7-8341-b5a36c3173a5] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:25.686322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-023af7f5-de56-42f9-a1c9-ef2ef3555a71 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.686764 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-023af7f5-de56-42f9-a1c9-ef2ef3555a71 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.687569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-023af7f5-de56-42f9-a1c9-ef2ef3555a71 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.687998 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-023af7f5-de56-42f9-a1c9-ef2ef3555a71 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.699108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-095f5d1a-010e-4376-9f50-b41b8cc4cf3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4a6bc6e-6f50-48de-8d35-063b19fe2e66) Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-095f5d1a-010e-4376-9f50-b41b8cc4cf3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Request method failure captured: Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 HTTP/1.1 Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cyyfh6OzSmSUrwRLZFLhgVmQoNJMml0oGVNixMorPt-hqraIXlaFCC5vjcaPfVaj-j8I9s2cQJh0zf2x5-fAV8ErGn8mmrGWv6Tb61L0FTcyD1Hew1PiITKJ47grW-glQXBviZ-OHHOuCR9Qb0zlqqY6UdO0BleJxusUbSMyntphvE Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:14:25.701384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:14:25.702933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fd46d5bdfd044627bcd71cd16b99649b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:14:25.702933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:14:25.702933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:14:25.702933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:14:25.702933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:14:25.702933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:14:25.702933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:14:25.702933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 17d33bb455874228bcc76644b24272de Jul 21 22:14:25.702933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:14:25.702933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4a6bc6e-6f50-48de-8d35-063b19fe2e66) Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'server_id': 'b34275f2-dfb0-4cd8-bac0-3e182fcb2fca', 'id': 'f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1'} Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:14:25.703750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4a6bc6e-6f50-48de-8d35-063b19fe2e66) Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:14:25.705059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4a6bc6e-6f50-48de-8d35-063b19fe2e66) Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.707657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4a6bc6e-6f50-48de-8d35-063b19fe2e66) Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:25.709369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4a6bc6e-6f50-48de-8d35-063b19fe2e66) Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4a6bc6e-6f50-48de-8d35-063b19fe2e66) Jul 21 22:14:25.712262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.716055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-023af7f5-de56-42f9-a1c9-ef2ef3555a71 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] HTTP exception thrown: Instance bc368e51-a804-44e7-8341-b5a36c3173a5 could not be found. Jul 21 22:14:25.716499 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-095f5d1a-010e-4376-9f50-b41b8cc4cf3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a4a6bc6e-6f50-48de-8d35-063b19fe2e66) {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-023af7f5-de56-42f9-a1c9-ef2ef3555a71 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Request method failure captured: Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 HTTP/1.1 Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cxt-JnbP05baBR29-ip2TnZxDzf94MueSS_-VLTcJgoSB3ItpmTwMsW1-P6e2Eb6gULQSoZMQaDwHFBs4Fiz-dMZ_OWUqWuGxDjWfhtZp3ag8jLCs7_xuMOtsCNc0nm7UUmtHG-jyW9cDAQn2IxLQzGQmW0lHb_U3FZ_GPoLs3qCOc Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 70b0dd669508462c8302c8107bb0f5f0 Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-TestVolumeBootPattern-1880088924 Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:14:25.716672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:14:25.720033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/70b0dd669508462c8302c8107bb0f5f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/70b0dd669508462c8302c8107bb0f5f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/70b0dd669508462c8302c8107bb0f5f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_70b0dd669508462c8302c8107bb0f5f0", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:14:25.720033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-TestVolumeBootPattern-1880088924 Jul 21 22:14:25.720033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 70b0dd669508462c8302c8107bb0f5f0 Jul 21 22:14:25.720033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-TestVolumeBootPattern-1880088924 Jul 21 22:14:25.720033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-TestVolumeBootPattern-1880088924-project Jul 21 22:14:25.720033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:14:25.720033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:14:25.720033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: d019ca1630544a14b0170e2c873012a3 Jul 21 22:14:25.720033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-TestVolumeBootPattern-1880088924-project Jul 21 22:14:25.720033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:14:25.720033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance bc368e51-a804-44e7-8341-b5a36c3173a5 could not be found. Jul 21 22:14:25.720033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': 'bc368e51-a804-44e7-8341-b5a36c3173a5'} Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc368e51-a804-44e7-8341-b5a36c3173a5 could not be found. Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:14:25.721958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc368e51-a804-44e7-8341-b5a36c3173a5 could not be found. Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc368e51-a804-44e7-8341-b5a36c3173a5 could not be found. Jul 21 22:14:25.725177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.727827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-023af7f5-de56-42f9-a1c9-ef2ef3555a71 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Returning 404 to user: Instance bc368e51-a804-44e7-8341-b5a36c3173a5 could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:14:25.727827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-023af7f5-de56-42f9-a1c9-ef2ef3555a71 tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5" status: 404 len: 111 microversion: 2.1 time: 0.028193 Jul 21 22:14:25.728124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-095f5d1a-010e-4376-9f50-b41b8cc4cf3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1" status: 400 len: 269 microversion: 2.1 time: 0.272731 Jul 21 22:14:25.729491 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 634/1137] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:14:25 2022] GET /compute/v2.1/servers/bc368e51-a804-44e7-8341-b5a36c3173a5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:14:25.729687 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 504/1138] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:14:25 2022] DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 => generated 269 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:14:25.729902 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7e49fbfd-c1f8-4565-b292-096acdd0c73c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:25.729902 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7e49fbfd-c1f8-4565-b292-096acdd0c73c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:25.730445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-aa76aea7-0abc-4eb4-b88c-d1528b59b304 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:25.730445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-aa76aea7-0abc-4eb4-b88c-d1528b59b304 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:25.730992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7e49fbfd-c1f8-4565-b292-096acdd0c73c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.730992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7e49fbfd-c1f8-4565-b292-096acdd0c73c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.730992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7e49fbfd-c1f8-4565-b292-096acdd0c73c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.730992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7e49fbfd-c1f8-4565-b292-096acdd0c73c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.731694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aa76aea7-0abc-4eb4-b88c-d1528b59b304 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.731694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aa76aea7-0abc-4eb4-b88c-d1528b59b304 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.731694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aa76aea7-0abc-4eb4-b88c-d1528b59b304 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.731694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aa76aea7-0abc-4eb4-b88c-d1528b59b304 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.749468 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7e49fbfd-c1f8-4565-b292-096acdd0c73c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042951 Jul 21 22:14:25.751551 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 635/1139] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:14:25 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:14:25.756358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-aa76aea7-0abc-4eb4-b88c-d1528b59b304 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048419 Jul 21 22:14:25.756358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 505/1140] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:14:25 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:14:25.758476 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5aff04b2-8ceb-4044-9a20-385dcb94a13f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:25.759056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5aff04b2-8ceb-4044-9a20-385dcb94a13f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:25.763014 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-550b4822-651e-4244-b904-15151e385c83 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:25.763240 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-550b4822-651e-4244-b904-15151e385c83 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:25.765059 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5aff04b2-8ceb-4044-9a20-385dcb94a13f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.765503 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5aff04b2-8ceb-4044-9a20-385dcb94a13f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.766271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5aff04b2-8ceb-4044-9a20-385dcb94a13f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.766700 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5aff04b2-8ceb-4044-9a20-385dcb94a13f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.770241 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-550b4822-651e-4244-b904-15151e385c83 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.770241 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-550b4822-651e-4244-b904-15151e385c83 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.772278 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-550b4822-651e-4244-b904-15151e385c83 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.772278 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-550b4822-651e-4244-b904-15151e385c83 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.857721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.objects.instance [None req-5aff04b2-8ceb-4044-9a20-385dcb94a13f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lazy-loading 'services' on Instance uuid b34275f2-dfb0-4cd8-bac0-3e182fcb2fca {{(pid=117979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:14:25.895207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-550b4822-651e-4244-b904-15151e385c83 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] HTTP exception thrown: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 is not attached to volume 62429cd7-9017-4dc8-a93b-18e307b00f22 Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-550b4822-651e-4244-b904-15151e385c83 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Request method failure captured: Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-volume_attachments/62429cd7-9017-4dc8-a93b-18e307b00f22 HTTP/1.1 Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwhZgP2lKPueRsocGvaeMq7ROSs_8wgYETfg7lnpeTphjU1mZBhgSWUCnPew9ATJxnZrdwROuYzDAxEYKfUoMY0z8OoM9keregwq9KJtQz6YeDH9JwkorofRQ47251yiOVRYTWxjeL63B-O49ANd9ZAyv-_JpV7cnuTmGDLsrRp3uM Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:14:25.897601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:14:25.899251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36a85f96959d48c5810ea0d38f65f22c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:14:25.899251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:14:25.899251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:14:25.899251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:14:25.899251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:14:25.899251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:14:25.899251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:14:25.899251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 1c86ce2899b6485da1517e3b5a1c64de Jul 21 22:14:25.899251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:14:25.899251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:14:25.899251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 is not attached to volume 62429cd7-9017-4dc8-a93b-18e307b00f22 Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'server_id': '84e2efbe-11d4-4ecc-8825-11f420d36f03', 'id': '62429cd7-9017-4dc8-a93b-18e307b00f22'} Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 62429cd7-9017-4dc8-a93b-18e307b00f22. Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:14:25.900072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 is not attached to volume 62429cd7-9017-4dc8-a93b-18e307b00f22 Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 is not attached to volume 62429cd7-9017-4dc8-a93b-18e307b00f22 Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.901423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-550b4822-651e-4244-b904-15151e385c83 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Returning 404 to user: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 is not attached to volume 62429cd7-9017-4dc8-a93b-18e307b00f22 {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:14:25.902519 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-550b4822-651e-4244-b904-15151e385c83 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "DELETE /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-volume_attachments/62429cd7-9017-4dc8-a93b-18e307b00f22" status: 404 len: 154 microversion: 2.20 time: 0.142182 Jul 21 22:14:25.902895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 506/1141] 10.222.0.44 () {60 vars in 1456 bytes} [Thu Jul 21 22:14:25 2022] DELETE /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-volume_attachments/62429cd7-9017-4dc8-a93b-18e307b00f22 => generated 154 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:14:25.907501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-aebf228c-ba0a-45f2-b22e-c02655fdc4c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:25.908418 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-aebf228c-ba0a-45f2-b22e-c02655fdc4c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:25.914336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aebf228c-ba0a-45f2-b22e-c02655fdc4c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.914788 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aebf228c-ba0a-45f2-b22e-c02655fdc4c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.915598 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aebf228c-ba0a-45f2-b22e-c02655fdc4c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:25.916039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aebf228c-ba0a-45f2-b22e-c02655fdc4c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:25.923753 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-5aff04b2-8ceb-4044-9a20-385dcb94a13f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-832a0ac0-7329-44af-8d04-c7bebb82ac0d) Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5aff04b2-8ceb-4044-9a20-385dcb94a13f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Request method failure captured: Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 HTTP/1.1 Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cyyfh6OzSmSUrwRLZFLhgVmQoNJMml0oGVNixMorPt-hqraIXlaFCC5vjcaPfVaj-j8I9s2cQJh0zf2x5-fAV8ErGn8mmrGWv6Tb61L0FTcyD1Hew1PiITKJ47grW-glQXBviZ-OHHOuCR9Qb0zlqqY6UdO0BleJxusUbSMyntphvE Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:14:25.926017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:14:25.927447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fd46d5bdfd044627bcd71cd16b99649b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:14:25.927447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:14:25.927447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:14:25.927447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:14:25.927447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:14:25.927447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:14:25.927447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:14:25.927447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 17d33bb455874228bcc76644b24272de Jul 21 22:14:25.927447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:14:25.927447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-832a0ac0-7329-44af-8d04-c7bebb82ac0d) Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'server_id': 'b34275f2-dfb0-4cd8-bac0-3e182fcb2fca', 'id': 'f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1'} Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:14:25.928146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-832a0ac0-7329-44af-8d04-c7bebb82ac0d) Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 21 22:14:25.929167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-832a0ac0-7329-44af-8d04-c7bebb82ac0d) Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.930268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-832a0ac0-7329-44af-8d04-c7bebb82ac0d) Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:25.931281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-832a0ac0-7329-44af-8d04-c7bebb82ac0d) Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-832a0ac0-7329-44af-8d04-c7bebb82ac0d) Jul 21 22:14:25.932393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:14:25.933620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5aff04b2-8ceb-4044-9a20-385dcb94a13f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-832a0ac0-7329-44af-8d04-c7bebb82ac0d) {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:14:25.933620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5aff04b2-8ceb-4044-9a20-385dcb94a13f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1" status: 400 len: 269 microversion: 2.1 time: 0.173014 Jul 21 22:14:25.933620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 636/1142] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:14:25 2022] DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca/os-volume_attachments/f88031a2-232c-4c8c-b3bf-b9ef0a5b5ca1 => generated 269 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:14:25.955855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-aebf228c-ba0a-45f2-b22e-c02655fdc4c8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051957 Jul 21 22:14:25.956527 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 507/1143] 10.222.0.44 () {60 vars in 1342 bytes} [Thu Jul 21 22:14:25 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:14:26.031823 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:26.032314 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:26.038299 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:26.038743 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:26.039541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:26.039974 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:26.064038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Going to try to terminate instance {{(pid=117979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:14:26.070190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.compute.api [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Working on deleting snapshot adb3c491-7fdb-4f9b-a0f5-a78ded7ff1dd from shelved instance... Jul 21 22:14:26.734193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Doing local delete in cell b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0(cell1) {{(pid=117979) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 21 22:14:26.734992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:26.735461 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:26.735884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.compute.api [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 21 22:14:26.742239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.network.neutron [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] deallocate_for_instance() {{(pid=117979) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 21 22:14:26.761971 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-15839dfd-4ce2-4609-b9e1-4c08dd99463d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:14:26.762894 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-15839dfd-4ce2-4609-b9e1-4c08dd99463d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:26.769247 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-15839dfd-4ce2-4609-b9e1-4c08dd99463d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:26.769696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-15839dfd-4ce2-4609-b9e1-4c08dd99463d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:26.771131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-15839dfd-4ce2-4609-b9e1-4c08dd99463d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:26.771566 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-15839dfd-4ce2-4609-b9e1-4c08dd99463d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:26.868716 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-15839dfd-4ce2-4609-b9e1-4c08dd99463d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "POST /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/action" status: 200 len: 75728 microversion: 2.1 time: 0.110614 Jul 21 22:14:26.869970 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 508/1144] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 22:14:26 2022] POST /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f/action => generated 75728 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 21 22:14:26.874802 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7689a05b-5846-4c25-bf43-6a18c57e13ed tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:14:26.875966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7689a05b-5846-4c25-bf43-6a18c57e13ed tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:26.884370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7689a05b-5846-4c25-bf43-6a18c57e13ed tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:26.884896 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7689a05b-5846-4c25-bf43-6a18c57e13ed tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:26.886076 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7689a05b-5846-4c25-bf43-6a18c57e13ed tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:26.887998 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7689a05b-5846-4c25-bf43-6a18c57e13ed tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:26.976609 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7689a05b-5846-4c25-bf43-6a18c57e13ed tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "POST /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/action" status: 200 len: 41197 microversion: 2.1 time: 0.104995 Jul 21 22:14:26.977640 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 509/1145] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 22:14:26 2022] POST /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06/action => generated 41197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:14:27.686518 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.network.neutron [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Updating instance_info_cache with network_info: [] {{(pid=117979) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 21 22:14:27.751269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-122e9b70-be71-41c3-8319-9f07d04f5e1f req-e69afc89-281f-4c4e-bc14-4de8bd3adf3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84e2efbe-11d4-4ecc-8825-11f420d36f03", "name": "network-vif-deleted", "tag": "978d1e0a-28ef-408b-a540-0a23b3da9c0b"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:14:27.761959 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-122e9b70-be71-41c3-8319-9f07d04f5e1f req-e69afc89-281f-4c4e-bc14-4de8bd3adf3c service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:27.762402 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-122e9b70-be71-41c3-8319-9f07d04f5e1f req-e69afc89-281f-4c4e-bc14-4de8bd3adf3c service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:27.775116 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.compute.server_external_events [req-122e9b70-be71-41c3-8319-9f07d04f5e1f req-e69afc89-281f-4c4e-bc14-4de8bd3adf3c service nova] Unable to find a host for instance 84e2efbe-11d4-4ecc-8825-11f420d36f03. Dropping event network-vif-deleted {{(pid=117978) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 22:14:27.776007 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-122e9b70-be71-41c3-8319-9f07d04f5e1f req-e69afc89-281f-4c4e-bc14-4de8bd3adf3c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.095090 Jul 21 22:14:27.776596 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 510/1146] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 96 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 21 22:14:27.915919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.scheduler.client.report [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Deleted allocations for instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 Jul 21 22:14:28.060323 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9730b551-7660-49b4-8ef8-087770dd2af6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "DELETE /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 204 len: 0 microversion: 2.20 time: 2.032243 Jul 21 22:14:28.061133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 637/1147] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jul 21 22:14:26 2022] DELETE /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 0 bytes in 2034 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 22:14:28.071570 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-297885fa-b5f2-4865-900c-c36495a8b892 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:28.072309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-297885fa-b5f2-4865-900c-c36495a8b892 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:28.079736 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-297885fa-b5f2-4865-900c-c36495a8b892 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:28.080192 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-297885fa-b5f2-4865-900c-c36495a8b892 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:28.081310 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-297885fa-b5f2-4865-900c-c36495a8b892 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:28.081908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-297885fa-b5f2-4865-900c-c36495a8b892 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:28.098423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-297885fa-b5f2-4865-900c-c36495a8b892 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] HTTP exception thrown: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-297885fa-b5f2-4865-900c-c36495a8b892 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Request method failure captured: Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 HTTP/1.1 Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwhZgP2lKPueRsocGvaeMq7ROSs_8wgYETfg7lnpeTphjU1mZBhgSWUCnPew9ATJxnZrdwROuYzDAxEYKfUoMY0z8OoM9keregwq9KJtQz6YeDH9JwkorofRQ47251yiOVRYTWxjeL63B-O49ANd9ZAyv-_JpV7cnuTmGDLsrRp3uM Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:14:28.100299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:14:28.101663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36a85f96959d48c5810ea0d38f65f22c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:14:28.101663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:14:28.101663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:14:28.101663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:14:28.101663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:14:28.101663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:14:28.101663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:14:28.101663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 1c86ce2899b6485da1517e3b5a1c64de Jul 21 22:14:28.101663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:14:28.101663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:14:28.101663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:14:28.101663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': '84e2efbe-11d4-4ecc-8825-11f420d36f03'} Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:14:28.102542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:14:28.104058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:14:28.105404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-297885fa-b5f2-4865-900c-c36495a8b892 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Returning 404 to user: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:14:28.105404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-297885fa-b5f2-4865-900c-c36495a8b892 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 404 len: 111 microversion: 2.20 time: 0.036612 Jul 21 22:14:28.105883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 511/1148] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:14:28 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:14:28.111803 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2af2000d-e042-4a20-8766-16c4c88b85a8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '.version_select at 0x7faca31660d0>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:28.130737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2af2000d-e042-4a20-8766-16c4c88b85a8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073268854" status: 204 len: 0 microversion: 2.20 time: 0.023303 Jul 21 22:14:28.131398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 638/1149] 10.222.0.44 () {60 vars in 1261 bytes} [Thu Jul 21 22:14:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2073268854 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 21 22:14:29.317023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9b490a59-da1e-416e-a041-430b593c6d75 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Action: 'create', calling method: .version_select at 0x7faca1f155e0>, body: {"keypair": {"name": "tempest-keypair-1346038580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhzsp0VHOetVUW5QXgN75IPtfUcjugA6AwiQ9itOLYNubpmik3mKkU8jLlypBnhsES/e2vIxNShZEVe8qXpm86lVaROPHhuT8FHzaFau6QAwFRYmJVA7n9ymbmMhuGGvw=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:14:29.331257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-9b490a59-da1e-416e-a041-430b593c6d75 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Getting quotas for project 36a85f96959d48c5810ea0d38f65f22c. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:14:29.335483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-9b490a59-da1e-416e-a041-430b593c6d75 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Getting quotas for user 1c86ce2899b6485da1517e3b5a1c64de and project 36a85f96959d48c5810ea0d38f65f22c. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:14:29.360397 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9b490a59-da1e-416e-a041-430b593c6d75 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047354 Jul 21 22:14:29.360988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 512/1150] 10.222.0.44 () {62 vars in 1199 bytes} [Thu Jul 21 22:14:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 21 22:14:30.029478 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:14:30.029947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:14:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:14:30.585123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-761461658", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b0ec8e99-05f4-42b9-a66c-01f8a5517d33"}], "security_groups": [{"name": "tempest-securitygroup--826181817"}], "key_name": "tempest-keypair-1346038580", "user_data": "}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:14:30.686967 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.network.neutron [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] validate_networks() for [('b0ec8e99-05f4-42b9-a66c-01f8a5517d33', None, None, None, None, None)] {{(pid=117979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:14:31.175567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Flavor limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:14:31.176127 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Image limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:14:31.176448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Flavor pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:14:31.176903 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Image pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:14:31.177310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:14:31.186010 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:31.186452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:31.187280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:31.187708 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:31.205273 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Getting quotas for project 36a85f96959d48c5810ea0d38f65f22c. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:14:31.209945 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Getting quotas for user 1c86ce2899b6485da1517e3b5a1c64de and project 36a85f96959d48c5810ea0d38f65f22c. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:14:31.221510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Going to run 1 instances... {{(pid=117979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:14:31.223950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:14:31.273705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-843b807f-3528-4f3a-bd71-de501c6242b6 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.693388 Jul 21 22:14:31.279425 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 639/1151] 10.222.0.44 () {62 vars in 1187 bytes} [Thu Jul 21 22:14:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 21 22:14:31.285299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-817bfa9f-207c-4721-b4b3-8b2b2f60c1a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:31.285951 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-817bfa9f-207c-4721-b4b3-8b2b2f60c1a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:31.350903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-817bfa9f-207c-4721-b4b3-8b2b2f60c1a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:31.358111 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-817bfa9f-207c-4721-b4b3-8b2b2f60c1a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:31.359837 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-817bfa9f-207c-4721-b4b3-8b2b2f60c1a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:31.360943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-817bfa9f-207c-4721-b4b3-8b2b2f60c1a3 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 200 len: 1281 microversion: 2.20 time: 0.080245 Jul 21 22:14:31.361503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 513/1152] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:14:31 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:14:32.382696 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2c611e1f-4713-40db-8103-0d0dd1deba01 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:32.383532 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2c611e1f-4713-40db-8103-0d0dd1deba01 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:32.391336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2c611e1f-4713-40db-8103-0d0dd1deba01 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:32.391950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2c611e1f-4713-40db-8103-0d0dd1deba01 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:32.392811 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2c611e1f-4713-40db-8103-0d0dd1deba01 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:32.393256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2c611e1f-4713-40db-8103-0d0dd1deba01 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:32.488690 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2c611e1f-4713-40db-8103-0d0dd1deba01 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:32.497310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2c611e1f-4713-40db-8103-0d0dd1deba01 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:32.498832 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2c611e1f-4713-40db-8103-0d0dd1deba01 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:32.500094 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2c611e1f-4713-40db-8103-0d0dd1deba01 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 200 len: 1351 microversion: 2.20 time: 0.124618 Jul 21 22:14:32.500806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 640/1153] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:14:32 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 1351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 21 22:14:33.519325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-61a64ab2-34a2-4631-b490-f2c94252ed82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:33.519941 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-61a64ab2-34a2-4631-b490-f2c94252ed82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:33.526562 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-61a64ab2-34a2-4631-b490-f2c94252ed82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:33.527043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-61a64ab2-34a2-4631-b490-f2c94252ed82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:33.527824 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-61a64ab2-34a2-4631-b490-f2c94252ed82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:33.528272 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-61a64ab2-34a2-4631-b490-f2c94252ed82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:33.666767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-61a64ab2-34a2-4631-b490-f2c94252ed82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:33.675482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-61a64ab2-34a2-4631-b490-f2c94252ed82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:33.677043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-61a64ab2-34a2-4631-b490-f2c94252ed82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:33.678165 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-61a64ab2-34a2-4631-b490-f2c94252ed82 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 200 len: 1406 microversion: 2.20 time: 0.162888 Jul 21 22:14:33.678727 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 514/1154] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:14:33 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:14:33.783557 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-96298646-f936-4f3f-b21e-ee534f69363d req-5e40c43f-553d-4c15-a2f4-864832e43997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59867bfc-c5f4-4bd8-8b01-e3e622d5178b", "tag": "a51d074c-c328-442a-8e06-ad5469efefc0"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:14:33.794054 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-96298646-f936-4f3f-b21e-ee534f69363d req-5e40c43f-553d-4c15-a2f4-864832e43997 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:33.794585 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-96298646-f936-4f3f-b21e-ee534f69363d req-5e40c43f-553d-4c15-a2f4-864832e43997 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:33.806596 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-96298646-f936-4f3f-b21e-ee534f69363d req-5e40c43f-553d-4c15-a2f4-864832e43997 service nova] Creating event network-changed:a51d074c-c328-442a-8e06-ad5469efefc0 for instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b on hv-cinder-82002 Jul 21 22:14:33.812877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-96298646-f936-4f3f-b21e-ee534f69363d req-5e40c43f-553d-4c15-a2f4-864832e43997 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034130 Jul 21 22:14:33.813812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 641/1155] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:14:34.696804 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0ef96101-94a0-4544-afc5-5709ee2d22ac tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:34.697417 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0ef96101-94a0-4544-afc5-5709ee2d22ac tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:34.703890 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ef96101-94a0-4544-afc5-5709ee2d22ac tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:34.704345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ef96101-94a0-4544-afc5-5709ee2d22ac tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:34.705114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ef96101-94a0-4544-afc5-5709ee2d22ac tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:34.705552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ef96101-94a0-4544-afc5-5709ee2d22ac tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:34.836295 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0ef96101-94a0-4544-afc5-5709ee2d22ac tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:34.844098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0ef96101-94a0-4544-afc5-5709ee2d22ac tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:34.845994 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0ef96101-94a0-4544-afc5-5709ee2d22ac tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:34.847373 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0ef96101-94a0-4544-afc5-5709ee2d22ac tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 200 len: 1406 microversion: 2.20 time: 0.154859 Jul 21 22:14:34.847837 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 515/1156] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:14:34 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:14:35.866855 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-07737bbd-bacc-444e-9fe2-45b0f39ad03c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:35.867493 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-07737bbd-bacc-444e-9fe2-45b0f39ad03c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:35.873661 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-07737bbd-bacc-444e-9fe2-45b0f39ad03c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:35.874124 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-07737bbd-bacc-444e-9fe2-45b0f39ad03c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:35.874878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-07737bbd-bacc-444e-9fe2-45b0f39ad03c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:35.875346 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-07737bbd-bacc-444e-9fe2-45b0f39ad03c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:36.007988 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-07737bbd-bacc-444e-9fe2-45b0f39ad03c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:36.015848 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-07737bbd-bacc-444e-9fe2-45b0f39ad03c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:36.017360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-07737bbd-bacc-444e-9fe2-45b0f39ad03c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:36.018461 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-07737bbd-bacc-444e-9fe2-45b0f39ad03c tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 200 len: 1406 microversion: 2.20 time: 0.156479 Jul 21 22:14:36.019031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 642/1157] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:14:35 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:14:37.035453 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-22e658b5-20a2-499e-ba2b-5b4365098f16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:37.036590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-22e658b5-20a2-499e-ba2b-5b4365098f16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:37.043076 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22e658b5-20a2-499e-ba2b-5b4365098f16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:37.043538 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22e658b5-20a2-499e-ba2b-5b4365098f16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:37.044292 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22e658b5-20a2-499e-ba2b-5b4365098f16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:37.044727 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22e658b5-20a2-499e-ba2b-5b4365098f16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:37.171943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-22e658b5-20a2-499e-ba2b-5b4365098f16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:37.180311 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-22e658b5-20a2-499e-ba2b-5b4365098f16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:37.181811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-22e658b5-20a2-499e-ba2b-5b4365098f16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:37.183038 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-22e658b5-20a2-499e-ba2b-5b4365098f16 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 200 len: 1406 microversion: 2.20 time: 0.151431 Jul 21 22:14:37.183603 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 516/1158] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:14:37 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:14:38.200276 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ee427779-a401-4354-a5c8-4ab39efd7cb8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:38.200886 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ee427779-a401-4354-a5c8-4ab39efd7cb8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:38.207511 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ee427779-a401-4354-a5c8-4ab39efd7cb8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:38.208009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ee427779-a401-4354-a5c8-4ab39efd7cb8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:38.208782 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ee427779-a401-4354-a5c8-4ab39efd7cb8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:38.209222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ee427779-a401-4354-a5c8-4ab39efd7cb8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:38.213238 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=2,nova_cell1:UPDATE=20,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:14:38.348811 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ee427779-a401-4354-a5c8-4ab39efd7cb8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:38.357267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ee427779-a401-4354-a5c8-4ab39efd7cb8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:38.358781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ee427779-a401-4354-a5c8-4ab39efd7cb8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:38.359920 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ee427779-a401-4354-a5c8-4ab39efd7cb8 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 200 len: 1406 microversion: 2.20 time: 0.163550 Jul 21 22:14:38.360481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 643/1159] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:14:38 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:14:39.377829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6401a29f-1020-4af2-9875-4860f3a0bc2b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:39.378350 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6401a29f-1020-4af2-9875-4860f3a0bc2b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:39.384915 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6401a29f-1020-4af2-9875-4860f3a0bc2b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:39.385369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6401a29f-1020-4af2-9875-4860f3a0bc2b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:39.386134 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6401a29f-1020-4af2-9875-4860f3a0bc2b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:39.386573 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6401a29f-1020-4af2-9875-4860f3a0bc2b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:39.514155 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6401a29f-1020-4af2-9875-4860f3a0bc2b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:39.521981 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6401a29f-1020-4af2-9875-4860f3a0bc2b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:39.523509 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6401a29f-1020-4af2-9875-4860f3a0bc2b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:39.524608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6401a29f-1020-4af2-9875-4860f3a0bc2b tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 200 len: 1406 microversion: 2.20 time: 0.150774 Jul 21 22:14:39.525175 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 517/1160] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:14:39 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:14:39.889296 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-ebc6676d-8a26-4592-82af-0591a92e3afc req-20d9a806-526a-4acd-93eb-cc4e6c34d10c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59867bfc-c5f4-4bd8-8b01-e3e622d5178b", "name": "network-vif-plugged", "status": "completed", "tag": "a51d074c-c328-442a-8e06-ad5469efefc0"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:14:39.897389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-ebc6676d-8a26-4592-82af-0591a92e3afc req-20d9a806-526a-4acd-93eb-cc4e6c34d10c service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:39.897824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-ebc6676d-8a26-4592-82af-0591a92e3afc req-20d9a806-526a-4acd-93eb-cc4e6c34d10c service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:39.908573 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-ebc6676d-8a26-4592-82af-0591a92e3afc req-20d9a806-526a-4acd-93eb-cc4e6c34d10c service nova] Creating event network-vif-plugged:a51d074c-c328-442a-8e06-ad5469efefc0 for instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b on hv-cinder-82002 Jul 21 22:14:39.913391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-ebc6676d-8a26-4592-82af-0591a92e3afc req-20d9a806-526a-4acd-93eb-cc4e6c34d10c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087395 Jul 21 22:14:39.913956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 644/1161] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:14:40.548238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8e6038a8-8862-49b5-9e3d-e79bb4662815 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:40.548884 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8e6038a8-8862-49b5-9e3d-e79bb4662815 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:40.555865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e6038a8-8862-49b5-9e3d-e79bb4662815 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:40.556314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e6038a8-8862-49b5-9e3d-e79bb4662815 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:40.557341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e6038a8-8862-49b5-9e3d-e79bb4662815 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:40.557492 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e6038a8-8862-49b5-9e3d-e79bb4662815 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:40.691452 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8e6038a8-8862-49b5-9e3d-e79bb4662815 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:40.700007 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8e6038a8-8862-49b5-9e3d-e79bb4662815 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:40.701502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8e6038a8-8862-49b5-9e3d-e79bb4662815 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:40.702603 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8e6038a8-8862-49b5-9e3d-e79bb4662815 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 200 len: 1406 microversion: 2.20 time: 0.158247 Jul 21 22:14:40.703181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 518/1162] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:14:40 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:14:41.718002 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:14:41.718698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=6 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:14:41.722873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7205a480-3b0c-400d-8ad7-2a61b1d84385 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:41.723615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7205a480-3b0c-400d-8ad7-2a61b1d84385 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:41.730992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7205a480-3b0c-400d-8ad7-2a61b1d84385 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:41.731462 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7205a480-3b0c-400d-8ad7-2a61b1d84385 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:41.732219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7205a480-3b0c-400d-8ad7-2a61b1d84385 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:41.732668 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7205a480-3b0c-400d-8ad7-2a61b1d84385 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:41.863413 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7205a480-3b0c-400d-8ad7-2a61b1d84385 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:41.871413 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7205a480-3b0c-400d-8ad7-2a61b1d84385 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:41.872910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7205a480-3b0c-400d-8ad7-2a61b1d84385 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:41.873994 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7205a480-3b0c-400d-8ad7-2a61b1d84385 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 200 len: 1406 microversion: 2.20 time: 0.157453 Jul 21 22:14:41.874537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 645/1163] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:14:41 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:14:42.892084 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a86458a9-ed72-42a7-9baa-558ebb333584 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:42.892728 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a86458a9-ed72-42a7-9baa-558ebb333584 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:42.894651 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:14:42.900780 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a86458a9-ed72-42a7-9baa-558ebb333584 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:42.901232 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a86458a9-ed72-42a7-9baa-558ebb333584 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:42.902006 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a86458a9-ed72-42a7-9baa-558ebb333584 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:42.902445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a86458a9-ed72-42a7-9baa-558ebb333584 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:43.028931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a86458a9-ed72-42a7-9baa-558ebb333584 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:43.037274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a86458a9-ed72-42a7-9baa-558ebb333584 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:43.038762 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a86458a9-ed72-42a7-9baa-558ebb333584 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:14:43.039927 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a86458a9-ed72-42a7-9baa-558ebb333584 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 200 len: 1597 microversion: 2.20 time: 0.151691 Jul 21 22:14:43.040489 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 519/1164] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:14:42 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 1597 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:14:43.057414 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f19ae53b-b015-4979-ab9d-546088e152c0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:14:43.057899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f19ae53b-b015-4979-ab9d-546088e152c0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:14:43.064237 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f19ae53b-b015-4979-ab9d-546088e152c0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:43.064769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f19ae53b-b015-4979-ab9d-546088e152c0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:43.065527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f19ae53b-b015-4979-ab9d-546088e152c0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:43.065958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f19ae53b-b015-4979-ab9d-546088e152c0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:43.145227 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f19ae53b-b015-4979-ab9d-546088e152c0 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091492 Jul 21 22:14:43.145859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 646/1165] 10.222.0.44 () {60 vars in 1315 bytes} [Thu Jul 21 22:14:43 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:14:44.084486 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-87828028-f600-48b5-a591-951fd831da90 req-0c6fa1ed-6d15-4b6c-80b9-33e8277331e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59867bfc-c5f4-4bd8-8b01-e3e622d5178b", "tag": "a51d074c-c328-442a-8e06-ad5469efefc0"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:14:44.092855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-87828028-f600-48b5-a591-951fd831da90 req-0c6fa1ed-6d15-4b6c-80b9-33e8277331e9 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:14:44.093311 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-87828028-f600-48b5-a591-951fd831da90 req-0c6fa1ed-6d15-4b6c-80b9-33e8277331e9 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:14:44.104362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-87828028-f600-48b5-a591-951fd831da90 req-0c6fa1ed-6d15-4b6c-80b9-33e8277331e9 service nova] Creating event network-changed:a51d074c-c328-442a-8e06-ad5469efefc0 for instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b on hv-cinder-82002 Jul 21 22:14:44.109447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-87828028-f600-48b5-a591-951fd831da90 req-0c6fa1ed-6d15-4b6c-80b9-33e8277331e9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029304 Jul 21 22:14:44.110229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 520/1166] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:15:58.546108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:15:58.546897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:15:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:15:59.163587 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:59.164359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=17 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:15:59.168446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ef09929f-feda-4de3-a9fe-3b8f3b1edb6f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:15:59.168931 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ef09929f-feda-4de3-a9fe-3b8f3b1edb6f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:15:59.176336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ef09929f-feda-4de3-a9fe-3b8f3b1edb6f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:15:59.176775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ef09929f-feda-4de3-a9fe-3b8f3b1edb6f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:15:59.177533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ef09929f-feda-4de3-a9fe-3b8f3b1edb6f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:15:59.177957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ef09929f-feda-4de3-a9fe-3b8f3b1edb6f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:15:59.202617 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ef09929f-feda-4de3-a9fe-3b8f3b1edb6f tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b/ips" status: 200 len: 151 microversion: 2.20 time: 0.040854 Jul 21 22:15:59.203201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 647/1167] 10.222.0.44 () {60 vars in 1288 bytes} [Thu Jul 21 22:15:59 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 21 22:17:09.224792 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:17:09.225424 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:17:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:17:19.529220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:17:19.529681 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:17:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:17:31.188430 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:17:31.189621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:17:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:17:39.621327 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:17:39.621784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:17:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:17:50.038152 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:17:50.038871 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:17:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:19:18.554995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:19:18.555635 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:19:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:20:25.526480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62186598-0719-47ae-9ec4-e5aa9f83c2b9] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 22:20:25.527131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:25.527993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=96 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:25.535526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-66dee1aa-fc01-4a4e-b856-208670b4af7d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] Calling method '.version_select at 0x7faca1f02af0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:25.539343 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR oslo.messaging._drivers.impl_rabbit [None req-66dee1aa-fc01-4a4e-b856-208670b4af7d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [3bce68d4-e69f-4ed8-9e06-d9decf9993c6] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 22:20:25.582471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1ea72114-1d1b-4719-8091-31de6bff38ad] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 21 22:20:25.583205 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=4 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:25.584335 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:25.587799 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3e21d269-6153-4263-84ee-f9f26a39b0ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:25.588287 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3e21d269-6153-4263-84ee-f9f26a39b0ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:25.596593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3e21d269-6153-4263-84ee-f9f26a39b0ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:25.597039 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3e21d269-6153-4263-84ee-f9f26a39b0ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:25.597798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3e21d269-6153-4263-84ee-f9f26a39b0ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:25.598412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3e21d269-6153-4263-84ee-f9f26a39b0ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:25.622733 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3e21d269-6153-4263-84ee-f9f26a39b0ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Going to try to terminate instance {{(pid=117979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:20:25.698386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3e21d269-6153-4263-84ee-f9f26a39b0ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 204 len: 0 microversion: 2.1 time: 0.117526 Jul 21 22:20:25.702047 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 648/1168] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:20:25 2022] DELETE /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:20:25.709383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f35aa2fc-db79-4691-ab97-dc0cd5b16f15 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:25.710116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f35aa2fc-db79-4691-ab97-dc0cd5b16f15 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:25.716307 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f35aa2fc-db79-4691-ab97-dc0cd5b16f15 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:25.716756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f35aa2fc-db79-4691-ab97-dc0cd5b16f15 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:25.717523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f35aa2fc-db79-4691-ab97-dc0cd5b16f15 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:25.717958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f35aa2fc-db79-4691-ab97-dc0cd5b16f15 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:25.910530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f35aa2fc-db79-4691-ab97-dc0cd5b16f15 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:25.918422 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f35aa2fc-db79-4691-ab97-dc0cd5b16f15 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.214469 Jul 21 22:20:25.919032 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 649/1169] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:25 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:26.368230 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3830c8eb-e599-4b92-be9d-41c987b1d652 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:26.368727 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3830c8eb-e599-4b92-be9d-41c987b1d652 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:26.374744 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3830c8eb-e599-4b92-be9d-41c987b1d652 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:26.375807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3830c8eb-e599-4b92-be9d-41c987b1d652 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:26.376564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3830c8eb-e599-4b92-be9d-41c987b1d652 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:26.377041 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3830c8eb-e599-4b92-be9d-41c987b1d652 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:26.403159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3830c8eb-e599-4b92-be9d-41c987b1d652 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Going to try to terminate instance {{(pid=117979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:20:26.480045 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3830c8eb-e599-4b92-be9d-41c987b1d652 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 204 len: 0 microversion: 2.1 time: 0.115596 Jul 21 22:20:26.481035 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 650/1170] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:20:26 2022] DELETE /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:20:26.491389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-04106d9f-4cbf-469b-8dc2-87199eae44b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:26.492181 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-04106d9f-4cbf-469b-8dc2-87199eae44b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:26.498388 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04106d9f-4cbf-469b-8dc2-87199eae44b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:26.498843 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04106d9f-4cbf-469b-8dc2-87199eae44b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:26.499656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04106d9f-4cbf-469b-8dc2-87199eae44b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:26.500795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04106d9f-4cbf-469b-8dc2-87199eae44b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:26.534823 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] [62186598-0719-47ae-9ec4-e5aa9f83c2b9] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 33970. Jul 21 22:20:26.545251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [None req-66dee1aa-fc01-4a4e-b856-208670b4af7d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] [3bce68d4-e69f-4ed8-9e06-d9decf9993c6] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 33972. Jul 21 22:20:26.565128 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-66dee1aa-fc01-4a4e-b856-208670b4af7d tempest-TestVolumeBootPattern-1880088924 tempest-TestVolumeBootPattern-1880088924-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2015823344" status: 202 len: 0 microversion: 2.1 time: 1.040347 Jul 21 22:20:26.565711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 521/1171] 10.222.0.44 () {58 vars in 1262 bytes} [Thu Jul 21 22:20:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2015823344 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:20:26.596831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] [1ea72114-1d1b-4719-8091-31de6bff38ad] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 33974. Jul 21 22:20:26.640213 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-04106d9f-4cbf-469b-8dc2-87199eae44b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:26.663563 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-04106d9f-4cbf-469b-8dc2-87199eae44b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1719 microversion: 2.1 time: 0.177522 Jul 21 22:20:26.664209 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 651/1172] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:26 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:26.935669 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0584508b-0319-4d9b-9dd3-74fcc7407633 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:26.936391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0584508b-0319-4d9b-9dd3-74fcc7407633 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:26.942433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0584508b-0319-4d9b-9dd3-74fcc7407633 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:26.942887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0584508b-0319-4d9b-9dd3-74fcc7407633 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:26.943781 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0584508b-0319-4d9b-9dd3-74fcc7407633 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:26.944209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0584508b-0319-4d9b-9dd3-74fcc7407633 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:27.137441 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0584508b-0319-4d9b-9dd3-74fcc7407633 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:27.146057 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0584508b-0319-4d9b-9dd3-74fcc7407633 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.214335 Jul 21 22:20:27.146623 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 522/1173] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:26 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:27.577556 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f510463d-2d14-4914-a50f-d3a747c61f94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:27.578718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f510463d-2d14-4914-a50f-d3a747c61f94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:27.584920 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f510463d-2d14-4914-a50f-d3a747c61f94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:27.585372 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f510463d-2d14-4914-a50f-d3a747c61f94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:27.586145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f510463d-2d14-4914-a50f-d3a747c61f94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:27.586585 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f510463d-2d14-4914-a50f-d3a747c61f94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:27.612656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f510463d-2d14-4914-a50f-d3a747c61f94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Going to try to terminate instance {{(pid=117979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:20:27.681502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-16909bea-e670-44b5-8ba8-82d86388a63e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:27.682741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-16909bea-e670-44b5-8ba8-82d86388a63e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:27.691108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-16909bea-e670-44b5-8ba8-82d86388a63e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:27.691559 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-16909bea-e670-44b5-8ba8-82d86388a63e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:27.692280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f510463d-2d14-4914-a50f-d3a747c61f94 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 204 len: 0 microversion: 2.1 time: 0.118084 Jul 21 22:20:27.692399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-16909bea-e670-44b5-8ba8-82d86388a63e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:27.692765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-16909bea-e670-44b5-8ba8-82d86388a63e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:27.696585 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 652/1174] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:20:27 2022] DELETE /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:20:27.705642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fa96352f-b54e-4272-88c6-4076f0eb4ec9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:27.707228 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fa96352f-b54e-4272-88c6-4076f0eb4ec9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:27.714158 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa96352f-b54e-4272-88c6-4076f0eb4ec9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:27.714692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa96352f-b54e-4272-88c6-4076f0eb4ec9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:27.715564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa96352f-b54e-4272-88c6-4076f0eb4ec9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:27.716001 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa96352f-b54e-4272-88c6-4076f0eb4ec9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:27.930137 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-16909bea-e670-44b5-8ba8-82d86388a63e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:27.939540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-16909bea-e670-44b5-8ba8-82d86388a63e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1719 microversion: 2.1 time: 0.261699 Jul 21 22:20:27.940588 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 523/1175] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:27 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1719 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:27.942768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fa96352f-b54e-4272-88c6-4076f0eb4ec9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:27.951830 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fa96352f-b54e-4272-88c6-4076f0eb4ec9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.253534 Jul 21 22:20:27.952565 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 653/1176] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:27 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:28.162645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-af95f0d1-d28e-412c-bf83-2e6bba4d7925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:28.163289 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-af95f0d1-d28e-412c-bf83-2e6bba4d7925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:28.169173 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af95f0d1-d28e-412c-bf83-2e6bba4d7925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:28.169622 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af95f0d1-d28e-412c-bf83-2e6bba4d7925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:28.170394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af95f0d1-d28e-412c-bf83-2e6bba4d7925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:28.170836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af95f0d1-d28e-412c-bf83-2e6bba4d7925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:28.309396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-af95f0d1-d28e-412c-bf83-2e6bba4d7925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:28.317736 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-af95f0d1-d28e-412c-bf83-2e6bba4d7925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.158878 Jul 21 22:20:28.318307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 524/1177] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:28 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:28.958087 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6ef35e76-d2d9-42dc-80a8-39ed786db9cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:28.958712 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6ef35e76-d2d9-42dc-80a8-39ed786db9cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:28.969793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-abc1f6e0-ac0f-4f42-8632-c3bf2018bb1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:28.971562 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-abc1f6e0-ac0f-4f42-8632-c3bf2018bb1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:28.979797 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-abc1f6e0-ac0f-4f42-8632-c3bf2018bb1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:28.983084 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ef35e76-d2d9-42dc-80a8-39ed786db9cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:28.983526 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ef35e76-d2d9-42dc-80a8-39ed786db9cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:28.984125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-abc1f6e0-ac0f-4f42-8632-c3bf2018bb1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:28.985086 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ef35e76-d2d9-42dc-80a8-39ed786db9cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:28.985527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ef35e76-d2d9-42dc-80a8-39ed786db9cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:28.987280 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-abc1f6e0-ac0f-4f42-8632-c3bf2018bb1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:28.987725 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-abc1f6e0-ac0f-4f42-8632-c3bf2018bb1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:29.101762 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6ef35e76-d2d9-42dc-80a8-39ed786db9cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:29.118873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6ef35e76-d2d9-42dc-80a8-39ed786db9cc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1652 microversion: 2.1 time: 0.164849 Jul 21 22:20:29.120165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 654/1178] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:28 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1652 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:29.169483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-abc1f6e0-ac0f-4f42-8632-c3bf2018bb1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:29.177677 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-abc1f6e0-ac0f-4f42-8632-c3bf2018bb1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.213473 Jul 21 22:20:29.187915 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 525/1179] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:28 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:29.233770 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:20:29.234034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:20:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:20:29.335566 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5cbda7e9-45a9-420d-99be-8abd6a5a2f6b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:29.336571 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5cbda7e9-45a9-420d-99be-8abd6a5a2f6b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:29.343033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5cbda7e9-45a9-420d-99be-8abd6a5a2f6b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:29.343901 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5cbda7e9-45a9-420d-99be-8abd6a5a2f6b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:29.344951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5cbda7e9-45a9-420d-99be-8abd6a5a2f6b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:29.345884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5cbda7e9-45a9-420d-99be-8abd6a5a2f6b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:29.568992 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-4020478b-3b1c-4381-a342-4a6f5f55bbce req-828961b8-3ed9-44a3-b47a-55ca704aeb37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f", "name": "network-vif-deleted", "tag": "ee06169e-43fc-48f5-a5bb-ad6632cb1500"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:20:29.584934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-4020478b-3b1c-4381-a342-4a6f5f55bbce req-828961b8-3ed9-44a3-b47a-55ca704aeb37 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:29.585671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-4020478b-3b1c-4381-a342-4a6f5f55bbce req-828961b8-3ed9-44a3-b47a-55ca704aeb37 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:29.594359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5cbda7e9-45a9-420d-99be-8abd6a5a2f6b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:29.606476 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5cbda7e9-45a9-420d-99be-8abd6a5a2f6b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.274733 Jul 21 22:20:29.607282 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 655/1180] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:29 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:29.632127 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-4020478b-3b1c-4381-a342-4a6f5f55bbce req-828961b8-3ed9-44a3-b47a-55ca704aeb37 service nova] Creating event network-vif-deleted:ee06169e-43fc-48f5-a5bb-ad6632cb1500 for instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f on hv-cinder-82002 Jul 21 22:20:29.638605 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-4020478b-3b1c-4381-a342-4a6f5f55bbce req-828961b8-3ed9-44a3-b47a-55ca704aeb37 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162294 Jul 21 22:20:29.639776 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 526/1181] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:20:30.137482 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-77c0a3be-c933-427c-84ba-9d8fe7aa99dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:30.138847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-77c0a3be-c933-427c-84ba-9d8fe7aa99dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:30.146367 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77c0a3be-c933-427c-84ba-9d8fe7aa99dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:30.146913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77c0a3be-c933-427c-84ba-9d8fe7aa99dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:30.150688 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77c0a3be-c933-427c-84ba-9d8fe7aa99dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:30.152191 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-77c0a3be-c933-427c-84ba-9d8fe7aa99dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:30.196563 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9df182a7-d572-4b19-8680-1937b797d44c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:30.197269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9df182a7-d572-4b19-8680-1937b797d44c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:30.208304 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9df182a7-d572-4b19-8680-1937b797d44c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:30.215467 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9df182a7-d572-4b19-8680-1937b797d44c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:30.216340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9df182a7-d572-4b19-8680-1937b797d44c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:30.216795 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9df182a7-d572-4b19-8680-1937b797d44c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:30.276635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-77c0a3be-c933-427c-84ba-9d8fe7aa99dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:30.304366 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-77c0a3be-c933-427c-84ba-9d8fe7aa99dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.164354 Jul 21 22:20:30.310018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 656/1182] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:30 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:30.418450 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9df182a7-d572-4b19-8680-1937b797d44c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:30.429088 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9df182a7-d572-4b19-8680-1937b797d44c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.237029 Jul 21 22:20:30.429675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 527/1183] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:30 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:30.639348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d85aef51-57f9-410d-879a-e4b77099da0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:30.640130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d85aef51-57f9-410d-879a-e4b77099da0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:30.673093 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d85aef51-57f9-410d-879a-e4b77099da0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:30.674292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d85aef51-57f9-410d-879a-e4b77099da0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:30.675311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d85aef51-57f9-410d-879a-e4b77099da0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:30.676018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d85aef51-57f9-410d-879a-e4b77099da0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:30.871763 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d85aef51-57f9-410d-879a-e4b77099da0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:30.881318 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d85aef51-57f9-410d-879a-e4b77099da0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.261661 Jul 21 22:20:30.883081 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 657/1184] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:30 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:31.326748 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-22c127b6-6227-4f25-b460-ab10726a4492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:31.327548 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-22c127b6-6227-4f25-b460-ab10726a4492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:31.334817 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22c127b6-6227-4f25-b460-ab10726a4492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:31.335306 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22c127b6-6227-4f25-b460-ab10726a4492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:31.336075 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22c127b6-6227-4f25-b460-ab10726a4492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:31.336513 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22c127b6-6227-4f25-b460-ab10726a4492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:31.423071 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-22c127b6-6227-4f25-b460-ab10726a4492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:31.430913 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-22c127b6-6227-4f25-b460-ab10726a4492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.108017 Jul 21 22:20:31.431512 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 528/1185] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:31 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:31.445545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f2e778a7-33fa-4236-95ee-b635f863ba42 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:31.446155 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f2e778a7-33fa-4236-95ee-b635f863ba42 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:31.452961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2e778a7-33fa-4236-95ee-b635f863ba42 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:31.453413 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2e778a7-33fa-4236-95ee-b635f863ba42 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:31.454362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2e778a7-33fa-4236-95ee-b635f863ba42 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:31.454992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2e778a7-33fa-4236-95ee-b635f863ba42 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:31.662160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f2e778a7-33fa-4236-95ee-b635f863ba42 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:31.670581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f2e778a7-33fa-4236-95ee-b635f863ba42 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.228859 Jul 21 22:20:31.671469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 658/1186] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:31 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:31.897683 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0b9cd3e0-fc31-4250-8171-0888c76b504e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:31.898319 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0b9cd3e0-fc31-4250-8171-0888c76b504e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:31.904480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b9cd3e0-fc31-4250-8171-0888c76b504e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:31.904932 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b9cd3e0-fc31-4250-8171-0888c76b504e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:31.905678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b9cd3e0-fc31-4250-8171-0888c76b504e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:31.906676 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b9cd3e0-fc31-4250-8171-0888c76b504e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:32.300452 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0b9cd3e0-fc31-4250-8171-0888c76b504e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:32.308406 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0b9cd3e0-fc31-4250-8171-0888c76b504e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.414624 Jul 21 22:20:32.309061 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 529/1187] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:31 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:32.449044 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d7ef11f2-c523-4a51-8914-384584b06b23 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:32.449997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d7ef11f2-c523-4a51-8914-384584b06b23 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:32.459218 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d7ef11f2-c523-4a51-8914-384584b06b23 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:32.459959 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d7ef11f2-c523-4a51-8914-384584b06b23 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:32.460923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d7ef11f2-c523-4a51-8914-384584b06b23 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:32.461373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d7ef11f2-c523-4a51-8914-384584b06b23 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:32.481740 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:32.541457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d7ef11f2-c523-4a51-8914-384584b06b23 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:32.550138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d7ef11f2-c523-4a51-8914-384584b06b23 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.106902 Jul 21 22:20:32.550706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 659/1188] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:32 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:32.688311 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1bc65759-266f-4f4d-b4dd-a612f2a947a6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:32.689069 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1bc65759-266f-4f4d-b4dd-a612f2a947a6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:32.695766 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bc65759-266f-4f4d-b4dd-a612f2a947a6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:32.696549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bc65759-266f-4f4d-b4dd-a612f2a947a6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:32.697567 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bc65759-266f-4f4d-b4dd-a612f2a947a6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:32.698081 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bc65759-266f-4f4d-b4dd-a612f2a947a6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:32.917759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1bc65759-266f-4f4d-b4dd-a612f2a947a6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:32.929182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1bc65759-266f-4f4d-b4dd-a612f2a947a6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.245215 Jul 21 22:20:32.930092 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 530/1189] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:32 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:33.326240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e1680495-5c77-48ae-8b42-60718cc73d01 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:33.327193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e1680495-5c77-48ae-8b42-60718cc73d01 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:33.334114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1680495-5c77-48ae-8b42-60718cc73d01 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:33.334635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1680495-5c77-48ae-8b42-60718cc73d01 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:33.335671 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1680495-5c77-48ae-8b42-60718cc73d01 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:33.336465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1680495-5c77-48ae-8b42-60718cc73d01 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:33.563455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e1680495-5c77-48ae-8b42-60718cc73d01 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:33.568286 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2893b737-c6ed-444c-9985-1035025a2813 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:33.569485 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2893b737-c6ed-444c-9985-1035025a2813 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:33.574504 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e1680495-5c77-48ae-8b42-60718cc73d01 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.251986 Jul 21 22:20:33.575969 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2893b737-c6ed-444c-9985-1035025a2813 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:33.576674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2893b737-c6ed-444c-9985-1035025a2813 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:33.578309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2893b737-c6ed-444c-9985-1035025a2813 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:33.579471 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2893b737-c6ed-444c-9985-1035025a2813 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:33.585356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 660/1190] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:33 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:33.653344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2893b737-c6ed-444c-9985-1035025a2813 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:33.661508 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2893b737-c6ed-444c-9985-1035025a2813 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.098017 Jul 21 22:20:33.662423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 531/1191] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:33 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:33.947746 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3159185a-db99-4483-85ac-6a10de5498c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:33.948604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3159185a-db99-4483-85ac-6a10de5498c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:33.954568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3159185a-db99-4483-85ac-6a10de5498c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:33.955021 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3159185a-db99-4483-85ac-6a10de5498c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:33.955793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3159185a-db99-4483-85ac-6a10de5498c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:33.956223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3159185a-db99-4483-85ac-6a10de5498c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:34.125211 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3159185a-db99-4483-85ac-6a10de5498c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:34.132478 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3159185a-db99-4483-85ac-6a10de5498c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.188990 Jul 21 22:20:34.133312 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 661/1192] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:33 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:34.600376 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8fbc4a00-e403-4517-8d17-254fe8068eb0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:34.601415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8fbc4a00-e403-4517-8d17-254fe8068eb0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:34.609299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fbc4a00-e403-4517-8d17-254fe8068eb0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:34.610149 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fbc4a00-e403-4517-8d17-254fe8068eb0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:34.611527 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fbc4a00-e403-4517-8d17-254fe8068eb0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:34.612161 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fbc4a00-e403-4517-8d17-254fe8068eb0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:34.684722 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dd36a474-3492-4865-aa9f-87a038348e20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:34.687364 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dd36a474-3492-4865-aa9f-87a038348e20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:34.702214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dd36a474-3492-4865-aa9f-87a038348e20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:34.703609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dd36a474-3492-4865-aa9f-87a038348e20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:34.704569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dd36a474-3492-4865-aa9f-87a038348e20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:34.705180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dd36a474-3492-4865-aa9f-87a038348e20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:34.785640 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8fbc4a00-e403-4517-8d17-254fe8068eb0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:34.797636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8fbc4a00-e403-4517-8d17-254fe8068eb0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.208442 Jul 21 22:20:34.798539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 532/1193] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:34 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:34.815433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dd36a474-3492-4865-aa9f-87a038348e20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:34.846345 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dd36a474-3492-4865-aa9f-87a038348e20 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.171927 Jul 21 22:20:34.847278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 662/1194] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:34 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:35.150116 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-61279c2c-0d0d-47ef-a6e0-5acba23885a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:35.150654 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-61279c2c-0d0d-47ef-a6e0-5acba23885a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:35.157358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-61279c2c-0d0d-47ef-a6e0-5acba23885a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:35.157890 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-61279c2c-0d0d-47ef-a6e0-5acba23885a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:35.158768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-61279c2c-0d0d-47ef-a6e0-5acba23885a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:35.159381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-61279c2c-0d0d-47ef-a6e0-5acba23885a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:35.294298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-61279c2c-0d0d-47ef-a6e0-5acba23885a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:35.302114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-61279c2c-0d0d-47ef-a6e0-5acba23885a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.156250 Jul 21 22:20:35.302695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 533/1195] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:35 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:35.818040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c203e260-f3a0-40b1-b7af-757d7ec646cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:35.819311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c203e260-f3a0-40b1-b7af-757d7ec646cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:35.827516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c203e260-f3a0-40b1-b7af-757d7ec646cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:35.827991 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c203e260-f3a0-40b1-b7af-757d7ec646cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:35.828773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c203e260-f3a0-40b1-b7af-757d7ec646cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:35.829207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c203e260-f3a0-40b1-b7af-757d7ec646cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:35.864145 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ee4967c9-5c60-4b74-99cc-138cfe94d1dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:35.864904 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ee4967c9-5c60-4b74-99cc-138cfe94d1dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:35.871911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee4967c9-5c60-4b74-99cc-138cfe94d1dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:35.872546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee4967c9-5c60-4b74-99cc-138cfe94d1dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:35.873599 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee4967c9-5c60-4b74-99cc-138cfe94d1dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:35.874312 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee4967c9-5c60-4b74-99cc-138cfe94d1dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:35.953330 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ee4967c9-5c60-4b74-99cc-138cfe94d1dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:35.964184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ee4967c9-5c60-4b74-99cc-138cfe94d1dc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.104053 Jul 21 22:20:35.965088 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 534/1196] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:35 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:36.007288 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c203e260-f3a0-40b1-b7af-757d7ec646cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:36.016493 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c203e260-f3a0-40b1-b7af-757d7ec646cd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.204831 Jul 21 22:20:36.017214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 663/1197] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:35 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:36.319327 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-25c797c5-95d0-4aa6-b6f5-c2a9a7317ae4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:36.319851 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-25c797c5-95d0-4aa6-b6f5-c2a9a7317ae4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:36.325746 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25c797c5-95d0-4aa6-b6f5-c2a9a7317ae4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:36.326195 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25c797c5-95d0-4aa6-b6f5-c2a9a7317ae4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:36.326960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25c797c5-95d0-4aa6-b6f5-c2a9a7317ae4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:36.327419 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25c797c5-95d0-4aa6-b6f5-c2a9a7317ae4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:36.458487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-25c797c5-95d0-4aa6-b6f5-c2a9a7317ae4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:36.466577 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-25c797c5-95d0-4aa6-b6f5-c2a9a7317ae4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.151310 Jul 21 22:20:36.467181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 535/1198] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:36 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:36.982369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-26702ca9-7b39-4b8f-beae-155c32c34703 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:36.982976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-26702ca9-7b39-4b8f-beae-155c32c34703 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:36.989515 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26702ca9-7b39-4b8f-beae-155c32c34703 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:36.989966 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26702ca9-7b39-4b8f-beae-155c32c34703 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:36.990730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26702ca9-7b39-4b8f-beae-155c32c34703 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:36.991207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26702ca9-7b39-4b8f-beae-155c32c34703 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:37.034073 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7639f748-21ae-4bae-9870-9726cb2d9376 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:37.034893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7639f748-21ae-4bae-9870-9726cb2d9376 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:37.041429 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7639f748-21ae-4bae-9870-9726cb2d9376 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:37.041967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7639f748-21ae-4bae-9870-9726cb2d9376 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:37.042805 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7639f748-21ae-4bae-9870-9726cb2d9376 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:37.043341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7639f748-21ae-4bae-9870-9726cb2d9376 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:37.052259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-26702ca9-7b39-4b8f-beae-155c32c34703 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:37.060336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-26702ca9-7b39-4b8f-beae-155c32c34703 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081765 Jul 21 22:20:37.060958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 664/1199] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:36 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:37.174044 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7639f748-21ae-4bae-9870-9726cb2d9376 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:37.181847 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7639f748-21ae-4bae-9870-9726cb2d9376 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152161 Jul 21 22:20:37.182750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 536/1200] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:37 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:37.484948 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-220a874a-55c3-421d-9c56-70f4d7e622f9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:37.485561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-220a874a-55c3-421d-9c56-70f4d7e622f9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:37.491519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-220a874a-55c3-421d-9c56-70f4d7e622f9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:37.491973 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-220a874a-55c3-421d-9c56-70f4d7e622f9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:37.492741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-220a874a-55c3-421d-9c56-70f4d7e622f9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:37.493175 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-220a874a-55c3-421d-9c56-70f4d7e622f9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:37.618677 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-220a874a-55c3-421d-9c56-70f4d7e622f9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:37.627215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-220a874a-55c3-421d-9c56-70f4d7e622f9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146146 Jul 21 22:20:37.627780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 665/1201] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:37 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:38.077082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4f43e5ec-6e2c-43e9-9393-ad6b9bfc4766 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:38.077724 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4f43e5ec-6e2c-43e9-9393-ad6b9bfc4766 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:38.084324 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f43e5ec-6e2c-43e9-9393-ad6b9bfc4766 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:38.084786 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f43e5ec-6e2c-43e9-9393-ad6b9bfc4766 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:38.085563 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f43e5ec-6e2c-43e9-9393-ad6b9bfc4766 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:38.086007 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f43e5ec-6e2c-43e9-9393-ad6b9bfc4766 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:38.146186 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4f43e5ec-6e2c-43e9-9393-ad6b9bfc4766 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:38.154155 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4f43e5ec-6e2c-43e9-9393-ad6b9bfc4766 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080954 Jul 21 22:20:38.154723 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 537/1202] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:38 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:38.198941 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-774c54c1-1976-4767-8b06-851162dbb925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:38.199615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-774c54c1-1976-4767-8b06-851162dbb925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:38.206106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-774c54c1-1976-4767-8b06-851162dbb925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:38.206579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-774c54c1-1976-4767-8b06-851162dbb925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:38.207375 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-774c54c1-1976-4767-8b06-851162dbb925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:38.207813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-774c54c1-1976-4767-8b06-851162dbb925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:38.337569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-774c54c1-1976-4767-8b06-851162dbb925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:38.346568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-774c54c1-1976-4767-8b06-851162dbb925 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.151392 Jul 21 22:20:38.347201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 666/1203] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:38 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:38.644417 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bfbd5541-950e-45c8-ada6-79a43779e93b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:38.645032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bfbd5541-950e-45c8-ada6-79a43779e93b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:38.651082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bfbd5541-950e-45c8-ada6-79a43779e93b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:38.651543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bfbd5541-950e-45c8-ada6-79a43779e93b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:38.652317 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bfbd5541-950e-45c8-ada6-79a43779e93b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:38.652760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bfbd5541-950e-45c8-ada6-79a43779e93b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:38.783270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bfbd5541-950e-45c8-ada6-79a43779e93b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:38.791146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bfbd5541-950e-45c8-ada6-79a43779e93b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.151092 Jul 21 22:20:38.791711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 538/1204] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:38 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:39.172154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-323a3372-11b7-4a90-94ca-2da4b624e34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:39.172759 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-323a3372-11b7-4a90-94ca-2da4b624e34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:39.178967 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-323a3372-11b7-4a90-94ca-2da4b624e34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:39.179728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-323a3372-11b7-4a90-94ca-2da4b624e34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:39.180740 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-323a3372-11b7-4a90-94ca-2da4b624e34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:39.181174 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-323a3372-11b7-4a90-94ca-2da4b624e34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:39.247226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-323a3372-11b7-4a90-94ca-2da4b624e34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:39.256140 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-323a3372-11b7-4a90-94ca-2da4b624e34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.088265 Jul 21 22:20:39.257109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 667/1205] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:39 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:39.363958 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ef6042c4-5346-4ff2-8965-aa78c8146177 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:39.364565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ef6042c4-5346-4ff2-8965-aa78c8146177 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:39.370980 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ef6042c4-5346-4ff2-8965-aa78c8146177 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:39.371453 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ef6042c4-5346-4ff2-8965-aa78c8146177 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:39.372238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ef6042c4-5346-4ff2-8965-aa78c8146177 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:39.372674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ef6042c4-5346-4ff2-8965-aa78c8146177 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:39.377356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:39.504342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ef6042c4-5346-4ff2-8965-aa78c8146177 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:39.512325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ef6042c4-5346-4ff2-8965-aa78c8146177 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152202 Jul 21 22:20:39.512888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 539/1206] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:39 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:39.808159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2fd11262-fa5e-4e10-a227-663ce4951783 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:39.808692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2fd11262-fa5e-4e10-a227-663ce4951783 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:39.815327 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2fd11262-fa5e-4e10-a227-663ce4951783 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:39.815774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2fd11262-fa5e-4e10-a227-663ce4951783 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:39.816531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2fd11262-fa5e-4e10-a227-663ce4951783 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:39.816961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2fd11262-fa5e-4e10-a227-663ce4951783 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:39.947323 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2fd11262-fa5e-4e10-a227-663ce4951783 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:39.955236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2fd11262-fa5e-4e10-a227-663ce4951783 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.151005 Jul 21 22:20:39.955797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 668/1207] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:39 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:40.272718 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7f43ef10-abf5-4306-a12b-7bfd80b016cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:40.273450 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7f43ef10-abf5-4306-a12b-7bfd80b016cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:40.279552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f43ef10-abf5-4306-a12b-7bfd80b016cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:40.280002 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f43ef10-abf5-4306-a12b-7bfd80b016cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:40.281269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f43ef10-abf5-4306-a12b-7bfd80b016cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:40.281710 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f43ef10-abf5-4306-a12b-7bfd80b016cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:40.345267 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7f43ef10-abf5-4306-a12b-7bfd80b016cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:40.353485 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7f43ef10-abf5-4306-a12b-7bfd80b016cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084642 Jul 21 22:20:40.354047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 540/1208] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:40 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:40.529327 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-41cfb9d4-f2ea-4e0a-a98f-c255f4314226 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:40.529941 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-41cfb9d4-f2ea-4e0a-a98f-c255f4314226 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:40.537016 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41cfb9d4-f2ea-4e0a-a98f-c255f4314226 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:40.537471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41cfb9d4-f2ea-4e0a-a98f-c255f4314226 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:40.538246 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41cfb9d4-f2ea-4e0a-a98f-c255f4314226 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:40.538685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41cfb9d4-f2ea-4e0a-a98f-c255f4314226 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:40.665279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-41cfb9d4-f2ea-4e0a-a98f-c255f4314226 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:40.673239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-41cfb9d4-f2ea-4e0a-a98f-c255f4314226 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147795 Jul 21 22:20:40.673810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 669/1209] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:40 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:40.973511 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a83e18e8-b959-406f-9777-0eae13114086 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:40.974104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a83e18e8-b959-406f-9777-0eae13114086 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:40.980601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a83e18e8-b959-406f-9777-0eae13114086 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:40.981047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a83e18e8-b959-406f-9777-0eae13114086 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:40.981811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a83e18e8-b959-406f-9777-0eae13114086 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:40.982246 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a83e18e8-b959-406f-9777-0eae13114086 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:41.109096 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a83e18e8-b959-406f-9777-0eae13114086 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:41.119887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a83e18e8-b959-406f-9777-0eae13114086 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150509 Jul 21 22:20:41.120474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 541/1210] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:40 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:41.371063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-775dd0c7-e506-4b8c-9d47-3f26a47baeda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:41.371593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-775dd0c7-e506-4b8c-9d47-3f26a47baeda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:41.378232 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-775dd0c7-e506-4b8c-9d47-3f26a47baeda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:41.378681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-775dd0c7-e506-4b8c-9d47-3f26a47baeda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:41.379478 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-775dd0c7-e506-4b8c-9d47-3f26a47baeda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:41.379918 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-775dd0c7-e506-4b8c-9d47-3f26a47baeda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:41.441756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-775dd0c7-e506-4b8c-9d47-3f26a47baeda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:41.449555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-775dd0c7-e506-4b8c-9d47-3f26a47baeda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082442 Jul 21 22:20:41.450115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 670/1211] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:41 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:41.690793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-28e63279-8e96-435d-9dfe-2572be62eae5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:41.691437 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-28e63279-8e96-435d-9dfe-2572be62eae5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:41.697456 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-28e63279-8e96-435d-9dfe-2572be62eae5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:41.697915 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-28e63279-8e96-435d-9dfe-2572be62eae5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:41.698698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-28e63279-8e96-435d-9dfe-2572be62eae5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:41.699174 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-28e63279-8e96-435d-9dfe-2572be62eae5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:41.825873 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-28e63279-8e96-435d-9dfe-2572be62eae5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:41.833773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-28e63279-8e96-435d-9dfe-2572be62eae5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147505 Jul 21 22:20:41.834337 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 542/1212] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:41 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:42.137248 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f1967e74-2694-4004-a936-e85fa8456a33 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:42.138244 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f1967e74-2694-4004-a936-e85fa8456a33 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:42.145666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1967e74-2694-4004-a936-e85fa8456a33 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:42.146113 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1967e74-2694-4004-a936-e85fa8456a33 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:42.146876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1967e74-2694-4004-a936-e85fa8456a33 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:42.147337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1967e74-2694-4004-a936-e85fa8456a33 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:42.275408 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f1967e74-2694-4004-a936-e85fa8456a33 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:42.284308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f1967e74-2694-4004-a936-e85fa8456a33 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.151066 Jul 21 22:20:42.284874 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 671/1213] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:42 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:42.466342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8d86d229-b370-421b-8c1a-0ac95a7cdfe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:42.466903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8d86d229-b370-421b-8c1a-0ac95a7cdfe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:42.474325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8d86d229-b370-421b-8c1a-0ac95a7cdfe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:42.474775 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8d86d229-b370-421b-8c1a-0ac95a7cdfe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:42.475603 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8d86d229-b370-421b-8c1a-0ac95a7cdfe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:42.476076 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8d86d229-b370-421b-8c1a-0ac95a7cdfe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:42.541407 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8d86d229-b370-421b-8c1a-0ac95a7cdfe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:42.549419 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8d86d229-b370-421b-8c1a-0ac95a7cdfe2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.086960 Jul 21 22:20:42.549989 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 543/1214] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:42 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:42.851702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8f966d73-1fc7-4146-9c2a-6a865abb878f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:42.852264 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8f966d73-1fc7-4146-9c2a-6a865abb878f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:42.858223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f966d73-1fc7-4146-9c2a-6a865abb878f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:42.858676 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f966d73-1fc7-4146-9c2a-6a865abb878f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:42.859470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f966d73-1fc7-4146-9c2a-6a865abb878f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:42.859909 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f966d73-1fc7-4146-9c2a-6a865abb878f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:42.987692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8f966d73-1fc7-4146-9c2a-6a865abb878f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:42.995773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8f966d73-1fc7-4146-9c2a-6a865abb878f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148005 Jul 21 22:20:42.996334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 672/1215] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:42 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:43.302105 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5ab0aeb8-66ce-48f4-9f94-457551d73273 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:43.302739 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5ab0aeb8-66ce-48f4-9f94-457551d73273 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:43.308705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ab0aeb8-66ce-48f4-9f94-457551d73273 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:43.309156 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ab0aeb8-66ce-48f4-9f94-457551d73273 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:43.309919 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ab0aeb8-66ce-48f4-9f94-457551d73273 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:43.310356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ab0aeb8-66ce-48f4-9f94-457551d73273 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:43.434782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5ab0aeb8-66ce-48f4-9f94-457551d73273 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:43.443078 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5ab0aeb8-66ce-48f4-9f94-457551d73273 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.145146 Jul 21 22:20:43.443640 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 544/1216] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:43 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:43.566084 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c8e362e4-57b2-4b78-af17-0e6f41ca912d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:43.566635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c8e362e4-57b2-4b78-af17-0e6f41ca912d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:43.573087 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8e362e4-57b2-4b78-af17-0e6f41ca912d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:43.573535 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8e362e4-57b2-4b78-af17-0e6f41ca912d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:43.574296 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8e362e4-57b2-4b78-af17-0e6f41ca912d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:43.574735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8e362e4-57b2-4b78-af17-0e6f41ca912d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:43.640164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c8e362e4-57b2-4b78-af17-0e6f41ca912d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:43.647963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c8e362e4-57b2-4b78-af17-0e6f41ca912d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.086244 Jul 21 22:20:43.648530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 673/1217] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:43 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:44.012281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-177307b8-593f-479c-b0ae-66bbadaab829 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:44.012896 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-177307b8-593f-479c-b0ae-66bbadaab829 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:44.019459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-177307b8-593f-479c-b0ae-66bbadaab829 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:44.019915 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-177307b8-593f-479c-b0ae-66bbadaab829 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:44.020713 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-177307b8-593f-479c-b0ae-66bbadaab829 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:44.021152 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-177307b8-593f-479c-b0ae-66bbadaab829 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:44.150144 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-177307b8-593f-479c-b0ae-66bbadaab829 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:44.158586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-177307b8-593f-479c-b0ae-66bbadaab829 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.150195 Jul 21 22:20:44.159190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 545/1218] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:44 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:44.460587 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7e13ed65-3428-4c83-b52a-2687f466072b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:44.461202 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7e13ed65-3428-4c83-b52a-2687f466072b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:44.467310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7e13ed65-3428-4c83-b52a-2687f466072b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:44.467759 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7e13ed65-3428-4c83-b52a-2687f466072b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:44.469108 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7e13ed65-3428-4c83-b52a-2687f466072b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:44.469547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7e13ed65-3428-4c83-b52a-2687f466072b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:44.595665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7e13ed65-3428-4c83-b52a-2687f466072b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:44.603591 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7e13ed65-3428-4c83-b52a-2687f466072b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146810 Jul 21 22:20:44.604159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 674/1219] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:44 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:44.664452 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c4e9972d-2794-4f0f-b785-13a63c33229f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:44.665057 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c4e9972d-2794-4f0f-b785-13a63c33229f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:44.671076 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4e9972d-2794-4f0f-b785-13a63c33229f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:44.671535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4e9972d-2794-4f0f-b785-13a63c33229f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:44.672295 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4e9972d-2794-4f0f-b785-13a63c33229f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:44.672733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4e9972d-2794-4f0f-b785-13a63c33229f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:44.735064 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c4e9972d-2794-4f0f-b785-13a63c33229f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:44.742925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c4e9972d-2794-4f0f-b785-13a63c33229f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082297 Jul 21 22:20:44.743512 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 546/1220] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:44 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:45.179426 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-41d71335-3242-4fbc-ac8e-b87bbaf6c55b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:45.180144 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-41d71335-3242-4fbc-ac8e-b87bbaf6c55b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:45.187882 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41d71335-3242-4fbc-ac8e-b87bbaf6c55b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:45.188334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41d71335-3242-4fbc-ac8e-b87bbaf6c55b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:45.189110 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41d71335-3242-4fbc-ac8e-b87bbaf6c55b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:45.189548 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-41d71335-3242-4fbc-ac8e-b87bbaf6c55b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:45.315983 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-41d71335-3242-4fbc-ac8e-b87bbaf6c55b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:45.323869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-41d71335-3242-4fbc-ac8e-b87bbaf6c55b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.151142 Jul 21 22:20:45.324429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 675/1221] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:45 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:45.620627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a5856603-2777-4d9e-9ee4-200b8cadf927 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:45.621231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a5856603-2777-4d9e-9ee4-200b8cadf927 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:45.627663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5856603-2777-4d9e-9ee4-200b8cadf927 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:45.628114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5856603-2777-4d9e-9ee4-200b8cadf927 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:45.628872 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5856603-2777-4d9e-9ee4-200b8cadf927 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:45.629306 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5856603-2777-4d9e-9ee4-200b8cadf927 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:45.756056 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a5856603-2777-4d9e-9ee4-200b8cadf927 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:45.759896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-20a5f257-8a93-4ba1-be22-272182cef65b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:45.760503 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-20a5f257-8a93-4ba1-be22-272182cef65b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:45.764645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a5856603-2777-4d9e-9ee4-200b8cadf927 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148284 Jul 21 22:20:45.765220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 547/1222] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:45 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:45.767036 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-20a5f257-8a93-4ba1-be22-272182cef65b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:45.767495 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-20a5f257-8a93-4ba1-be22-272182cef65b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:45.768268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-20a5f257-8a93-4ba1-be22-272182cef65b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:45.768705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-20a5f257-8a93-4ba1-be22-272182cef65b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:45.772660 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:45.833474 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-20a5f257-8a93-4ba1-be22-272182cef65b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:45.841343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-20a5f257-8a93-4ba1-be22-272182cef65b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085299 Jul 21 22:20:45.841908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 676/1223] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:45 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:46.341170 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ac31eea4-f56a-4549-b901-fc05999ed40a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:46.341811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ac31eea4-f56a-4549-b901-fc05999ed40a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:46.348316 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac31eea4-f56a-4549-b901-fc05999ed40a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:46.348771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac31eea4-f56a-4549-b901-fc05999ed40a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:46.349542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac31eea4-f56a-4549-b901-fc05999ed40a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:46.349985 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac31eea4-f56a-4549-b901-fc05999ed40a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:46.476762 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ac31eea4-f56a-4549-b901-fc05999ed40a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:46.484945 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ac31eea4-f56a-4549-b901-fc05999ed40a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147606 Jul 21 22:20:46.485519 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 548/1224] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:46 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:46.781842 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dfe7cc41-8ac4-46f4-ba01-5e0a52231491 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:46.782457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dfe7cc41-8ac4-46f4-ba01-5e0a52231491 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:46.789055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dfe7cc41-8ac4-46f4-ba01-5e0a52231491 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:46.789507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dfe7cc41-8ac4-46f4-ba01-5e0a52231491 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:46.790280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dfe7cc41-8ac4-46f4-ba01-5e0a52231491 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:46.790719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dfe7cc41-8ac4-46f4-ba01-5e0a52231491 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:46.858893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fcea7e76-ae9f-429d-b8e8-75ce76e4c3d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:46.860077 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fcea7e76-ae9f-429d-b8e8-75ce76e4c3d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:46.866442 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fcea7e76-ae9f-429d-b8e8-75ce76e4c3d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:46.867362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fcea7e76-ae9f-429d-b8e8-75ce76e4c3d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:46.867741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fcea7e76-ae9f-429d-b8e8-75ce76e4c3d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:46.868189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fcea7e76-ae9f-429d-b8e8-75ce76e4c3d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:46.943250 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fcea7e76-ae9f-429d-b8e8-75ce76e4c3d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:46.946363 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dfe7cc41-8ac4-46f4-ba01-5e0a52231491 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:46.951201 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fcea7e76-ae9f-429d-b8e8-75ce76e4c3d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.096140 Jul 21 22:20:46.951862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 549/1225] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:46 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:46.954479 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dfe7cc41-8ac4-46f4-ba01-5e0a52231491 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.176518 Jul 21 22:20:46.955157 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 677/1226] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:46 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:47.505478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ee5392ff-216f-4699-9fc0-57703cf4f389 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:47.506079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ee5392ff-216f-4699-9fc0-57703cf4f389 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:47.512059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee5392ff-216f-4699-9fc0-57703cf4f389 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:47.512510 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee5392ff-216f-4699-9fc0-57703cf4f389 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:47.513278 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee5392ff-216f-4699-9fc0-57703cf4f389 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:47.513714 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee5392ff-216f-4699-9fc0-57703cf4f389 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:47.640080 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ee5392ff-216f-4699-9fc0-57703cf4f389 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:47.648430 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ee5392ff-216f-4699-9fc0-57703cf4f389 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146827 Jul 21 22:20:47.648993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 550/1227] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:47 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:47.970359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c8035071-63ff-435d-9b7d-fba639080e93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:47.971271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c8035071-63ff-435d-9b7d-fba639080e93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:47.972053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-36d2d778-6c75-4b61-acca-bb8441a26ba6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:47.972717 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-36d2d778-6c75-4b61-acca-bb8441a26ba6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:47.977818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8035071-63ff-435d-9b7d-fba639080e93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:47.978271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8035071-63ff-435d-9b7d-fba639080e93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:47.979065 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8035071-63ff-435d-9b7d-fba639080e93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:47.979276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36d2d778-6c75-4b61-acca-bb8441a26ba6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:47.979552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8035071-63ff-435d-9b7d-fba639080e93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:47.979665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36d2d778-6c75-4b61-acca-bb8441a26ba6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:47.980466 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36d2d778-6c75-4b61-acca-bb8441a26ba6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:47.980903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36d2d778-6c75-4b61-acca-bb8441a26ba6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:48.049684 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c8035071-63ff-435d-9b7d-fba639080e93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:48.057648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c8035071-63ff-435d-9b7d-fba639080e93 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.091112 Jul 21 22:20:48.058218 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 678/1228] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:47 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:48.136630 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-36d2d778-6c75-4b61-acca-bb8441a26ba6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:48.144883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-36d2d778-6c75-4b61-acca-bb8441a26ba6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.177318 Jul 21 22:20:48.145540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 551/1229] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:47 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:48.665618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-be3756b8-0f7c-46d0-a32f-88c3c72178ed tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:48.666228 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-be3756b8-0f7c-46d0-a32f-88c3c72178ed tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:48.672877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-be3756b8-0f7c-46d0-a32f-88c3c72178ed tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:48.673325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-be3756b8-0f7c-46d0-a32f-88c3c72178ed tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:48.674109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-be3756b8-0f7c-46d0-a32f-88c3c72178ed tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:48.674547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-be3756b8-0f7c-46d0-a32f-88c3c72178ed tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:48.802915 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-be3756b8-0f7c-46d0-a32f-88c3c72178ed tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:48.810779 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-be3756b8-0f7c-46d0-a32f-88c3c72178ed tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149008 Jul 21 22:20:48.811387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 679/1230] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:48 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:49.075302 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-19256874-9597-447a-9645-da0e5a3d0dd7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:49.075892 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-19256874-9597-447a-9645-da0e5a3d0dd7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:49.083035 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19256874-9597-447a-9645-da0e5a3d0dd7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:49.083493 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19256874-9597-447a-9645-da0e5a3d0dd7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:49.084285 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19256874-9597-447a-9645-da0e5a3d0dd7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:49.084725 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19256874-9597-447a-9645-da0e5a3d0dd7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:49.145620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-19256874-9597-447a-9645-da0e5a3d0dd7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:49.153455 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-19256874-9597-447a-9645-da0e5a3d0dd7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082407 Jul 21 22:20:49.154013 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 552/1231] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:49 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:49.162331 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2deec689-6271-4d03-8b68-dda971735c26 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:49.163046 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2deec689-6271-4d03-8b68-dda971735c26 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:49.170018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2deec689-6271-4d03-8b68-dda971735c26 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:49.170465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2deec689-6271-4d03-8b68-dda971735c26 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:49.171270 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2deec689-6271-4d03-8b68-dda971735c26 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:49.171700 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2deec689-6271-4d03-8b68-dda971735c26 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:49.300778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2deec689-6271-4d03-8b68-dda971735c26 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:49.308735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2deec689-6271-4d03-8b68-dda971735c26 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150238 Jul 21 22:20:49.309296 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 680/1232] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:49 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:49.827936 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b7a17e39-b2b3-45fd-9c93-c4eb96598a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:49.828497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b7a17e39-b2b3-45fd-9c93-c4eb96598a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:49.834703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b7a17e39-b2b3-45fd-9c93-c4eb96598a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:49.835183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b7a17e39-b2b3-45fd-9c93-c4eb96598a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:49.835944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b7a17e39-b2b3-45fd-9c93-c4eb96598a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:49.836378 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b7a17e39-b2b3-45fd-9c93-c4eb96598a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:49.963671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b7a17e39-b2b3-45fd-9c93-c4eb96598a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:49.972190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b7a17e39-b2b3-45fd-9c93-c4eb96598a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148143 Jul 21 22:20:49.972756 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 553/1233] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:49 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:50.172473 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1aba235d-6627-4db5-87b5-a93c2959f93c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:50.173102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1aba235d-6627-4db5-87b5-a93c2959f93c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:50.181441 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1aba235d-6627-4db5-87b5-a93c2959f93c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:50.181441 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1aba235d-6627-4db5-87b5-a93c2959f93c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:50.181809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1aba235d-6627-4db5-87b5-a93c2959f93c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:50.182241 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1aba235d-6627-4db5-87b5-a93c2959f93c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:50.242826 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1aba235d-6627-4db5-87b5-a93c2959f93c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:50.250622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1aba235d-6627-4db5-87b5-a93c2959f93c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083088 Jul 21 22:20:50.251201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 681/1234] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:50 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:50.325725 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3fa94cdc-3d62-46c2-86c8-68a3075a4fac tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:50.326367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3fa94cdc-3d62-46c2-86c8-68a3075a4fac tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:50.333326 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3fa94cdc-3d62-46c2-86c8-68a3075a4fac tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:50.333768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3fa94cdc-3d62-46c2-86c8-68a3075a4fac tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:50.334533 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3fa94cdc-3d62-46c2-86c8-68a3075a4fac tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:50.334971 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3fa94cdc-3d62-46c2-86c8-68a3075a4fac tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:50.687171 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3fa94cdc-3d62-46c2-86c8-68a3075a4fac tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:50.695554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3fa94cdc-3d62-46c2-86c8-68a3075a4fac tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.373642 Jul 21 22:20:50.696126 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 554/1235] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:50 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:50.989074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-086bba8d-0533-49c1-98cd-a7cba376b0ee tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:50.989713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-086bba8d-0533-49c1-98cd-a7cba376b0ee tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:50.995827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-086bba8d-0533-49c1-98cd-a7cba376b0ee tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:50.996264 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-086bba8d-0533-49c1-98cd-a7cba376b0ee tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:50.997021 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-086bba8d-0533-49c1-98cd-a7cba376b0ee tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:50.997452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-086bba8d-0533-49c1-98cd-a7cba376b0ee tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:51.123350 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-086bba8d-0533-49c1-98cd-a7cba376b0ee tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:51.131727 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-086bba8d-0533-49c1-98cd-a7cba376b0ee tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146512 Jul 21 22:20:51.132287 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 682/1236] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:50 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:51.267564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c3aed1ce-76ec-4f7b-8c7c-d38e7e3b13c5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:51.268100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c3aed1ce-76ec-4f7b-8c7c-d38e7e3b13c5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:51.274209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c3aed1ce-76ec-4f7b-8c7c-d38e7e3b13c5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:51.274663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c3aed1ce-76ec-4f7b-8c7c-d38e7e3b13c5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:51.275460 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c3aed1ce-76ec-4f7b-8c7c-d38e7e3b13c5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:51.275898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c3aed1ce-76ec-4f7b-8c7c-d38e7e3b13c5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:51.339074 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c3aed1ce-76ec-4f7b-8c7c-d38e7e3b13c5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:51.342424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:51.348034 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c3aed1ce-76ec-4f7b-8c7c-d38e7e3b13c5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084480 Jul 21 22:20:51.348598 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 555/1237] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:51 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:51.712734 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c8f76005-4536-40ca-aa04-57c105a6e899 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:51.713378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c8f76005-4536-40ca-aa04-57c105a6e899 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:51.720635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8f76005-4536-40ca-aa04-57c105a6e899 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:51.721096 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8f76005-4536-40ca-aa04-57c105a6e899 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:51.721869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8f76005-4536-40ca-aa04-57c105a6e899 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:51.722308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c8f76005-4536-40ca-aa04-57c105a6e899 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:51.847980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c8f76005-4536-40ca-aa04-57c105a6e899 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:51.855871 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c8f76005-4536-40ca-aa04-57c105a6e899 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147035 Jul 21 22:20:51.856451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 683/1238] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:51 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:52.148887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-880b0b34-b3bb-4890-bdf7-271da876785f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:52.149506 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-880b0b34-b3bb-4890-bdf7-271da876785f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:52.155537 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-880b0b34-b3bb-4890-bdf7-271da876785f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:52.155995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-880b0b34-b3bb-4890-bdf7-271da876785f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:52.157335 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-880b0b34-b3bb-4890-bdf7-271da876785f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:52.157809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-880b0b34-b3bb-4890-bdf7-271da876785f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:52.289392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-880b0b34-b3bb-4890-bdf7-271da876785f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:52.297252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-880b0b34-b3bb-4890-bdf7-271da876785f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152460 Jul 21 22:20:52.297820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 556/1239] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:52 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:52.364169 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0bb0966d-9545-4989-8227-f21ecba158fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:52.364779 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0bb0966d-9545-4989-8227-f21ecba158fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:52.370697 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0bb0966d-9545-4989-8227-f21ecba158fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:52.371188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0bb0966d-9545-4989-8227-f21ecba158fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:52.371959 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0bb0966d-9545-4989-8227-f21ecba158fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:52.372394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0bb0966d-9545-4989-8227-f21ecba158fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:52.434933 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0bb0966d-9545-4989-8227-f21ecba158fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:52.443642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0bb0966d-9545-4989-8227-f21ecba158fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083332 Jul 21 22:20:52.444211 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 684/1240] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:52 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:52.873023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b24d7bca-5a5d-4102-bbed-7b6e65f87a91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:52.873557 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b24d7bca-5a5d-4102-bbed-7b6e65f87a91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:52.880666 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b24d7bca-5a5d-4102-bbed-7b6e65f87a91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:52.881113 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b24d7bca-5a5d-4102-bbed-7b6e65f87a91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:52.881876 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b24d7bca-5a5d-4102-bbed-7b6e65f87a91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:52.882331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b24d7bca-5a5d-4102-bbed-7b6e65f87a91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:53.009123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b24d7bca-5a5d-4102-bbed-7b6e65f87a91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:53.016971 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b24d7bca-5a5d-4102-bbed-7b6e65f87a91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147873 Jul 21 22:20:53.017538 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 557/1241] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:52 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:53.314089 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9817d7be-6815-4b4a-b1af-53c052ff7733 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:53.314724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9817d7be-6815-4b4a-b1af-53c052ff7733 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:53.321176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9817d7be-6815-4b4a-b1af-53c052ff7733 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:53.321629 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9817d7be-6815-4b4a-b1af-53c052ff7733 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:53.322389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9817d7be-6815-4b4a-b1af-53c052ff7733 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:53.322825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9817d7be-6815-4b4a-b1af-53c052ff7733 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:53.450327 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9817d7be-6815-4b4a-b1af-53c052ff7733 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:53.459115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9817d7be-6815-4b4a-b1af-53c052ff7733 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148813 Jul 21 22:20:53.459704 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 685/1242] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:53 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:53.461120 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-30e0307c-ec9f-4edf-9264-e2538c727445 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:53.461819 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-30e0307c-ec9f-4edf-9264-e2538c727445 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:53.468276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30e0307c-ec9f-4edf-9264-e2538c727445 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:53.469393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30e0307c-ec9f-4edf-9264-e2538c727445 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:53.470329 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30e0307c-ec9f-4edf-9264-e2538c727445 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:53.471067 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30e0307c-ec9f-4edf-9264-e2538c727445 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:53.535281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-30e0307c-ec9f-4edf-9264-e2538c727445 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:53.543065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-30e0307c-ec9f-4edf-9264-e2538c727445 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.086400 Jul 21 22:20:53.543632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 558/1243] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:53 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:54.033608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f3d786b2-de04-4ccd-8d92-e2dee2ace00f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:54.034236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f3d786b2-de04-4ccd-8d92-e2dee2ace00f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:54.040400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f3d786b2-de04-4ccd-8d92-e2dee2ace00f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:54.040854 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f3d786b2-de04-4ccd-8d92-e2dee2ace00f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:54.041625 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f3d786b2-de04-4ccd-8d92-e2dee2ace00f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:54.042063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f3d786b2-de04-4ccd-8d92-e2dee2ace00f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:54.169606 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f3d786b2-de04-4ccd-8d92-e2dee2ace00f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:54.178223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f3d786b2-de04-4ccd-8d92-e2dee2ace00f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148403 Jul 21 22:20:54.178792 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 686/1244] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:54 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:54.476426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ad1f0660-6657-45fa-8cee-29231d8d2692 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:54.477068 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ad1f0660-6657-45fa-8cee-29231d8d2692 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:54.483823 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad1f0660-6657-45fa-8cee-29231d8d2692 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:54.485074 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad1f0660-6657-45fa-8cee-29231d8d2692 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:54.485854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad1f0660-6657-45fa-8cee-29231d8d2692 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:54.486297 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad1f0660-6657-45fa-8cee-29231d8d2692 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:54.559362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d77fc648-aafa-47a1-8e09-44fd915e4dba tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:54.559980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d77fc648-aafa-47a1-8e09-44fd915e4dba tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:54.567316 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d77fc648-aafa-47a1-8e09-44fd915e4dba tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:54.567793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d77fc648-aafa-47a1-8e09-44fd915e4dba tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:54.568693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d77fc648-aafa-47a1-8e09-44fd915e4dba tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:54.569130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d77fc648-aafa-47a1-8e09-44fd915e4dba tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:54.630204 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ad1f0660-6657-45fa-8cee-29231d8d2692 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:54.638198 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ad1f0660-6657-45fa-8cee-29231d8d2692 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.165652 Jul 21 22:20:54.638778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 559/1245] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:54 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:54.646084 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d77fc648-aafa-47a1-8e09-44fd915e4dba tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:54.653874 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d77fc648-aafa-47a1-8e09-44fd915e4dba tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.098528 Jul 21 22:20:54.654419 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 687/1246] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:54 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:55.195776 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-520bd4eb-0ef5-449f-834a-0c265b2c1df9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:55.196392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-520bd4eb-0ef5-449f-834a-0c265b2c1df9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:55.202309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-520bd4eb-0ef5-449f-834a-0c265b2c1df9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:55.203430 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-520bd4eb-0ef5-449f-834a-0c265b2c1df9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:55.204216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-520bd4eb-0ef5-449f-834a-0c265b2c1df9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:55.204661 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-520bd4eb-0ef5-449f-834a-0c265b2c1df9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:55.332685 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-520bd4eb-0ef5-449f-834a-0c265b2c1df9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:55.340654 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-520bd4eb-0ef5-449f-834a-0c265b2c1df9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148794 Jul 21 22:20:55.341234 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 560/1247] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:55 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:55.655308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b790f879-5d0a-417b-9c5f-c3937f66c413 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:55.655955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b790f879-5d0a-417b-9c5f-c3937f66c413 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:55.658221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:55.663510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b790f879-5d0a-417b-9c5f-c3937f66c413 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:55.663956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b790f879-5d0a-417b-9c5f-c3937f66c413 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:55.664754 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b790f879-5d0a-417b-9c5f-c3937f66c413 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:55.665187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b790f879-5d0a-417b-9c5f-c3937f66c413 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:55.672522 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ab5c6b4c-5a53-49a9-ae8f-99ea27cd4045 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:55.673142 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ab5c6b4c-5a53-49a9-ae8f-99ea27cd4045 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:55.675522 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:55.681017 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ab5c6b4c-5a53-49a9-ae8f-99ea27cd4045 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:55.681471 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ab5c6b4c-5a53-49a9-ae8f-99ea27cd4045 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:55.682348 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ab5c6b4c-5a53-49a9-ae8f-99ea27cd4045 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:55.682795 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ab5c6b4c-5a53-49a9-ae8f-99ea27cd4045 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:55.763845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ab5c6b4c-5a53-49a9-ae8f-99ea27cd4045 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:55.771765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ab5c6b4c-5a53-49a9-ae8f-99ea27cd4045 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.103781 Jul 21 22:20:55.772711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 561/1248] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:55 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:55.822606 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b790f879-5d0a-417b-9c5f-c3937f66c413 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:55.830615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b790f879-5d0a-417b-9c5f-c3937f66c413 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.179282 Jul 21 22:20:55.831219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 688/1249] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:55 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:56.357804 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b259d5ad-0412-4377-8743-b5ae6a31b3f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:56.358430 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b259d5ad-0412-4377-8743-b5ae6a31b3f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:56.364951 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b259d5ad-0412-4377-8743-b5ae6a31b3f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:56.365396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b259d5ad-0412-4377-8743-b5ae6a31b3f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:56.366171 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b259d5ad-0412-4377-8743-b5ae6a31b3f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:56.366583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b259d5ad-0412-4377-8743-b5ae6a31b3f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:56.492911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b259d5ad-0412-4377-8743-b5ae6a31b3f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:56.500885 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b259d5ad-0412-4377-8743-b5ae6a31b3f1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146761 Jul 21 22:20:56.501457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 562/1250] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:56 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:56.788101 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b18f713a-952b-4bbc-9ac3-34b94c3bcf00 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:56.788706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b18f713a-952b-4bbc-9ac3-34b94c3bcf00 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:56.794649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b18f713a-952b-4bbc-9ac3-34b94c3bcf00 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:56.795128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b18f713a-952b-4bbc-9ac3-34b94c3bcf00 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:56.795893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b18f713a-952b-4bbc-9ac3-34b94c3bcf00 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:56.796322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b18f713a-952b-4bbc-9ac3-34b94c3bcf00 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:56.847742 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-264e4e0b-cf99-4cc9-8b80-60f33e9618ad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:56.848443 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-264e4e0b-cf99-4cc9-8b80-60f33e9618ad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:56.854556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-264e4e0b-cf99-4cc9-8b80-60f33e9618ad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:56.855394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-264e4e0b-cf99-4cc9-8b80-60f33e9618ad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:56.855796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-264e4e0b-cf99-4cc9-8b80-60f33e9618ad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:56.856232 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-264e4e0b-cf99-4cc9-8b80-60f33e9618ad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:56.857351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b18f713a-952b-4bbc-9ac3-34b94c3bcf00 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:56.865253 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b18f713a-952b-4bbc-9ac3-34b94c3bcf00 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081242 Jul 21 22:20:56.865859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 689/1251] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:56 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:56.985793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-264e4e0b-cf99-4cc9-8b80-60f33e9618ad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:56.993818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-264e4e0b-cf99-4cc9-8b80-60f33e9618ad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.150061 Jul 21 22:20:56.994327 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 563/1252] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:56 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:20:57.518693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-69a1a23a-5433-424f-8c3a-901c42164d38 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:57.519330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-69a1a23a-5433-424f-8c3a-901c42164d38 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:57.525371 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69a1a23a-5433-424f-8c3a-901c42164d38 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:57.525821 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69a1a23a-5433-424f-8c3a-901c42164d38 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:57.526590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69a1a23a-5433-424f-8c3a-901c42164d38 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:57.527052 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69a1a23a-5433-424f-8c3a-901c42164d38 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:57.659777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-69a1a23a-5433-424f-8c3a-901c42164d38 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:57.667623 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-69a1a23a-5433-424f-8c3a-901c42164d38 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.153087 Jul 21 22:20:57.668189 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 690/1253] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:57 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:57.883073 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f9e1154f-954d-4313-a400-53272a6f58f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:57.883712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f9e1154f-954d-4313-a400-53272a6f58f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:57.890767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9e1154f-954d-4313-a400-53272a6f58f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:57.891248 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9e1154f-954d-4313-a400-53272a6f58f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:57.892105 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9e1154f-954d-4313-a400-53272a6f58f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:57.892915 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9e1154f-954d-4313-a400-53272a6f58f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:57.975632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f9e1154f-954d-4313-a400-53272a6f58f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:57.983598 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f9e1154f-954d-4313-a400-53272a6f58f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.104610 Jul 21 22:20:57.984436 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 564/1254] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:57 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:58.011226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f857bd2c-f576-4b4a-9e5f-6e38a1c702bb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:58.011837 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f857bd2c-f576-4b4a-9e5f-6e38a1c702bb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:58.018647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f857bd2c-f576-4b4a-9e5f-6e38a1c702bb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:58.019134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f857bd2c-f576-4b4a-9e5f-6e38a1c702bb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:58.019999 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f857bd2c-f576-4b4a-9e5f-6e38a1c702bb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:58.020339 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f857bd2c-f576-4b4a-9e5f-6e38a1c702bb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:58.146537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f857bd2c-f576-4b4a-9e5f-6e38a1c702bb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:58.154414 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f857bd2c-f576-4b4a-9e5f-6e38a1c702bb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147041 Jul 21 22:20:58.154973 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 691/1255] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:58 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:58.685316 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5abad1c1-41ee-40e2-a66b-94ebce238667 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:58.685920 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5abad1c1-41ee-40e2-a66b-94ebce238667 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:58.692605 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5abad1c1-41ee-40e2-a66b-94ebce238667 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:58.693054 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5abad1c1-41ee-40e2-a66b-94ebce238667 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:58.693817 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5abad1c1-41ee-40e2-a66b-94ebce238667 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:58.694253 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5abad1c1-41ee-40e2-a66b-94ebce238667 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:58.819220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5abad1c1-41ee-40e2-a66b-94ebce238667 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:58.827120 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5abad1c1-41ee-40e2-a66b-94ebce238667 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.145630 Jul 21 22:20:58.827690 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 565/1256] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:58 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:59.000521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-36190a4b-c2e1-450a-bdde-da7140873d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:59.001124 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-36190a4b-c2e1-450a-bdde-da7140873d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:59.007154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-36190a4b-c2e1-450a-bdde-da7140873d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:59.007603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-36190a4b-c2e1-450a-bdde-da7140873d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:59.008358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-36190a4b-c2e1-450a-bdde-da7140873d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:59.008788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-36190a4b-c2e1-450a-bdde-da7140873d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:59.072502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-36190a4b-c2e1-450a-bdde-da7140873d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:59.076237 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:20:59.081650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-36190a4b-c2e1-450a-bdde-da7140873d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085037 Jul 21 22:20:59.082244 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 692/1257] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:58 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:59.172272 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5e73797b-a6a2-4781-996b-25c79d31279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:59.172897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5e73797b-a6a2-4781-996b-25c79d31279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:59.179353 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e73797b-a6a2-4781-996b-25c79d31279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:59.179798 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e73797b-a6a2-4781-996b-25c79d31279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:59.180556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e73797b-a6a2-4781-996b-25c79d31279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:59.180993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e73797b-a6a2-4781-996b-25c79d31279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:59.307854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5e73797b-a6a2-4781-996b-25c79d31279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:59.315814 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5e73797b-a6a2-4781-996b-25c79d31279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148120 Jul 21 22:20:59.316388 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 566/1258] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:59 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:20:59.629467 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:20:59.629662 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:20:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:20:59.843427 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-088c7993-8064-4080-b1e0-110106720fc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:20:59.843951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-088c7993-8064-4080-b1e0-110106720fc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:20:59.850316 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-088c7993-8064-4080-b1e0-110106720fc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:59.850759 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-088c7993-8064-4080-b1e0-110106720fc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:59.851539 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-088c7993-8064-4080-b1e0-110106720fc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:20:59.851971 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-088c7993-8064-4080-b1e0-110106720fc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:20:59.977738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-088c7993-8064-4080-b1e0-110106720fc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:20:59.985526 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-088c7993-8064-4080-b1e0-110106720fc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.145967 Jul 21 22:20:59.986088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 693/1259] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:20:59 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:00.098041 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9769fdc9-e477-4224-a598-66a2c0743fda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:00.098577 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9769fdc9-e477-4224-a598-66a2c0743fda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:00.104629 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9769fdc9-e477-4224-a598-66a2c0743fda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:00.105082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9769fdc9-e477-4224-a598-66a2c0743fda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:00.105854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9769fdc9-e477-4224-a598-66a2c0743fda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:00.106291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9769fdc9-e477-4224-a598-66a2c0743fda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:00.169551 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9769fdc9-e477-4224-a598-66a2c0743fda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:00.178604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9769fdc9-e477-4224-a598-66a2c0743fda tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084896 Jul 21 22:21:00.179356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 567/1260] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:00 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:00.331911 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ad086d0d-7276-4a10-af04-3677b8a3c95f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:00.332516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ad086d0d-7276-4a10-af04-3677b8a3c95f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:00.338898 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ad086d0d-7276-4a10-af04-3677b8a3c95f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:00.339371 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ad086d0d-7276-4a10-af04-3677b8a3c95f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:00.340138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ad086d0d-7276-4a10-af04-3677b8a3c95f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:00.340569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ad086d0d-7276-4a10-af04-3677b8a3c95f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:00.468627 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ad086d0d-7276-4a10-af04-3677b8a3c95f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:00.476969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ad086d0d-7276-4a10-af04-3677b8a3c95f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148957 Jul 21 22:21:00.477535 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 694/1261] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:00 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:01.002418 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-627c0f8d-f044-4db5-b8d7-483548fce429 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:01.003046 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-627c0f8d-f044-4db5-b8d7-483548fce429 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:01.009059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-627c0f8d-f044-4db5-b8d7-483548fce429 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:01.009504 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-627c0f8d-f044-4db5-b8d7-483548fce429 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:01.010260 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-627c0f8d-f044-4db5-b8d7-483548fce429 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:01.010695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-627c0f8d-f044-4db5-b8d7-483548fce429 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:01.137328 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-627c0f8d-f044-4db5-b8d7-483548fce429 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:01.145691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-627c0f8d-f044-4db5-b8d7-483548fce429 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147108 Jul 21 22:21:01.146266 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 568/1262] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:00 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:01.196031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a3a1005c-60a8-4a93-91a0-49226bc827a3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:01.196634 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a3a1005c-60a8-4a93-91a0-49226bc827a3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:01.202645 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3a1005c-60a8-4a93-91a0-49226bc827a3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:01.203679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3a1005c-60a8-4a93-91a0-49226bc827a3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:01.204433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3a1005c-60a8-4a93-91a0-49226bc827a3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:01.204866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3a1005c-60a8-4a93-91a0-49226bc827a3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:01.267963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a3a1005c-60a8-4a93-91a0-49226bc827a3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:01.275735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a3a1005c-60a8-4a93-91a0-49226bc827a3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083619 Jul 21 22:21:01.276298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 695/1263] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:01 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:01.494336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-10f905b9-0f2e-4f95-a3ff-35982dff91d4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:01.494966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-10f905b9-0f2e-4f95-a3ff-35982dff91d4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:01.501993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-10f905b9-0f2e-4f95-a3ff-35982dff91d4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:01.502441 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-10f905b9-0f2e-4f95-a3ff-35982dff91d4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:01.503240 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-10f905b9-0f2e-4f95-a3ff-35982dff91d4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:01.503678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-10f905b9-0f2e-4f95-a3ff-35982dff91d4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:01.631916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-10f905b9-0f2e-4f95-a3ff-35982dff91d4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:01.639799 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-10f905b9-0f2e-4f95-a3ff-35982dff91d4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149292 Jul 21 22:21:01.640362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 569/1264] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:01 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:02.162400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-874b8601-0bb4-43d7-b4a9-41d06881215b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:02.163028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-874b8601-0bb4-43d7-b4a9-41d06881215b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:02.169472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-874b8601-0bb4-43d7-b4a9-41d06881215b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:02.169924 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-874b8601-0bb4-43d7-b4a9-41d06881215b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:02.170692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-874b8601-0bb4-43d7-b4a9-41d06881215b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:02.171166 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-874b8601-0bb4-43d7-b4a9-41d06881215b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:02.292601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-273067e3-5d96-4544-a556-a803d92ebd72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:02.293231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-273067e3-5d96-4544-a556-a803d92ebd72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:02.297942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-874b8601-0bb4-43d7-b4a9-41d06881215b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:02.299733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-273067e3-5d96-4544-a556-a803d92ebd72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:02.300188 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-273067e3-5d96-4544-a556-a803d92ebd72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:02.300971 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-273067e3-5d96-4544-a556-a803d92ebd72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:02.301484 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-273067e3-5d96-4544-a556-a803d92ebd72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:02.305992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-874b8601-0bb4-43d7-b4a9-41d06881215b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147535 Jul 21 22:21:02.306569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 696/1265] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:02 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:02.365240 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-273067e3-5d96-4544-a556-a803d92ebd72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:02.373198 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-273067e3-5d96-4544-a556-a803d92ebd72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084474 Jul 21 22:21:02.373755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 570/1266] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:02 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:02.657858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d74cb505-ca27-4044-b2e8-f9e816422ddf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:02.658460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d74cb505-ca27-4044-b2e8-f9e816422ddf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:02.664431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d74cb505-ca27-4044-b2e8-f9e816422ddf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:02.664873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d74cb505-ca27-4044-b2e8-f9e816422ddf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:02.665627 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d74cb505-ca27-4044-b2e8-f9e816422ddf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:02.666058 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d74cb505-ca27-4044-b2e8-f9e816422ddf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:02.790913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d74cb505-ca27-4044-b2e8-f9e816422ddf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:02.798730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d74cb505-ca27-4044-b2e8-f9e816422ddf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.145531 Jul 21 22:21:02.799330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 697/1267] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:02 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:03.323068 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b3bdc8eb-d691-4d9c-a873-902d865f810e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:03.323712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b3bdc8eb-d691-4d9c-a873-902d865f810e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:03.330255 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3bdc8eb-d691-4d9c-a873-902d865f810e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:03.330707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3bdc8eb-d691-4d9c-a873-902d865f810e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:03.331504 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3bdc8eb-d691-4d9c-a873-902d865f810e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:03.331943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3bdc8eb-d691-4d9c-a873-902d865f810e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:03.389587 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-57832760-441a-47f1-9f93-6506394ddb1f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:03.390221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-57832760-441a-47f1-9f93-6506394ddb1f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:03.396610 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-57832760-441a-47f1-9f93-6506394ddb1f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:03.397066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-57832760-441a-47f1-9f93-6506394ddb1f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:03.397846 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-57832760-441a-47f1-9f93-6506394ddb1f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:03.398283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-57832760-441a-47f1-9f93-6506394ddb1f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:03.471609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-57832760-441a-47f1-9f93-6506394ddb1f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:03.479691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-57832760-441a-47f1-9f93-6506394ddb1f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.093884 Jul 21 22:21:03.487105 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 698/1268] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:03 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:03.488283 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b3bdc8eb-d691-4d9c-a873-902d865f810e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:03.496285 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b3bdc8eb-d691-4d9c-a873-902d865f810e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.177087 Jul 21 22:21:03.496852 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 571/1269] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:03 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:03.815559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4308a92c-d61e-4e6e-847f-a9bc24ea758c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:03.816194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4308a92c-d61e-4e6e-847f-a9bc24ea758c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:03.822188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4308a92c-d61e-4e6e-847f-a9bc24ea758c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:03.822630 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4308a92c-d61e-4e6e-847f-a9bc24ea758c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:03.823416 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4308a92c-d61e-4e6e-847f-a9bc24ea758c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:03.823847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4308a92c-d61e-4e6e-847f-a9bc24ea758c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:03.950863 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4308a92c-d61e-4e6e-847f-a9bc24ea758c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:03.960370 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4308a92c-d61e-4e6e-847f-a9bc24ea758c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148381 Jul 21 22:21:03.960987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 699/1270] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:03 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:04.497022 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0724fab6-908e-46f4-abea-61630af64f62 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:04.497629 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0724fab6-908e-46f4-abea-61630af64f62 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:04.504659 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0724fab6-908e-46f4-abea-61630af64f62 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:04.505103 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0724fab6-908e-46f4-abea-61630af64f62 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:04.505865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0724fab6-908e-46f4-abea-61630af64f62 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:04.506297 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0724fab6-908e-46f4-abea-61630af64f62 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:04.513117 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6b0fa933-f39a-4b6e-9c8a-21cd3080796c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:04.513730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6b0fa933-f39a-4b6e-9c8a-21cd3080796c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:04.520851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b0fa933-f39a-4b6e-9c8a-21cd3080796c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:04.521328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b0fa933-f39a-4b6e-9c8a-21cd3080796c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:04.522079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b0fa933-f39a-4b6e-9c8a-21cd3080796c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:04.522514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b0fa933-f39a-4b6e-9c8a-21cd3080796c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:04.524410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:04.569542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0724fab6-908e-46f4-abea-61630af64f62 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:04.578978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0724fab6-908e-46f4-abea-61630af64f62 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085711 Jul 21 22:21:04.579828 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 572/1271] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:04 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:04.665410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6b0fa933-f39a-4b6e-9c8a-21cd3080796c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:04.673818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6b0fa933-f39a-4b6e-9c8a-21cd3080796c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.164507 Jul 21 22:21:04.674382 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 700/1272] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:04 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:04.985085 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ebf6f358-078d-4d84-aa92-e4d62791a98e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:04.985716 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ebf6f358-078d-4d84-aa92-e4d62791a98e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:04.992409 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ebf6f358-078d-4d84-aa92-e4d62791a98e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:04.993703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ebf6f358-078d-4d84-aa92-e4d62791a98e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:04.994512 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ebf6f358-078d-4d84-aa92-e4d62791a98e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:04.994961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ebf6f358-078d-4d84-aa92-e4d62791a98e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:05.128193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ebf6f358-078d-4d84-aa92-e4d62791a98e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:05.136152 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ebf6f358-078d-4d84-aa92-e4d62791a98e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.155791 Jul 21 22:21:05.136726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 573/1273] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:04 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:05.596417 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dfec0a9e-e9c3-45ed-a08c-7e2b82a6d3cb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:05.597022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dfec0a9e-e9c3-45ed-a08c-7e2b82a6d3cb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:05.603397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dfec0a9e-e9c3-45ed-a08c-7e2b82a6d3cb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:05.603850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dfec0a9e-e9c3-45ed-a08c-7e2b82a6d3cb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:05.604608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dfec0a9e-e9c3-45ed-a08c-7e2b82a6d3cb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:05.605037 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dfec0a9e-e9c3-45ed-a08c-7e2b82a6d3cb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:05.665561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dfec0a9e-e9c3-45ed-a08c-7e2b82a6d3cb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:05.673588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dfec0a9e-e9c3-45ed-a08c-7e2b82a6d3cb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081891 Jul 21 22:21:05.674194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 701/1274] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:05 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:05.691226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e9e90468-8a5a-4296-bec2-47302485ca64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:05.691844 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e9e90468-8a5a-4296-bec2-47302485ca64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:05.698284 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9e90468-8a5a-4296-bec2-47302485ca64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:05.698742 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9e90468-8a5a-4296-bec2-47302485ca64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:05.699552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9e90468-8a5a-4296-bec2-47302485ca64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:05.699999 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9e90468-8a5a-4296-bec2-47302485ca64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:05.830690 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9e90468-8a5a-4296-bec2-47302485ca64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:05.838594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e9e90468-8a5a-4296-bec2-47302485ca64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.151666 Jul 21 22:21:05.839199 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 574/1275] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:05 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:06.152737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e1d04bbf-f13a-4d3e-be53-f68e3f3822bd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:06.153375 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e1d04bbf-f13a-4d3e-be53-f68e3f3822bd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:06.159495 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1d04bbf-f13a-4d3e-be53-f68e3f3822bd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:06.159943 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1d04bbf-f13a-4d3e-be53-f68e3f3822bd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:06.160702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1d04bbf-f13a-4d3e-be53-f68e3f3822bd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:06.161131 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e1d04bbf-f13a-4d3e-be53-f68e3f3822bd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:06.290158 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e1d04bbf-f13a-4d3e-be53-f68e3f3822bd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:06.298506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e1d04bbf-f13a-4d3e-be53-f68e3f3822bd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149686 Jul 21 22:21:06.299078 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 702/1276] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:06 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:06.690550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a48f479a-db52-4188-addf-fb4208327730 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:06.691188 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a48f479a-db52-4188-addf-fb4208327730 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:06.697461 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a48f479a-db52-4188-addf-fb4208327730 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:06.698027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a48f479a-db52-4188-addf-fb4208327730 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:06.698665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a48f479a-db52-4188-addf-fb4208327730 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:06.699128 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a48f479a-db52-4188-addf-fb4208327730 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:06.760659 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a48f479a-db52-4188-addf-fb4208327730 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:06.768645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a48f479a-db52-4188-addf-fb4208327730 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081953 Jul 21 22:21:06.769211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 575/1277] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:06 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:06.854895 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c06f6dbf-312c-43eb-beb9-9f5ac912c416 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:06.855523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c06f6dbf-312c-43eb-beb9-9f5ac912c416 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:06.861947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c06f6dbf-312c-43eb-beb9-9f5ac912c416 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:06.862388 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c06f6dbf-312c-43eb-beb9-9f5ac912c416 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:06.863171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c06f6dbf-312c-43eb-beb9-9f5ac912c416 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:06.863685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c06f6dbf-312c-43eb-beb9-9f5ac912c416 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:06.996653 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c06f6dbf-312c-43eb-beb9-9f5ac912c416 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:07.004621 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c06f6dbf-312c-43eb-beb9-9f5ac912c416 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.153547 Jul 21 22:21:07.005190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 703/1278] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:06 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:07.317161 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-33ae928c-7bc5-423a-bb58-6fa42cde0d63 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:07.317771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-33ae928c-7bc5-423a-bb58-6fa42cde0d63 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:07.324557 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-33ae928c-7bc5-423a-bb58-6fa42cde0d63 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:07.325010 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-33ae928c-7bc5-423a-bb58-6fa42cde0d63 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:07.326056 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-33ae928c-7bc5-423a-bb58-6fa42cde0d63 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:07.326618 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-33ae928c-7bc5-423a-bb58-6fa42cde0d63 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:07.453751 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-33ae928c-7bc5-423a-bb58-6fa42cde0d63 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:07.461539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-33ae928c-7bc5-423a-bb58-6fa42cde0d63 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149921 Jul 21 22:21:07.462106 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 576/1279] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:07 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:07.785990 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6ad9a77a-bd8f-4411-a77d-2f59e7ad3583 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:07.786636 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6ad9a77a-bd8f-4411-a77d-2f59e7ad3583 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:07.792646 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ad9a77a-bd8f-4411-a77d-2f59e7ad3583 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:07.793101 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ad9a77a-bd8f-4411-a77d-2f59e7ad3583 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:07.793861 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ad9a77a-bd8f-4411-a77d-2f59e7ad3583 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:07.794301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6ad9a77a-bd8f-4411-a77d-2f59e7ad3583 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:07.854178 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6ad9a77a-bd8f-4411-a77d-2f59e7ad3583 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:07.862575 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6ad9a77a-bd8f-4411-a77d-2f59e7ad3583 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080445 Jul 21 22:21:07.863164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 704/1280] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:07 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:08.021756 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-894c04a9-9946-4554-a457-eb5ee952052a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:08.022370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-894c04a9-9946-4554-a457-eb5ee952052a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:08.028862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-894c04a9-9946-4554-a457-eb5ee952052a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:08.029343 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-894c04a9-9946-4554-a457-eb5ee952052a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:08.030115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-894c04a9-9946-4554-a457-eb5ee952052a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:08.030552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-894c04a9-9946-4554-a457-eb5ee952052a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:08.163033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-894c04a9-9946-4554-a457-eb5ee952052a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:08.171014 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-894c04a9-9946-4554-a457-eb5ee952052a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.153184 Jul 21 22:21:08.171584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 577/1281] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:08 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:08.478624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fcb7b593-2436-445d-aee8-9b26ee7bae59 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:08.479312 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fcb7b593-2436-445d-aee8-9b26ee7bae59 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:08.485853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fcb7b593-2436-445d-aee8-9b26ee7bae59 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:08.486311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fcb7b593-2436-445d-aee8-9b26ee7bae59 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:08.487105 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fcb7b593-2436-445d-aee8-9b26ee7bae59 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:08.487549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fcb7b593-2436-445d-aee8-9b26ee7bae59 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:08.611730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fcb7b593-2436-445d-aee8-9b26ee7bae59 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:08.619576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fcb7b593-2436-445d-aee8-9b26ee7bae59 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.144804 Jul 21 22:21:08.620149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 705/1282] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:08 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:08.879876 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f146f986-2a31-48d8-8771-072782a8c3c9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:08.880414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f146f986-2a31-48d8-8771-072782a8c3c9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:08.886451 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f146f986-2a31-48d8-8771-072782a8c3c9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:08.886906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f146f986-2a31-48d8-8771-072782a8c3c9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:08.887709 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f146f986-2a31-48d8-8771-072782a8c3c9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:08.888150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f146f986-2a31-48d8-8771-072782a8c3c9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:08.951505 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f146f986-2a31-48d8-8771-072782a8c3c9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:08.959297 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f146f986-2a31-48d8-8771-072782a8c3c9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083371 Jul 21 22:21:08.959859 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 578/1283] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:08 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:09.188207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3f9e614d-0c66-464d-a101-ad66dd04194e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:09.188864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3f9e614d-0c66-464d-a101-ad66dd04194e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:09.195442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3f9e614d-0c66-464d-a101-ad66dd04194e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:09.195894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3f9e614d-0c66-464d-a101-ad66dd04194e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:09.196663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3f9e614d-0c66-464d-a101-ad66dd04194e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:09.197098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3f9e614d-0c66-464d-a101-ad66dd04194e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:09.322355 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3f9e614d-0c66-464d-a101-ad66dd04194e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:09.330783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3f9e614d-0c66-464d-a101-ad66dd04194e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146576 Jul 21 22:21:09.331381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 706/1284] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:09 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:09.637062 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9397d59b-8f3b-4675-be3f-a54211920dd2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:09.637676 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9397d59b-8f3b-4675-be3f-a54211920dd2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:09.644849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9397d59b-8f3b-4675-be3f-a54211920dd2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:09.645301 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9397d59b-8f3b-4675-be3f-a54211920dd2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:09.646069 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9397d59b-8f3b-4675-be3f-a54211920dd2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:09.646507 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9397d59b-8f3b-4675-be3f-a54211920dd2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:09.771822 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9397d59b-8f3b-4675-be3f-a54211920dd2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:09.779615 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9397d59b-8f3b-4675-be3f-a54211920dd2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146441 Jul 21 22:21:09.780179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 579/1285] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:09 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:09.976565 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8504ecfd-5aed-40d7-bff7-fe5d2a794c6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:09.977174 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8504ecfd-5aed-40d7-bff7-fe5d2a794c6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:09.983267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8504ecfd-5aed-40d7-bff7-fe5d2a794c6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:09.983720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8504ecfd-5aed-40d7-bff7-fe5d2a794c6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:09.984484 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8504ecfd-5aed-40d7-bff7-fe5d2a794c6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:09.985410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8504ecfd-5aed-40d7-bff7-fe5d2a794c6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:10.048819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8504ecfd-5aed-40d7-bff7-fe5d2a794c6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:10.056958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8504ecfd-5aed-40d7-bff7-fe5d2a794c6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084209 Jul 21 22:21:10.057524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 707/1286] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:09 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:10.348864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b8c835a1-d795-463d-b527-4932bd9303a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:10.349394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b8c835a1-d795-463d-b527-4932bd9303a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:10.355428 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8c835a1-d795-463d-b527-4932bd9303a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:10.355883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8c835a1-d795-463d-b527-4932bd9303a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:10.356651 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8c835a1-d795-463d-b527-4932bd9303a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:10.357090 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8c835a1-d795-463d-b527-4932bd9303a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:10.483662 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b8c835a1-d795-463d-b527-4932bd9303a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:10.492275 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b8c835a1-d795-463d-b527-4932bd9303a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148164 Jul 21 22:21:10.492836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 580/1287] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:10 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:10.796383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e8c7e4e8-c725-4852-9d2f-05fa3fc4997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:10.796991 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e8c7e4e8-c725-4852-9d2f-05fa3fc4997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:10.803731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e8c7e4e8-c725-4852-9d2f-05fa3fc4997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:10.804176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e8c7e4e8-c725-4852-9d2f-05fa3fc4997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:10.804934 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e8c7e4e8-c725-4852-9d2f-05fa3fc4997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:10.805366 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e8c7e4e8-c725-4852-9d2f-05fa3fc4997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:10.930804 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e8c7e4e8-c725-4852-9d2f-05fa3fc4997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:10.939310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e8c7e4e8-c725-4852-9d2f-05fa3fc4997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146717 Jul 21 22:21:10.939875 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 708/1288] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:10 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:11.074366 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f924a61e-e496-4874-8c69-d3b49c591c6f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:11.074911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f924a61e-e496-4874-8c69-d3b49c591c6f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:11.082049 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f924a61e-e496-4874-8c69-d3b49c591c6f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:11.082474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f924a61e-e496-4874-8c69-d3b49c591c6f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:11.083263 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f924a61e-e496-4874-8c69-d3b49c591c6f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:11.083695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f924a61e-e496-4874-8c69-d3b49c591c6f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:11.147491 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f924a61e-e496-4874-8c69-d3b49c591c6f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:11.155410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f924a61e-e496-4874-8c69-d3b49c591c6f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084943 Jul 21 22:21:11.155969 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 581/1289] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:11 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:11.509237 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-37118fc0-d28b-4060-a90c-44151ef83b16 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:11.509842 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-37118fc0-d28b-4060-a90c-44151ef83b16 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:11.515876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37118fc0-d28b-4060-a90c-44151ef83b16 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:11.516376 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37118fc0-d28b-4060-a90c-44151ef83b16 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:11.517132 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37118fc0-d28b-4060-a90c-44151ef83b16 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:11.517565 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37118fc0-d28b-4060-a90c-44151ef83b16 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:11.534769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:11.649734 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-37118fc0-d28b-4060-a90c-44151ef83b16 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:11.658129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-37118fc0-d28b-4060-a90c-44151ef83b16 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.152720 Jul 21 22:21:11.658696 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 709/1290] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:11 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:11.956369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0c97c16f-b46c-4dd5-9a5b-82a657b710e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:11.956975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0c97c16f-b46c-4dd5-9a5b-82a657b710e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:11.963223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0c97c16f-b46c-4dd5-9a5b-82a657b710e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:11.963459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0c97c16f-b46c-4dd5-9a5b-82a657b710e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:11.964221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0c97c16f-b46c-4dd5-9a5b-82a657b710e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:11.964654 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0c97c16f-b46c-4dd5-9a5b-82a657b710e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:12.093381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0c97c16f-b46c-4dd5-9a5b-82a657b710e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:12.102200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0c97c16f-b46c-4dd5-9a5b-82a657b710e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149844 Jul 21 22:21:12.102769 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 582/1291] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:11 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:12.171123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-72ddf9f9-d1da-4f8b-ae27-c36be8d22780 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:12.171725 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-72ddf9f9-d1da-4f8b-ae27-c36be8d22780 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:12.178641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72ddf9f9-d1da-4f8b-ae27-c36be8d22780 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:12.178981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72ddf9f9-d1da-4f8b-ae27-c36be8d22780 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:12.179893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72ddf9f9-d1da-4f8b-ae27-c36be8d22780 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:12.180370 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72ddf9f9-d1da-4f8b-ae27-c36be8d22780 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:12.244697 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-72ddf9f9-d1da-4f8b-ae27-c36be8d22780 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:12.252525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-72ddf9f9-d1da-4f8b-ae27-c36be8d22780 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085184 Jul 21 22:21:12.253095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 710/1292] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:12 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:12.675592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-adb772e2-28e9-4c13-b61b-3183a65fa87c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:12.676202 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-adb772e2-28e9-4c13-b61b-3183a65fa87c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:12.682226 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-adb772e2-28e9-4c13-b61b-3183a65fa87c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:12.682672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-adb772e2-28e9-4c13-b61b-3183a65fa87c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:12.683467 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-adb772e2-28e9-4c13-b61b-3183a65fa87c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:12.683902 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-adb772e2-28e9-4c13-b61b-3183a65fa87c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:12.811524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-adb772e2-28e9-4c13-b61b-3183a65fa87c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:12.820285 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-adb772e2-28e9-4c13-b61b-3183a65fa87c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149004 Jul 21 22:21:12.820853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 583/1293] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:12 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:13.119235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-311b1247-2bca-423d-890c-dd6a11ab971a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:13.119769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-311b1247-2bca-423d-890c-dd6a11ab971a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:13.126715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-311b1247-2bca-423d-890c-dd6a11ab971a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:13.127199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-311b1247-2bca-423d-890c-dd6a11ab971a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:13.128062 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-311b1247-2bca-423d-890c-dd6a11ab971a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:13.128502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-311b1247-2bca-423d-890c-dd6a11ab971a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:13.254959 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-311b1247-2bca-423d-890c-dd6a11ab971a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:13.262895 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-311b1247-2bca-423d-890c-dd6a11ab971a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147642 Jul 21 22:21:13.263494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 711/1294] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:13 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:13.269089 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8290e077-df5f-4bf3-9e65-0ba0cb4975d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:13.269714 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8290e077-df5f-4bf3-9e65-0ba0cb4975d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:13.276285 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8290e077-df5f-4bf3-9e65-0ba0cb4975d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:13.276741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8290e077-df5f-4bf3-9e65-0ba0cb4975d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:13.277743 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8290e077-df5f-4bf3-9e65-0ba0cb4975d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:13.278187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8290e077-df5f-4bf3-9e65-0ba0cb4975d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:13.357197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8290e077-df5f-4bf3-9e65-0ba0cb4975d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:13.366242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8290e077-df5f-4bf3-9e65-0ba0cb4975d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.101048 Jul 21 22:21:13.366817 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 584/1295] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:13 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:13.837416 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3340317f-37e5-40de-b39d-04d92b47e97a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:13.837937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3340317f-37e5-40de-b39d-04d92b47e97a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:13.843914 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3340317f-37e5-40de-b39d-04d92b47e97a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:13.845105 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3340317f-37e5-40de-b39d-04d92b47e97a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:13.846130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3340317f-37e5-40de-b39d-04d92b47e97a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:13.846564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3340317f-37e5-40de-b39d-04d92b47e97a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:13.973142 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3340317f-37e5-40de-b39d-04d92b47e97a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:13.981050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3340317f-37e5-40de-b39d-04d92b47e97a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147615 Jul 21 22:21:13.981618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 712/1296] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:13 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:14.279938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3a0bdd36-9a9d-471c-a475-8af177b7b187 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:14.280556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3a0bdd36-9a9d-471c-a475-8af177b7b187 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:14.287086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a0bdd36-9a9d-471c-a475-8af177b7b187 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:14.287545 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a0bdd36-9a9d-471c-a475-8af177b7b187 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:14.288318 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a0bdd36-9a9d-471c-a475-8af177b7b187 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:14.288759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a0bdd36-9a9d-471c-a475-8af177b7b187 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:14.383311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-26b9924f-f05a-4be8-abdf-a25c0ddd5ef6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:14.383921 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-26b9924f-f05a-4be8-abdf-a25c0ddd5ef6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:14.390393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26b9924f-f05a-4be8-abdf-a25c0ddd5ef6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:14.390850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26b9924f-f05a-4be8-abdf-a25c0ddd5ef6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:14.391655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26b9924f-f05a-4be8-abdf-a25c0ddd5ef6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:14.392087 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26b9924f-f05a-4be8-abdf-a25c0ddd5ef6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:14.417126 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3a0bdd36-9a9d-471c-a475-8af177b7b187 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:14.425623 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3a0bdd36-9a9d-471c-a475-8af177b7b187 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149755 Jul 21 22:21:14.426213 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 585/1297] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:14 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:14.456686 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-26b9924f-f05a-4be8-abdf-a25c0ddd5ef6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:14.464700 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-26b9924f-f05a-4be8-abdf-a25c0ddd5ef6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085596 Jul 21 22:21:14.465281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 713/1298] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:14 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:14.997670 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-361cf5d1-5628-46cd-b08f-264a39afd7e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:14.998315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-361cf5d1-5628-46cd-b08f-264a39afd7e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:15.004558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-361cf5d1-5628-46cd-b08f-264a39afd7e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:15.005014 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-361cf5d1-5628-46cd-b08f-264a39afd7e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:15.005785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-361cf5d1-5628-46cd-b08f-264a39afd7e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:15.006223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-361cf5d1-5628-46cd-b08f-264a39afd7e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:15.132886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-361cf5d1-5628-46cd-b08f-264a39afd7e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:15.141771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-361cf5d1-5628-46cd-b08f-264a39afd7e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147425 Jul 21 22:21:15.142345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 586/1299] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:14 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:15.443165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-27123950-b885-48d8-b0fe-89f6d40078a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:15.443776 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-27123950-b885-48d8-b0fe-89f6d40078a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:15.450374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-27123950-b885-48d8-b0fe-89f6d40078a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:15.450824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-27123950-b885-48d8-b0fe-89f6d40078a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:15.451612 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-27123950-b885-48d8-b0fe-89f6d40078a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:15.452048 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-27123950-b885-48d8-b0fe-89f6d40078a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:15.485246 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c9e025e1-22a9-41a2-9e9a-adb1870bf69b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:15.485865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c9e025e1-22a9-41a2-9e9a-adb1870bf69b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:15.493236 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9e025e1-22a9-41a2-9e9a-adb1870bf69b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:15.493697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9e025e1-22a9-41a2-9e9a-adb1870bf69b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:15.494494 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9e025e1-22a9-41a2-9e9a-adb1870bf69b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:15.494940 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9e025e1-22a9-41a2-9e9a-adb1870bf69b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:15.570085 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c9e025e1-22a9-41a2-9e9a-adb1870bf69b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:15.578060 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c9e025e1-22a9-41a2-9e9a-adb1870bf69b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.101029 Jul 21 22:21:15.579228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 587/1300] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:15 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:15.602305 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-27123950-b885-48d8-b0fe-89f6d40078a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:15.610247 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-27123950-b885-48d8-b0fe-89f6d40078a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.171072 Jul 21 22:21:15.610810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 714/1301] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:15 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:16.159518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4a929899-1af0-4b43-b261-4435186c1fce tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:16.160121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4a929899-1af0-4b43-b261-4435186c1fce tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:16.166028 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4a929899-1af0-4b43-b261-4435186c1fce tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:16.166474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4a929899-1af0-4b43-b261-4435186c1fce tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:16.167270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4a929899-1af0-4b43-b261-4435186c1fce tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:16.167701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4a929899-1af0-4b43-b261-4435186c1fce tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:16.293124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4a929899-1af0-4b43-b261-4435186c1fce tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:16.301620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4a929899-1af0-4b43-b261-4435186c1fce tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146730 Jul 21 22:21:16.302187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 588/1302] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:16 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:16.595655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4024b6ef-b10c-4cc2-b861-e8af20aff837 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:16.596262 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4024b6ef-b10c-4cc2-b861-e8af20aff837 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:16.602812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4024b6ef-b10c-4cc2-b861-e8af20aff837 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:16.603284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4024b6ef-b10c-4cc2-b861-e8af20aff837 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:16.604040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4024b6ef-b10c-4cc2-b861-e8af20aff837 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:16.604469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4024b6ef-b10c-4cc2-b861-e8af20aff837 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:16.626689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c32ebb3c-7ae2-4083-8a9b-ccaecd5f8215 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:16.627323 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c32ebb3c-7ae2-4083-8a9b-ccaecd5f8215 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:16.633737 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c32ebb3c-7ae2-4083-8a9b-ccaecd5f8215 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:16.634193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c32ebb3c-7ae2-4083-8a9b-ccaecd5f8215 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:16.634966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c32ebb3c-7ae2-4083-8a9b-ccaecd5f8215 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:16.635443 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c32ebb3c-7ae2-4083-8a9b-ccaecd5f8215 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:16.639498 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:16.664572 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4024b6ef-b10c-4cc2-b861-e8af20aff837 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:16.673365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4024b6ef-b10c-4cc2-b861-e8af20aff837 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081750 Jul 21 22:21:16.673944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 715/1303] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:16 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:16.767864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c32ebb3c-7ae2-4083-8a9b-ccaecd5f8215 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:16.775797 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c32ebb3c-7ae2-4083-8a9b-ccaecd5f8215 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.153517 Jul 21 22:21:16.776372 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 589/1304] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:16 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:17.318674 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5d0748aa-5956-4879-a038-c114ebc70856 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:17.319310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5d0748aa-5956-4879-a038-c114ebc70856 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:17.325363 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d0748aa-5956-4879-a038-c114ebc70856 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:17.325810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d0748aa-5956-4879-a038-c114ebc70856 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:17.326572 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d0748aa-5956-4879-a038-c114ebc70856 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:17.327023 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d0748aa-5956-4879-a038-c114ebc70856 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:17.451360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5d0748aa-5956-4879-a038-c114ebc70856 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:17.459675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5d0748aa-5956-4879-a038-c114ebc70856 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.144824 Jul 21 22:21:17.460235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 716/1305] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:17 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:17.690707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2ba187a1-0fb8-4ded-8809-cfa11ddc9d9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:17.691355 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2ba187a1-0fb8-4ded-8809-cfa11ddc9d9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:17.697757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ba187a1-0fb8-4ded-8809-cfa11ddc9d9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:17.698204 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ba187a1-0fb8-4ded-8809-cfa11ddc9d9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:17.698967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ba187a1-0fb8-4ded-8809-cfa11ddc9d9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:17.699501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ba187a1-0fb8-4ded-8809-cfa11ddc9d9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:17.760428 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2ba187a1-0fb8-4ded-8809-cfa11ddc9d9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:17.768861 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2ba187a1-0fb8-4ded-8809-cfa11ddc9d9a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082566 Jul 21 22:21:17.769427 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 590/1306] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:17 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:17.792714 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e4e29658-2d29-4bf3-b928-cc172e8b9110 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:17.793321 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e4e29658-2d29-4bf3-b928-cc172e8b9110 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:17.799719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e4e29658-2d29-4bf3-b928-cc172e8b9110 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:17.800170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e4e29658-2d29-4bf3-b928-cc172e8b9110 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:17.800931 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e4e29658-2d29-4bf3-b928-cc172e8b9110 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:17.801369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e4e29658-2d29-4bf3-b928-cc172e8b9110 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:17.930769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e4e29658-2d29-4bf3-b928-cc172e8b9110 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:17.940282 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e4e29658-2d29-4bf3-b928-cc172e8b9110 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.151307 Jul 21 22:21:17.941134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 717/1307] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:17 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:18.477418 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bd15c0da-fda7-4e4a-ac6d-a6ef5f24ac1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:18.478076 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bd15c0da-fda7-4e4a-ac6d-a6ef5f24ac1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:18.485241 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bd15c0da-fda7-4e4a-ac6d-a6ef5f24ac1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:18.485701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bd15c0da-fda7-4e4a-ac6d-a6ef5f24ac1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:18.486481 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bd15c0da-fda7-4e4a-ac6d-a6ef5f24ac1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:18.486924 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bd15c0da-fda7-4e4a-ac6d-a6ef5f24ac1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:18.613461 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bd15c0da-fda7-4e4a-ac6d-a6ef5f24ac1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:18.621388 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bd15c0da-fda7-4e4a-ac6d-a6ef5f24ac1e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147882 Jul 21 22:21:18.621970 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 591/1308] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:18 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:18.785887 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5e09f2e8-da58-41ba-9e2a-aa63147fc8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:18.786494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5e09f2e8-da58-41ba-9e2a-aa63147fc8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:18.792580 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5e09f2e8-da58-41ba-9e2a-aa63147fc8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:18.793029 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5e09f2e8-da58-41ba-9e2a-aa63147fc8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:18.793792 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5e09f2e8-da58-41ba-9e2a-aa63147fc8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:18.794229 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5e09f2e8-da58-41ba-9e2a-aa63147fc8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:18.856027 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5e09f2e8-da58-41ba-9e2a-aa63147fc8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:18.864051 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5e09f2e8-da58-41ba-9e2a-aa63147fc8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082692 Jul 21 22:21:18.864559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 718/1309] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:18 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:18.960104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f454ae50-5001-4abd-8a41-adf0b85451c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:18.961060 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f454ae50-5001-4abd-8a41-adf0b85451c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:18.971327 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f454ae50-5001-4abd-8a41-adf0b85451c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:18.972183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f454ae50-5001-4abd-8a41-adf0b85451c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:18.973171 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f454ae50-5001-4abd-8a41-adf0b85451c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:18.973913 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f454ae50-5001-4abd-8a41-adf0b85451c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:19.109193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f454ae50-5001-4abd-8a41-adf0b85451c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:19.117180 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f454ae50-5001-4abd-8a41-adf0b85451c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.162786 Jul 21 22:21:19.117694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 592/1310] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:18 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:19.637614 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3584a12a-5edc-436b-9f0d-cbacd285b479 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:19.638223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3584a12a-5edc-436b-9f0d-cbacd285b479 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:19.644501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3584a12a-5edc-436b-9f0d-cbacd285b479 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:19.644943 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3584a12a-5edc-436b-9f0d-cbacd285b479 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:19.645697 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3584a12a-5edc-436b-9f0d-cbacd285b479 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:19.646119 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3584a12a-5edc-436b-9f0d-cbacd285b479 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:19.770601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3584a12a-5edc-436b-9f0d-cbacd285b479 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:19.778750 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3584a12a-5edc-436b-9f0d-cbacd285b479 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.145030 Jul 21 22:21:19.779353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 719/1311] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:19 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:19.881433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5968ff1f-754b-493d-9cda-7f912eb9b8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:19.882047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5968ff1f-754b-493d-9cda-7f912eb9b8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:19.888091 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5968ff1f-754b-493d-9cda-7f912eb9b8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:19.888541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5968ff1f-754b-493d-9cda-7f912eb9b8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:19.889307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5968ff1f-754b-493d-9cda-7f912eb9b8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:19.889741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5968ff1f-754b-493d-9cda-7f912eb9b8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:19.949420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5968ff1f-754b-493d-9cda-7f912eb9b8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:19.957136 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5968ff1f-754b-493d-9cda-7f912eb9b8ca tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079627 Jul 21 22:21:19.957699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 593/1312] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:19 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:20.133548 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0f4787fd-80b5-4330-9492-0b8a65ae851d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:20.134164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0f4787fd-80b5-4330-9492-0b8a65ae851d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:20.140666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0f4787fd-80b5-4330-9492-0b8a65ae851d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:20.141119 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0f4787fd-80b5-4330-9492-0b8a65ae851d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:20.141896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0f4787fd-80b5-4330-9492-0b8a65ae851d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:20.142337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0f4787fd-80b5-4330-9492-0b8a65ae851d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:20.271888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0f4787fd-80b5-4330-9492-0b8a65ae851d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:20.279706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0f4787fd-80b5-4330-9492-0b8a65ae851d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149979 Jul 21 22:21:20.280299 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 720/1313] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:20 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:20.795899 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7eb02e84-4702-48bc-80bc-ffc9906f0615 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:20.796421 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7eb02e84-4702-48bc-80bc-ffc9906f0615 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:20.803539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7eb02e84-4702-48bc-80bc-ffc9906f0615 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:20.803994 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7eb02e84-4702-48bc-80bc-ffc9906f0615 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:20.804791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7eb02e84-4702-48bc-80bc-ffc9906f0615 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:20.805234 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7eb02e84-4702-48bc-80bc-ffc9906f0615 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:20.931515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7eb02e84-4702-48bc-80bc-ffc9906f0615 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:20.939299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7eb02e84-4702-48bc-80bc-ffc9906f0615 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147333 Jul 21 22:21:20.939865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 594/1314] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:20 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:20.973948 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c3cfcb44-b2e0-46d0-8201-aac2a305e2e0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:20.974951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c3cfcb44-b2e0-46d0-8201-aac2a305e2e0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:20.980728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3cfcb44-b2e0-46d0-8201-aac2a305e2e0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:20.981180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3cfcb44-b2e0-46d0-8201-aac2a305e2e0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:20.981949 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3cfcb44-b2e0-46d0-8201-aac2a305e2e0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:20.982381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3cfcb44-b2e0-46d0-8201-aac2a305e2e0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:21.054773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c3cfcb44-b2e0-46d0-8201-aac2a305e2e0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:21.062774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c3cfcb44-b2e0-46d0-8201-aac2a305e2e0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.093656 Jul 21 22:21:21.063391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 721/1315] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:20 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:21.297279 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-19a39c6b-2378-4c14-8acc-769af4873706 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:21.297880 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-19a39c6b-2378-4c14-8acc-769af4873706 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:21.304035 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19a39c6b-2378-4c14-8acc-769af4873706 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:21.304427 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19a39c6b-2378-4c14-8acc-769af4873706 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:21.305195 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19a39c6b-2378-4c14-8acc-769af4873706 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:21.305624 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-19a39c6b-2378-4c14-8acc-769af4873706 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:21.432265 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-19a39c6b-2378-4c14-8acc-769af4873706 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:21.440932 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-19a39c6b-2378-4c14-8acc-769af4873706 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147437 Jul 21 22:21:21.441506 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 595/1316] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:21 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:21.956529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-70d15406-e442-4512-9da9-1510d6e8a38a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:21.957287 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-70d15406-e442-4512-9da9-1510d6e8a38a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:21.963604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-70d15406-e442-4512-9da9-1510d6e8a38a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:21.964052 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-70d15406-e442-4512-9da9-1510d6e8a38a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:21.964810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-70d15406-e442-4512-9da9-1510d6e8a38a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:21.965272 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-70d15406-e442-4512-9da9-1510d6e8a38a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:22.079498 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9052daa6-f9aa-44dd-9bf9-f54d661feeb0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:22.080111 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9052daa6-f9aa-44dd-9bf9-f54d661feeb0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:22.086601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9052daa6-f9aa-44dd-9bf9-f54d661feeb0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:22.087081 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9052daa6-f9aa-44dd-9bf9-f54d661feeb0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:22.087850 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9052daa6-f9aa-44dd-9bf9-f54d661feeb0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:22.088288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9052daa6-f9aa-44dd-9bf9-f54d661feeb0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:22.091737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-70d15406-e442-4512-9da9-1510d6e8a38a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:22.100006 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-70d15406-e442-4512-9da9-1510d6e8a38a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147311 Jul 21 22:21:22.100715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 722/1317] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:21 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:22.152270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9052daa6-f9aa-44dd-9bf9-f54d661feeb0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:22.160630 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9052daa6-f9aa-44dd-9bf9-f54d661feeb0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084900 Jul 21 22:21:22.161189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 596/1318] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:22 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:22.458518 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7151f754-83b4-4d06-96a7-ff57a0196efe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:22.459126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7151f754-83b4-4d06-96a7-ff57a0196efe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:22.465229 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7151f754-83b4-4d06-96a7-ff57a0196efe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:22.465674 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7151f754-83b4-4d06-96a7-ff57a0196efe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:22.466440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7151f754-83b4-4d06-96a7-ff57a0196efe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:22.466879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7151f754-83b4-4d06-96a7-ff57a0196efe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:22.592663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7151f754-83b4-4d06-96a7-ff57a0196efe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:22.600717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7151f754-83b4-4d06-96a7-ff57a0196efe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146740 Jul 21 22:21:22.601275 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 723/1319] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:22 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:23.117725 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b02c67cd-54d2-4b87-ab98-9ec789f7e9e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:23.118315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b02c67cd-54d2-4b87-ab98-9ec789f7e9e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:23.124785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b02c67cd-54d2-4b87-ab98-9ec789f7e9e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:23.125240 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b02c67cd-54d2-4b87-ab98-9ec789f7e9e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:23.126496 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b02c67cd-54d2-4b87-ab98-9ec789f7e9e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:23.126937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b02c67cd-54d2-4b87-ab98-9ec789f7e9e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:23.177396 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-094e9a78-576e-4078-8629-6b38bb7b0289 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:23.178125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-094e9a78-576e-4078-8629-6b38bb7b0289 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:23.184635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-094e9a78-576e-4078-8629-6b38bb7b0289 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:23.185158 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-094e9a78-576e-4078-8629-6b38bb7b0289 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:23.185996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-094e9a78-576e-4078-8629-6b38bb7b0289 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:23.186525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-094e9a78-576e-4078-8629-6b38bb7b0289 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:23.260597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-094e9a78-576e-4078-8629-6b38bb7b0289 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:23.269130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-094e9a78-576e-4078-8629-6b38bb7b0289 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.095591 Jul 21 22:21:23.269927 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 724/1320] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:23 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:23.284134 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b02c67cd-54d2-4b87-ab98-9ec789f7e9e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:23.292062 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b02c67cd-54d2-4b87-ab98-9ec789f7e9e0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.178248 Jul 21 22:21:23.292629 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 597/1321] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:23 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:23.618185 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-24a19921-5ffc-4023-b398-470fa1756de5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:23.618796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-24a19921-5ffc-4023-b398-470fa1756de5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:23.624793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-24a19921-5ffc-4023-b398-470fa1756de5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:23.625868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-24a19921-5ffc-4023-b398-470fa1756de5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:23.626634 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-24a19921-5ffc-4023-b398-470fa1756de5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:23.627106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-24a19921-5ffc-4023-b398-470fa1756de5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:23.751155 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-24a19921-5ffc-4023-b398-470fa1756de5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:23.758931 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-24a19921-5ffc-4023-b398-470fa1756de5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.144614 Jul 21 22:21:23.759521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 725/1322] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:23 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:24.285581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b69ffda0-56e7-46fe-90a6-0c148ae8c543 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:24.286119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b69ffda0-56e7-46fe-90a6-0c148ae8c543 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:24.292492 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b69ffda0-56e7-46fe-90a6-0c148ae8c543 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:24.292942 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b69ffda0-56e7-46fe-90a6-0c148ae8c543 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:24.293701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b69ffda0-56e7-46fe-90a6-0c148ae8c543 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:24.294137 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b69ffda0-56e7-46fe-90a6-0c148ae8c543 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:24.309452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1245a332-4e74-49d7-8155-1306f42ad68f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:24.310245 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1245a332-4e74-49d7-8155-1306f42ad68f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:24.317423 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1245a332-4e74-49d7-8155-1306f42ad68f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:24.317877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1245a332-4e74-49d7-8155-1306f42ad68f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:24.318658 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1245a332-4e74-49d7-8155-1306f42ad68f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:24.319175 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1245a332-4e74-49d7-8155-1306f42ad68f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:24.323190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:24.356434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b69ffda0-56e7-46fe-90a6-0c148ae8c543 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:24.364991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b69ffda0-56e7-46fe-90a6-0c148ae8c543 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083230 Jul 21 22:21:24.365575 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 598/1323] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:24 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:24.451773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1245a332-4e74-49d7-8155-1306f42ad68f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:24.459605 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1245a332-4e74-49d7-8155-1306f42ad68f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.153992 Jul 21 22:21:24.460164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 726/1324] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:24 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:24.776035 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-88310c61-ab52-4c1a-a643-2cfe721ce919 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:24.776644 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-88310c61-ab52-4c1a-a643-2cfe721ce919 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:24.783265 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-88310c61-ab52-4c1a-a643-2cfe721ce919 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:24.783714 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-88310c61-ab52-4c1a-a643-2cfe721ce919 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:24.784471 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-88310c61-ab52-4c1a-a643-2cfe721ce919 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:24.784903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-88310c61-ab52-4c1a-a643-2cfe721ce919 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:25.114419 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-88310c61-ab52-4c1a-a643-2cfe721ce919 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:25.122210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-88310c61-ab52-4c1a-a643-2cfe721ce919 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.349989 Jul 21 22:21:25.122778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 599/1325] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:24 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:25.381276 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fa636179-0e81-4997-a3bd-c29a9af73a5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:25.381818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fa636179-0e81-4997-a3bd-c29a9af73a5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:25.388263 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa636179-0e81-4997-a3bd-c29a9af73a5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:25.388720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa636179-0e81-4997-a3bd-c29a9af73a5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:25.389489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa636179-0e81-4997-a3bd-c29a9af73a5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:25.390265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa636179-0e81-4997-a3bd-c29a9af73a5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:25.450466 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fa636179-0e81-4997-a3bd-c29a9af73a5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:25.458383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fa636179-0e81-4997-a3bd-c29a9af73a5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081061 Jul 21 22:21:25.458946 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 727/1326] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:25 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:25.476842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bedcfbbd-0680-4ba5-b3ac-0a768746e3fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:25.477457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bedcfbbd-0680-4ba5-b3ac-0a768746e3fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:25.483970 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bedcfbbd-0680-4ba5-b3ac-0a768746e3fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:25.484420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bedcfbbd-0680-4ba5-b3ac-0a768746e3fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:25.485189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bedcfbbd-0680-4ba5-b3ac-0a768746e3fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:25.486182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bedcfbbd-0680-4ba5-b3ac-0a768746e3fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:25.614541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bedcfbbd-0680-4ba5-b3ac-0a768746e3fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:25.622396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bedcfbbd-0680-4ba5-b3ac-0a768746e3fd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149380 Jul 21 22:21:25.622964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 600/1327] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:25 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:26.139892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8772ef54-bc16-45f4-916b-72e39afb0cd3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:26.140525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8772ef54-bc16-45f4-916b-72e39afb0cd3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:26.142958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=80 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:26.148372 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8772ef54-bc16-45f4-916b-72e39afb0cd3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:26.148804 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8772ef54-bc16-45f4-916b-72e39afb0cd3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:26.149560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8772ef54-bc16-45f4-916b-72e39afb0cd3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:26.149991 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8772ef54-bc16-45f4-916b-72e39afb0cd3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:26.276694 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8772ef54-bc16-45f4-916b-72e39afb0cd3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:26.284709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8772ef54-bc16-45f4-916b-72e39afb0cd3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148445 Jul 21 22:21:26.285266 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 728/1328] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:26 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:26.475414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-65b67cb1-6398-4f25-88b2-ee9897ce82b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:26.475953 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-65b67cb1-6398-4f25-88b2-ee9897ce82b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:26.477796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=80 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:26.483966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-65b67cb1-6398-4f25-88b2-ee9897ce82b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:26.484131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-65b67cb1-6398-4f25-88b2-ee9897ce82b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:26.484909 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-65b67cb1-6398-4f25-88b2-ee9897ce82b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:26.485850 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-65b67cb1-6398-4f25-88b2-ee9897ce82b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:26.546380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-65b67cb1-6398-4f25-88b2-ee9897ce82b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:26.554696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-65b67cb1-6398-4f25-88b2-ee9897ce82b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083371 Jul 21 22:21:26.555303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 601/1329] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:26 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:26.646444 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-141eeeef-8275-4820-bb1e-202d19ef68bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:26.647067 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-141eeeef-8275-4820-bb1e-202d19ef68bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:26.653442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-141eeeef-8275-4820-bb1e-202d19ef68bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:26.653926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-141eeeef-8275-4820-bb1e-202d19ef68bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:26.654699 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-141eeeef-8275-4820-bb1e-202d19ef68bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:26.655214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-141eeeef-8275-4820-bb1e-202d19ef68bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:26.791316 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-141eeeef-8275-4820-bb1e-202d19ef68bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:26.799947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-141eeeef-8275-4820-bb1e-202d19ef68bc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.157410 Jul 21 22:21:26.800513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 729/1330] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:26 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:27.301821 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4ae91338-1c2c-40e9-864e-f2032675da0b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:27.302435 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4ae91338-1c2c-40e9-864e-f2032675da0b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:27.308611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ae91338-1c2c-40e9-864e-f2032675da0b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:27.309066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ae91338-1c2c-40e9-864e-f2032675da0b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:27.309832 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ae91338-1c2c-40e9-864e-f2032675da0b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:27.310272 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ae91338-1c2c-40e9-864e-f2032675da0b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:27.436147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4ae91338-1c2c-40e9-864e-f2032675da0b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:27.444627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4ae91338-1c2c-40e9-864e-f2032675da0b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146653 Jul 21 22:21:27.445188 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 602/1331] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:27 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:27.572397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-789fd6a7-98e3-4c94-80b4-cf00646a5fdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:27.572943 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-789fd6a7-98e3-4c94-80b4-cf00646a5fdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:27.578885 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-789fd6a7-98e3-4c94-80b4-cf00646a5fdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:27.579356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-789fd6a7-98e3-4c94-80b4-cf00646a5fdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:27.580112 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-789fd6a7-98e3-4c94-80b4-cf00646a5fdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:27.580542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-789fd6a7-98e3-4c94-80b4-cf00646a5fdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:27.640163 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-789fd6a7-98e3-4c94-80b4-cf00646a5fdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:27.647951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-789fd6a7-98e3-4c94-80b4-cf00646a5fdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079385 Jul 21 22:21:27.648669 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 730/1332] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:27 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:27.816649 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5b21c99e-feff-438b-b4ca-52dfe664c492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:27.817256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5b21c99e-feff-438b-b4ca-52dfe664c492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:27.823854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5b21c99e-feff-438b-b4ca-52dfe664c492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:27.824245 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5b21c99e-feff-438b-b4ca-52dfe664c492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:27.825005 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5b21c99e-feff-438b-b4ca-52dfe664c492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:27.825436 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5b21c99e-feff-438b-b4ca-52dfe664c492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:27.954433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5b21c99e-feff-438b-b4ca-52dfe664c492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:27.962707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5b21c99e-feff-438b-b4ca-52dfe664c492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149883 Jul 21 22:21:27.963398 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 603/1333] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:27 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:28.462182 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ab66e6aa-b585-405a-b7b4-1d9f00158f6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:28.462706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ab66e6aa-b585-405a-b7b4-1d9f00158f6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:28.469680 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ab66e6aa-b585-405a-b7b4-1d9f00158f6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:28.470123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ab66e6aa-b585-405a-b7b4-1d9f00158f6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:28.471178 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ab66e6aa-b585-405a-b7b4-1d9f00158f6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:28.471611 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ab66e6aa-b585-405a-b7b4-1d9f00158f6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:28.598802 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ab66e6aa-b585-405a-b7b4-1d9f00158f6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:28.606562 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ab66e6aa-b585-405a-b7b4-1d9f00158f6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148276 Jul 21 22:21:28.607148 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 731/1334] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:28 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:28.664083 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-173c8d31-4885-4674-97d2-743b522bddcb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:28.664691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-173c8d31-4885-4674-97d2-743b522bddcb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:28.670657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-173c8d31-4885-4674-97d2-743b522bddcb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:28.671135 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-173c8d31-4885-4674-97d2-743b522bddcb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:28.671928 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-173c8d31-4885-4674-97d2-743b522bddcb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:28.672366 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-173c8d31-4885-4674-97d2-743b522bddcb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:28.739124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-173c8d31-4885-4674-97d2-743b522bddcb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:28.747018 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-173c8d31-4885-4674-97d2-743b522bddcb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.086688 Jul 21 22:21:28.747586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 604/1335] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:28 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:28.980637 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-40c4ed08-e5d7-4a14-a1f7-a29085797715 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:28.981391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-40c4ed08-e5d7-4a14-a1f7-a29085797715 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:28.988832 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40c4ed08-e5d7-4a14-a1f7-a29085797715 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:28.989234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40c4ed08-e5d7-4a14-a1f7-a29085797715 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:28.990000 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40c4ed08-e5d7-4a14-a1f7-a29085797715 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:28.990465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40c4ed08-e5d7-4a14-a1f7-a29085797715 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:29.118179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-40c4ed08-e5d7-4a14-a1f7-a29085797715 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:29.126085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-40c4ed08-e5d7-4a14-a1f7-a29085797715 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149308 Jul 21 22:21:29.126655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 732/1336] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:28 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:29.623572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-efc9a6ac-9004-4cf7-86c9-b3dda8de1949 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:29.624190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-efc9a6ac-9004-4cf7-86c9-b3dda8de1949 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:29.631352 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efc9a6ac-9004-4cf7-86c9-b3dda8de1949 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:29.631932 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efc9a6ac-9004-4cf7-86c9-b3dda8de1949 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:29.632700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efc9a6ac-9004-4cf7-86c9-b3dda8de1949 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:29.633136 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efc9a6ac-9004-4cf7-86c9-b3dda8de1949 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:29.758427 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-efc9a6ac-9004-4cf7-86c9-b3dda8de1949 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:29.761962 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:29.764188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-46604378-4e8f-459f-ab37-51f6a5002612 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:29.764793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-46604378-4e8f-459f-ab37-51f6a5002612 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:29.768500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-efc9a6ac-9004-4cf7-86c9-b3dda8de1949 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148753 Jul 21 22:21:29.769075 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 605/1337] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:29 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:29.771931 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-46604378-4e8f-459f-ab37-51f6a5002612 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:29.772390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-46604378-4e8f-459f-ab37-51f6a5002612 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:29.773142 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-46604378-4e8f-459f-ab37-51f6a5002612 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:29.773576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-46604378-4e8f-459f-ab37-51f6a5002612 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:29.836891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-46604378-4e8f-459f-ab37-51f6a5002612 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:29.845490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-46604378-4e8f-459f-ab37-51f6a5002612 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084276 Jul 21 22:21:29.846055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 733/1338] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:29 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:30.143426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-be4b0f28-45f4-4652-b212-cf7ca2b590fb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:30.144037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-be4b0f28-45f4-4652-b212-cf7ca2b590fb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:30.149999 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be4b0f28-45f4-4652-b212-cf7ca2b590fb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:30.150445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be4b0f28-45f4-4652-b212-cf7ca2b590fb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:30.151237 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be4b0f28-45f4-4652-b212-cf7ca2b590fb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:30.151670 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be4b0f28-45f4-4652-b212-cf7ca2b590fb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:30.276422 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-be4b0f28-45f4-4652-b212-cf7ca2b590fb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:30.284909 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-be4b0f28-45f4-4652-b212-cf7ca2b590fb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.145862 Jul 21 22:21:30.285480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 606/1339] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:30 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:30.785637 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-eaf81f1d-2993-4f2e-ba8b-a2ded6e2144c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:30.786160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-eaf81f1d-2993-4f2e-ba8b-a2ded6e2144c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:30.792761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eaf81f1d-2993-4f2e-ba8b-a2ded6e2144c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:30.793211 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eaf81f1d-2993-4f2e-ba8b-a2ded6e2144c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:30.794009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eaf81f1d-2993-4f2e-ba8b-a2ded6e2144c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:30.794445 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eaf81f1d-2993-4f2e-ba8b-a2ded6e2144c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:30.862023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dfc4d3e3-3356-4440-a271-544eb005d266 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:30.862672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dfc4d3e3-3356-4440-a271-544eb005d266 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:30.869109 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dfc4d3e3-3356-4440-a271-544eb005d266 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:30.869565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dfc4d3e3-3356-4440-a271-544eb005d266 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:30.870375 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dfc4d3e3-3356-4440-a271-544eb005d266 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:30.870812 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dfc4d3e3-3356-4440-a271-544eb005d266 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:30.944894 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dfc4d3e3-3356-4440-a271-544eb005d266 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:30.949067 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-eaf81f1d-2993-4f2e-ba8b-a2ded6e2144c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:30.952794 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dfc4d3e3-3356-4440-a271-544eb005d266 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.095049 Jul 21 22:21:30.953381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 607/1340] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:30 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:30.957115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-eaf81f1d-2993-4f2e-ba8b-a2ded6e2144c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.175417 Jul 21 22:21:30.957669 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 734/1341] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:30 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:31.301934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0cfebbdd-802a-4124-a20c-4614248a4489 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:31.302544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0cfebbdd-802a-4124-a20c-4614248a4489 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:31.308831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0cfebbdd-802a-4124-a20c-4614248a4489 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:31.309282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0cfebbdd-802a-4124-a20c-4614248a4489 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:31.310047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0cfebbdd-802a-4124-a20c-4614248a4489 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:31.310484 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0cfebbdd-802a-4124-a20c-4614248a4489 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:31.439423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0cfebbdd-802a-4124-a20c-4614248a4489 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:31.447295 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0cfebbdd-802a-4124-a20c-4614248a4489 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149883 Jul 21 22:21:31.447855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 608/1342] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:31 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:31.969191 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b154a777-11b4-4583-b521-dfe64c1a418d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:31.969805 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b154a777-11b4-4583-b521-dfe64c1a418d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:31.973557 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ab860685-2e6f-4f02-98b4-a8c89d608ead tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:31.974163 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ab860685-2e6f-4f02-98b4-a8c89d608ead tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:31.976738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b154a777-11b4-4583-b521-dfe64c1a418d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:31.977198 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b154a777-11b4-4583-b521-dfe64c1a418d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:31.977975 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b154a777-11b4-4583-b521-dfe64c1a418d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:31.978418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b154a777-11b4-4583-b521-dfe64c1a418d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:31.980362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ab860685-2e6f-4f02-98b4-a8c89d608ead tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:31.980803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ab860685-2e6f-4f02-98b4-a8c89d608ead tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:31.981573 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ab860685-2e6f-4f02-98b4-a8c89d608ead tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:31.982016 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ab860685-2e6f-4f02-98b4-a8c89d608ead tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:32.064300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b154a777-11b4-4583-b521-dfe64c1a418d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:32.072191 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b154a777-11b4-4583-b521-dfe64c1a418d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.106860 Jul 21 22:21:32.072808 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 735/1343] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:31 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:32.133445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ab860685-2e6f-4f02-98b4-a8c89d608ead tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:32.142014 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ab860685-2e6f-4f02-98b4-a8c89d608ead tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.171751 Jul 21 22:21:32.142628 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 609/1344] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:31 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:32.464711 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-201a0d6b-8ece-4587-9e00-3eda56bb9b92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:32.465328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-201a0d6b-8ece-4587-9e00-3eda56bb9b92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:32.471598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-201a0d6b-8ece-4587-9e00-3eda56bb9b92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:32.472049 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-201a0d6b-8ece-4587-9e00-3eda56bb9b92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:32.472819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-201a0d6b-8ece-4587-9e00-3eda56bb9b92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:32.473255 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-201a0d6b-8ece-4587-9e00-3eda56bb9b92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:32.606955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-201a0d6b-8ece-4587-9e00-3eda56bb9b92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:32.615347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-201a0d6b-8ece-4587-9e00-3eda56bb9b92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.154486 Jul 21 22:21:32.615911 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 736/1345] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:32 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:33.089397 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a9864e66-c8f9-4469-b2d7-56f1fb505d37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:33.090005 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a9864e66-c8f9-4469-b2d7-56f1fb505d37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:33.097301 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a9864e66-c8f9-4469-b2d7-56f1fb505d37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:33.097760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a9864e66-c8f9-4469-b2d7-56f1fb505d37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:33.098523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a9864e66-c8f9-4469-b2d7-56f1fb505d37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:33.098959 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a9864e66-c8f9-4469-b2d7-56f1fb505d37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:33.158971 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f31a4a96-942c-49f8-9829-401d37ba3945 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:33.159603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f31a4a96-942c-49f8-9829-401d37ba3945 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:33.159727 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a9864e66-c8f9-4469-b2d7-56f1fb505d37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:33.166026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f31a4a96-942c-49f8-9829-401d37ba3945 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:33.166473 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f31a4a96-942c-49f8-9829-401d37ba3945 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:33.167268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f31a4a96-942c-49f8-9829-401d37ba3945 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:33.167617 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a9864e66-c8f9-4469-b2d7-56f1fb505d37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082052 Jul 21 22:21:33.167741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f31a4a96-942c-49f8-9829-401d37ba3945 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:33.168189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 610/1346] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:33 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:33.519197 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f31a4a96-942c-49f8-9829-401d37ba3945 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:33.527048 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f31a4a96-942c-49f8-9829-401d37ba3945 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.372411 Jul 21 22:21:33.527617 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 737/1347] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:33 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:33.632497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-253705c8-cb06-45f2-bc7e-6f5304cbfb9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:33.633107 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-253705c8-cb06-45f2-bc7e-6f5304cbfb9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:33.639136 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-253705c8-cb06-45f2-bc7e-6f5304cbfb9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:33.639594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-253705c8-cb06-45f2-bc7e-6f5304cbfb9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:33.640359 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-253705c8-cb06-45f2-bc7e-6f5304cbfb9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:33.640804 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-253705c8-cb06-45f2-bc7e-6f5304cbfb9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:33.764574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-253705c8-cb06-45f2-bc7e-6f5304cbfb9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:33.773090 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-253705c8-cb06-45f2-bc7e-6f5304cbfb9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.144445 Jul 21 22:21:33.773665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 611/1348] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:33 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:34.185789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-23607732-3c60-4932-84da-e203808d37d9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:34.186278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-23607732-3c60-4932-84da-e203808d37d9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:34.192784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23607732-3c60-4932-84da-e203808d37d9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:34.193240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23607732-3c60-4932-84da-e203808d37d9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:34.194012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23607732-3c60-4932-84da-e203808d37d9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:34.194456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23607732-3c60-4932-84da-e203808d37d9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:34.257607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-23607732-3c60-4932-84da-e203808d37d9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:34.265508 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-23607732-3c60-4932-84da-e203808d37d9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083911 Jul 21 22:21:34.266065 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 738/1349] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:34 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:34.544032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ff35ce91-e1f6-4d46-b676-c33c3c353085 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:34.544961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ff35ce91-e1f6-4d46-b676-c33c3c353085 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:34.551407 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff35ce91-e1f6-4d46-b676-c33c3c353085 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:34.551855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff35ce91-e1f6-4d46-b676-c33c3c353085 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:34.552614 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff35ce91-e1f6-4d46-b676-c33c3c353085 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:34.553047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff35ce91-e1f6-4d46-b676-c33c3c353085 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:34.677125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ff35ce91-e1f6-4d46-b676-c33c3c353085 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:34.684934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ff35ce91-e1f6-4d46-b676-c33c3c353085 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.145074 Jul 21 22:21:34.685501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 612/1350] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:34 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:34.790607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cb1c1b6b-dabe-493c-8da9-5eed88ba2eb6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:34.791192 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cb1c1b6b-dabe-493c-8da9-5eed88ba2eb6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:34.797361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cb1c1b6b-dabe-493c-8da9-5eed88ba2eb6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:34.797817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cb1c1b6b-dabe-493c-8da9-5eed88ba2eb6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:34.798619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cb1c1b6b-dabe-493c-8da9-5eed88ba2eb6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:34.799084 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cb1c1b6b-dabe-493c-8da9-5eed88ba2eb6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:34.923787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-cb1c1b6b-dabe-493c-8da9-5eed88ba2eb6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:34.931668 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cb1c1b6b-dabe-493c-8da9-5eed88ba2eb6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.144962 Jul 21 22:21:34.932231 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 739/1351] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:34 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:35.282655 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-74aef9ed-9f9d-40c4-857c-781fa12eeb3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:35.283318 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-74aef9ed-9f9d-40c4-857c-781fa12eeb3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:35.289293 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-74aef9ed-9f9d-40c4-857c-781fa12eeb3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:35.289740 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-74aef9ed-9f9d-40c4-857c-781fa12eeb3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:35.290500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-74aef9ed-9f9d-40c4-857c-781fa12eeb3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:35.290936 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-74aef9ed-9f9d-40c4-857c-781fa12eeb3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:35.353923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-74aef9ed-9f9d-40c4-857c-781fa12eeb3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:35.362132 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-74aef9ed-9f9d-40c4-857c-781fa12eeb3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083941 Jul 21 22:21:35.362698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 613/1352] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:35 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:35.701254 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4971b4d5-3385-4e34-8469-040fcbc0bb23 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:35.701868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4971b4d5-3385-4e34-8469-040fcbc0bb23 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:35.709091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4971b4d5-3385-4e34-8469-040fcbc0bb23 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:35.709542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4971b4d5-3385-4e34-8469-040fcbc0bb23 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:35.710303 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4971b4d5-3385-4e34-8469-040fcbc0bb23 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:35.710739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4971b4d5-3385-4e34-8469-040fcbc0bb23 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:35.837374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4971b4d5-3385-4e34-8469-040fcbc0bb23 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:35.845557 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4971b4d5-3385-4e34-8469-040fcbc0bb23 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147893 Jul 21 22:21:35.846122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 740/1353] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:35 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:35.948381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-aee0f58b-37da-428e-a4b9-162c3b55b5a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:35.948991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-aee0f58b-37da-428e-a4b9-162c3b55b5a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:35.956363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aee0f58b-37da-428e-a4b9-162c3b55b5a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:35.956754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aee0f58b-37da-428e-a4b9-162c3b55b5a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:35.957517 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aee0f58b-37da-428e-a4b9-162c3b55b5a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:35.957952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aee0f58b-37da-428e-a4b9-162c3b55b5a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:36.085112 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-aee0f58b-37da-428e-a4b9-162c3b55b5a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:36.092902 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-aee0f58b-37da-428e-a4b9-162c3b55b5a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148298 Jul 21 22:21:36.093470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 614/1354] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:35 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:36.378963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5d43ed0e-7f17-4b8e-bf8d-e170ba359a65 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:36.379737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5d43ed0e-7f17-4b8e-bf8d-e170ba359a65 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:36.385591 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d43ed0e-7f17-4b8e-bf8d-e170ba359a65 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:36.386042 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d43ed0e-7f17-4b8e-bf8d-e170ba359a65 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:36.386807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d43ed0e-7f17-4b8e-bf8d-e170ba359a65 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:36.387297 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d43ed0e-7f17-4b8e-bf8d-e170ba359a65 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:36.449696 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5d43ed0e-7f17-4b8e-bf8d-e170ba359a65 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:36.457610 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5d43ed0e-7f17-4b8e-bf8d-e170ba359a65 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083111 Jul 21 22:21:36.458170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 741/1355] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:36 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:36.861687 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5fb75536-91b5-467d-b70e-fa2bd2267aaa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:36.862299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5fb75536-91b5-467d-b70e-fa2bd2267aaa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:36.868407 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5fb75536-91b5-467d-b70e-fa2bd2267aaa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:36.868855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5fb75536-91b5-467d-b70e-fa2bd2267aaa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:36.869611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5fb75536-91b5-467d-b70e-fa2bd2267aaa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:36.870042 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5fb75536-91b5-467d-b70e-fa2bd2267aaa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:36.994703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5fb75536-91b5-467d-b70e-fa2bd2267aaa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:37.002482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5fb75536-91b5-467d-b70e-fa2bd2267aaa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.144706 Jul 21 22:21:37.003063 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 615/1356] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:36 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:37.109457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-92a8a5a9-9756-4467-829e-2a251e64e83a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:37.110069 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-92a8a5a9-9756-4467-829e-2a251e64e83a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:37.116742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92a8a5a9-9756-4467-829e-2a251e64e83a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:37.117134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92a8a5a9-9756-4467-829e-2a251e64e83a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:37.117900 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92a8a5a9-9756-4467-829e-2a251e64e83a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:37.118339 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92a8a5a9-9756-4467-829e-2a251e64e83a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:37.246982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-92a8a5a9-9756-4467-829e-2a251e64e83a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:37.250842 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:37.256085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-92a8a5a9-9756-4467-829e-2a251e64e83a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150415 Jul 21 22:21:37.256651 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 742/1357] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:37 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:37.474537 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8f5df00a-da76-4d42-8902-d6159d826bc1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:37.475192 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8f5df00a-da76-4d42-8902-d6159d826bc1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:37.481391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f5df00a-da76-4d42-8902-d6159d826bc1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:37.481841 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f5df00a-da76-4d42-8902-d6159d826bc1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:37.482643 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f5df00a-da76-4d42-8902-d6159d826bc1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:37.483554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f5df00a-da76-4d42-8902-d6159d826bc1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:37.546470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8f5df00a-da76-4d42-8902-d6159d826bc1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:37.554848 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8f5df00a-da76-4d42-8902-d6159d826bc1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084404 Jul 21 22:21:37.555449 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 616/1358] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:37 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:38.019220 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-201b76ae-b623-409b-86cd-7d37a99488c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:38.019821 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-201b76ae-b623-409b-86cd-7d37a99488c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:38.025733 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-201b76ae-b623-409b-86cd-7d37a99488c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:38.026177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-201b76ae-b623-409b-86cd-7d37a99488c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:38.026931 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-201b76ae-b623-409b-86cd-7d37a99488c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:38.027386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-201b76ae-b623-409b-86cd-7d37a99488c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:38.156109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-201b76ae-b623-409b-86cd-7d37a99488c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:38.167337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-201b76ae-b623-409b-86cd-7d37a99488c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152739 Jul 21 22:21:38.168363 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 743/1359] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:38 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:38.273678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9f67db71-5fc8-4895-b5c3-2b44cc0e002e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:38.274224 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9f67db71-5fc8-4895-b5c3-2b44cc0e002e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:38.280930 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9f67db71-5fc8-4895-b5c3-2b44cc0e002e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:38.281377 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9f67db71-5fc8-4895-b5c3-2b44cc0e002e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:38.282182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9f67db71-5fc8-4895-b5c3-2b44cc0e002e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:38.282617 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9f67db71-5fc8-4895-b5c3-2b44cc0e002e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:38.409632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9f67db71-5fc8-4895-b5c3-2b44cc0e002e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:38.417941 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9f67db71-5fc8-4895-b5c3-2b44cc0e002e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148170 Jul 21 22:21:38.418517 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 617/1360] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:38 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:38.571497 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ac86044b-16aa-4de4-b016-9959f998eb0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:38.572039 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ac86044b-16aa-4de4-b016-9959f998eb0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:38.578004 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ac86044b-16aa-4de4-b016-9959f998eb0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:38.578453 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ac86044b-16aa-4de4-b016-9959f998eb0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:38.579247 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ac86044b-16aa-4de4-b016-9959f998eb0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:38.579685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ac86044b-16aa-4de4-b016-9959f998eb0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:38.643355 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ac86044b-16aa-4de4-b016-9959f998eb0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:38.651271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ac86044b-16aa-4de4-b016-9959f998eb0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083640 Jul 21 22:21:38.651834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 744/1361] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:38 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:39.184805 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cd4f26b6-cf37-4fb5-8c9b-52633593cab3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:39.185410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cd4f26b6-cf37-4fb5-8c9b-52633593cab3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:39.191597 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd4f26b6-cf37-4fb5-8c9b-52633593cab3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:39.192044 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd4f26b6-cf37-4fb5-8c9b-52633593cab3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:39.192801 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd4f26b6-cf37-4fb5-8c9b-52633593cab3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:39.193234 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd4f26b6-cf37-4fb5-8c9b-52633593cab3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:39.322777 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cd4f26b6-cf37-4fb5-8c9b-52633593cab3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:39.331146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cd4f26b6-cf37-4fb5-8c9b-52633593cab3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.150053 Jul 21 22:21:39.331708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 618/1362] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:39 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:39.436992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f60951cd-dc25-44a0-874f-e329dcde3824 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:39.438643 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f60951cd-dc25-44a0-874f-e329dcde3824 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:39.446077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f60951cd-dc25-44a0-874f-e329dcde3824 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:39.446524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f60951cd-dc25-44a0-874f-e329dcde3824 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:39.447320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f60951cd-dc25-44a0-874f-e329dcde3824 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:39.447763 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f60951cd-dc25-44a0-874f-e329dcde3824 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:39.573452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f60951cd-dc25-44a0-874f-e329dcde3824 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:39.581900 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f60951cd-dc25-44a0-874f-e329dcde3824 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149576 Jul 21 22:21:39.582468 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 745/1363] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:39 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:39.668210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-96d90719-193b-4d72-af1b-4229a770c733 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:39.668827 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-96d90719-193b-4d72-af1b-4229a770c733 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:39.674759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96d90719-193b-4d72-af1b-4229a770c733 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:39.675256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96d90719-193b-4d72-af1b-4229a770c733 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:39.676026 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96d90719-193b-4d72-af1b-4229a770c733 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:39.676470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96d90719-193b-4d72-af1b-4229a770c733 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:39.739943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-96d90719-193b-4d72-af1b-4229a770c733 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:39.747763 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-96d90719-193b-4d72-af1b-4229a770c733 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083331 Jul 21 22:21:39.748322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 619/1364] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:39 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:40.348729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-26d519e0-d069-4dc2-a4f0-be526f4a91e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:40.349340 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-26d519e0-d069-4dc2-a4f0-be526f4a91e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:40.355457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26d519e0-d069-4dc2-a4f0-be526f4a91e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:40.355908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26d519e0-d069-4dc2-a4f0-be526f4a91e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:40.356701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26d519e0-d069-4dc2-a4f0-be526f4a91e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:40.357140 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-26d519e0-d069-4dc2-a4f0-be526f4a91e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:40.485456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-26d519e0-d069-4dc2-a4f0-be526f4a91e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:40.493445 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-26d519e0-d069-4dc2-a4f0-be526f4a91e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149274 Jul 21 22:21:40.494005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 746/1365] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:40 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:40.599987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-67dabff1-7c4a-459e-b2ea-c851848c7d64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:40.600600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-67dabff1-7c4a-459e-b2ea-c851848c7d64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:40.607125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67dabff1-7c4a-459e-b2ea-c851848c7d64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:40.607578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67dabff1-7c4a-459e-b2ea-c851848c7d64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:40.608344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67dabff1-7c4a-459e-b2ea-c851848c7d64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:40.608782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67dabff1-7c4a-459e-b2ea-c851848c7d64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:40.734394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-67dabff1-7c4a-459e-b2ea-c851848c7d64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:40.742229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-67dabff1-7c4a-459e-b2ea-c851848c7d64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146117 Jul 21 22:21:40.742805 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 620/1366] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:40 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:40.764681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4b135b90-e721-4596-a013-1a4f8fa6b8da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:40.765308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4b135b90-e721-4596-a013-1a4f8fa6b8da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:40.772180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b135b90-e721-4596-a013-1a4f8fa6b8da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:40.772603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b135b90-e721-4596-a013-1a4f8fa6b8da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:40.773381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b135b90-e721-4596-a013-1a4f8fa6b8da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:40.773846 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b135b90-e721-4596-a013-1a4f8fa6b8da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:40.849984 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4b135b90-e721-4596-a013-1a4f8fa6b8da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:40.857937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4b135b90-e721-4596-a013-1a4f8fa6b8da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.097046 Jul 21 22:21:40.858497 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 747/1367] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:40 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:41.510544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dbaa438d-281b-43c5-99c5-28ae8eec941a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:41.511205 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dbaa438d-281b-43c5-99c5-28ae8eec941a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:41.517273 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbaa438d-281b-43c5-99c5-28ae8eec941a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:41.517728 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbaa438d-281b-43c5-99c5-28ae8eec941a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:41.518494 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbaa438d-281b-43c5-99c5-28ae8eec941a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:41.518933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbaa438d-281b-43c5-99c5-28ae8eec941a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:41.650296 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dbaa438d-281b-43c5-99c5-28ae8eec941a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:41.658592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dbaa438d-281b-43c5-99c5-28ae8eec941a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.151911 Jul 21 22:21:41.659284 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 621/1368] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:41 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:41.759090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f7e21504-34d0-4c2f-8727-5189b348766d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:41.759643 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f7e21504-34d0-4c2f-8727-5189b348766d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:41.765948 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f7e21504-34d0-4c2f-8727-5189b348766d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:41.766392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f7e21504-34d0-4c2f-8727-5189b348766d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:41.767177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f7e21504-34d0-4c2f-8727-5189b348766d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:41.767613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f7e21504-34d0-4c2f-8727-5189b348766d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:41.874510 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c61a58de-8d1e-4a10-930f-0fdbbea83163 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:41.875156 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c61a58de-8d1e-4a10-930f-0fdbbea83163 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:41.881147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c61a58de-8d1e-4a10-930f-0fdbbea83163 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:41.881604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c61a58de-8d1e-4a10-930f-0fdbbea83163 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:41.882386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c61a58de-8d1e-4a10-930f-0fdbbea83163 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:41.882830 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c61a58de-8d1e-4a10-930f-0fdbbea83163 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:41.894062 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f7e21504-34d0-4c2f-8727-5189b348766d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:41.900935 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:41.902359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f7e21504-34d0-4c2f-8727-5189b348766d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146956 Jul 21 22:21:41.902986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 748/1369] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:41 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:41.947841 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c61a58de-8d1e-4a10-930f-0fdbbea83163 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:41.955687 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c61a58de-8d1e-4a10-930f-0fdbbea83163 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085032 Jul 21 22:21:41.956256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 622/1370] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:41 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:42.675615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6666f9ff-c58c-4cef-aa02-e19f4303c690 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:42.676226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6666f9ff-c58c-4cef-aa02-e19f4303c690 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:42.682287 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6666f9ff-c58c-4cef-aa02-e19f4303c690 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:42.682743 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6666f9ff-c58c-4cef-aa02-e19f4303c690 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:42.683541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6666f9ff-c58c-4cef-aa02-e19f4303c690 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:42.683980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6666f9ff-c58c-4cef-aa02-e19f4303c690 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:42.813696 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6666f9ff-c58c-4cef-aa02-e19f4303c690 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:42.821593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6666f9ff-c58c-4cef-aa02-e19f4303c690 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.150325 Jul 21 22:21:42.822156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 749/1371] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:42 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:42.920039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d1cef642-4de4-489e-b117-6564c0f17576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:42.920649 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d1cef642-4de4-489e-b117-6564c0f17576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:42.927673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1cef642-4de4-489e-b117-6564c0f17576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:42.928122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1cef642-4de4-489e-b117-6564c0f17576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:42.928877 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1cef642-4de4-489e-b117-6564c0f17576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:42.929310 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1cef642-4de4-489e-b117-6564c0f17576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:42.972597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-60247944-2f65-47e7-aa96-bd7c25e679ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:42.973212 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-60247944-2f65-47e7-aa96-bd7c25e679ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:42.979274 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60247944-2f65-47e7-aa96-bd7c25e679ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:42.979727 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60247944-2f65-47e7-aa96-bd7c25e679ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:42.980501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60247944-2f65-47e7-aa96-bd7c25e679ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:42.980936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-60247944-2f65-47e7-aa96-bd7c25e679ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:43.055418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-60247944-2f65-47e7-aa96-bd7c25e679ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:43.064174 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-60247944-2f65-47e7-aa96-bd7c25e679ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.095658 Jul 21 22:21:43.064952 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 750/1372] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:42 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:43.084158 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d1cef642-4de4-489e-b117-6564c0f17576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:43.092177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d1cef642-4de4-489e-b117-6564c0f17576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.176014 Jul 21 22:21:43.092750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 623/1373] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:42 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:43.837778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0230b633-24b4-4a55-84b1-8035e64aff89 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:43.838322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0230b633-24b4-4a55-84b1-8035e64aff89 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:43.845804 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0230b633-24b4-4a55-84b1-8035e64aff89 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:43.846248 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0230b633-24b4-4a55-84b1-8035e64aff89 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:43.847032 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0230b633-24b4-4a55-84b1-8035e64aff89 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:43.847456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0230b633-24b4-4a55-84b1-8035e64aff89 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:43.974397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0230b633-24b4-4a55-84b1-8035e64aff89 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:43.982326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0230b633-24b4-4a55-84b1-8035e64aff89 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148454 Jul 21 22:21:43.982884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 751/1374] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:43 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:44.081466 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ca9a2a45-9812-4041-8950-70eb5c669213 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:44.082111 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ca9a2a45-9812-4041-8950-70eb5c669213 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:44.088663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ca9a2a45-9812-4041-8950-70eb5c669213 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:44.089064 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ca9a2a45-9812-4041-8950-70eb5c669213 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:44.089834 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ca9a2a45-9812-4041-8950-70eb5c669213 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:44.090276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ca9a2a45-9812-4041-8950-70eb5c669213 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:44.109322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c5f3da10-2df5-4349-b34f-61ee8be768ab tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:44.109925 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c5f3da10-2df5-4349-b34f-61ee8be768ab tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:44.115998 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c5f3da10-2df5-4349-b34f-61ee8be768ab tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:44.116443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c5f3da10-2df5-4349-b34f-61ee8be768ab tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:44.117197 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c5f3da10-2df5-4349-b34f-61ee8be768ab tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:44.117625 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c5f3da10-2df5-4349-b34f-61ee8be768ab tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:44.152157 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ca9a2a45-9812-4041-8950-70eb5c669213 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:44.160952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ca9a2a45-9812-4041-8950-70eb5c669213 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083856 Jul 21 22:21:44.161847 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 624/1375] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:44 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:44.259862 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c5f3da10-2df5-4349-b34f-61ee8be768ab tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:44.267775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c5f3da10-2df5-4349-b34f-61ee8be768ab tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.162200 Jul 21 22:21:44.268344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 752/1376] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:44 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:44.998786 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9dbb7304-2195-46cd-a788-dc4ea8b46df6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:44.999422 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9dbb7304-2195-46cd-a788-dc4ea8b46df6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:45.005405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9dbb7304-2195-46cd-a788-dc4ea8b46df6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:45.005850 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9dbb7304-2195-46cd-a788-dc4ea8b46df6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:45.006611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9dbb7304-2195-46cd-a788-dc4ea8b46df6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:45.007069 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9dbb7304-2195-46cd-a788-dc4ea8b46df6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:45.132638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9dbb7304-2195-46cd-a788-dc4ea8b46df6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:45.140524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9dbb7304-2195-46cd-a788-dc4ea8b46df6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.145604 Jul 21 22:21:45.141584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 625/1377] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:44 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:45.178279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-31d6f56d-b7d9-4c86-9f68-2bf65f034c3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:45.178883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-31d6f56d-b7d9-4c86-9f68-2bf65f034c3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:45.185325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31d6f56d-b7d9-4c86-9f68-2bf65f034c3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:45.185771 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31d6f56d-b7d9-4c86-9f68-2bf65f034c3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:45.186527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31d6f56d-b7d9-4c86-9f68-2bf65f034c3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:45.186957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-31d6f56d-b7d9-4c86-9f68-2bf65f034c3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:45.248518 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-31d6f56d-b7d9-4c86-9f68-2bf65f034c3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:45.259268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-31d6f56d-b7d9-4c86-9f68-2bf65f034c3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084667 Jul 21 22:21:45.259767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 753/1378] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:45 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:45.285394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9d22d175-af8b-4381-81aa-23916f93884c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:45.286006 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9d22d175-af8b-4381-81aa-23916f93884c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:45.291959 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9d22d175-af8b-4381-81aa-23916f93884c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:45.292416 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9d22d175-af8b-4381-81aa-23916f93884c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:45.293172 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9d22d175-af8b-4381-81aa-23916f93884c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:45.293606 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9d22d175-af8b-4381-81aa-23916f93884c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:45.423119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9d22d175-af8b-4381-81aa-23916f93884c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:45.431151 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9d22d175-af8b-4381-81aa-23916f93884c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150203 Jul 21 22:21:45.431716 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 626/1379] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:45 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:46.158150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b4d9f86b-f975-4d99-8839-88d459ac17c1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:46.158761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b4d9f86b-f975-4d99-8839-88d459ac17c1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:46.164810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b4d9f86b-f975-4d99-8839-88d459ac17c1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:46.165260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b4d9f86b-f975-4d99-8839-88d459ac17c1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:46.166020 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b4d9f86b-f975-4d99-8839-88d459ac17c1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:46.166454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b4d9f86b-f975-4d99-8839-88d459ac17c1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:46.277393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9444f06a-7193-416a-a46b-d45afd943795 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:46.278048 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9444f06a-7193-416a-a46b-d45afd943795 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:46.285042 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9444f06a-7193-416a-a46b-d45afd943795 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:46.285502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9444f06a-7193-416a-a46b-d45afd943795 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:46.286284 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9444f06a-7193-416a-a46b-d45afd943795 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:46.286728 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9444f06a-7193-416a-a46b-d45afd943795 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:46.296188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b4d9f86b-f975-4d99-8839-88d459ac17c1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:46.304787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b4d9f86b-f975-4d99-8839-88d459ac17c1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.151027 Jul 21 22:21:46.305360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 754/1380] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:46 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:46.348662 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9444f06a-7193-416a-a46b-d45afd943795 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:46.356593 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9444f06a-7193-416a-a46b-d45afd943795 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083205 Jul 21 22:21:46.357170 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 627/1381] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:46 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:46.448897 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-10fcf96c-2b2b-4980-a3c7-af75f9cb6ab3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:46.449434 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-10fcf96c-2b2b-4980-a3c7-af75f9cb6ab3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:46.456147 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-10fcf96c-2b2b-4980-a3c7-af75f9cb6ab3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:46.456595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-10fcf96c-2b2b-4980-a3c7-af75f9cb6ab3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:46.457358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-10fcf96c-2b2b-4980-a3c7-af75f9cb6ab3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:46.457795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-10fcf96c-2b2b-4980-a3c7-af75f9cb6ab3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:46.595080 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-10fcf96c-2b2b-4980-a3c7-af75f9cb6ab3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:46.603259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-10fcf96c-2b2b-4980-a3c7-af75f9cb6ab3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.158339 Jul 21 22:21:46.603826 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 755/1382] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:46 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:47.321713 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4ea78d09-f68a-41fe-a576-865cb35291f1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:47.322358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4ea78d09-f68a-41fe-a576-865cb35291f1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:47.328853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ea78d09-f68a-41fe-a576-865cb35291f1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:47.329307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ea78d09-f68a-41fe-a576-865cb35291f1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:47.330077 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ea78d09-f68a-41fe-a576-865cb35291f1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:47.330521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ea78d09-f68a-41fe-a576-865cb35291f1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:47.373996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ea9922c0-e365-4db1-91c1-bc331d241f69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:47.374597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ea9922c0-e365-4db1-91c1-bc331d241f69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:47.382008 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea9922c0-e365-4db1-91c1-bc331d241f69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:47.382387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea9922c0-e365-4db1-91c1-bc331d241f69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:47.383178 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea9922c0-e365-4db1-91c1-bc331d241f69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:47.383609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea9922c0-e365-4db1-91c1-bc331d241f69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:47.458358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ea9922c0-e365-4db1-91c1-bc331d241f69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:47.466213 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ea9922c0-e365-4db1-91c1-bc331d241f69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.095936 Jul 21 22:21:47.466787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 756/1383] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:47 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:47.486785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4ea78d09-f68a-41fe-a576-865cb35291f1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:47.494698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4ea78d09-f68a-41fe-a576-865cb35291f1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.176826 Jul 21 22:21:47.495298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 628/1384] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:47 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:47.620258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0b6fcd2c-ccc5-4aef-9c35-46750eba9790 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:47.620807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0b6fcd2c-ccc5-4aef-9c35-46750eba9790 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:47.627425 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b6fcd2c-ccc5-4aef-9c35-46750eba9790 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:47.627879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b6fcd2c-ccc5-4aef-9c35-46750eba9790 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:47.628648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b6fcd2c-ccc5-4aef-9c35-46750eba9790 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:47.629087 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b6fcd2c-ccc5-4aef-9c35-46750eba9790 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:47.756104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0b6fcd2c-ccc5-4aef-9c35-46750eba9790 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:47.767150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0b6fcd2c-ccc5-4aef-9c35-46750eba9790 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150627 Jul 21 22:21:47.767769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 757/1385] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:47 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:48.483369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-531dff7e-f64d-4def-aa78-19391c8cd7a4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:48.483988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-531dff7e-f64d-4def-aa78-19391c8cd7a4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:48.490522 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-531dff7e-f64d-4def-aa78-19391c8cd7a4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:48.490978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-531dff7e-f64d-4def-aa78-19391c8cd7a4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:48.491777 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-531dff7e-f64d-4def-aa78-19391c8cd7a4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:48.492217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-531dff7e-f64d-4def-aa78-19391c8cd7a4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:48.512335 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2a0715f0-f60b-400a-885e-ae749ad4e6e2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:48.512953 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2a0715f0-f60b-400a-885e-ae749ad4e6e2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:48.519990 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a0715f0-f60b-400a-885e-ae749ad4e6e2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:48.520443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a0715f0-f60b-400a-885e-ae749ad4e6e2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:48.521208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a0715f0-f60b-400a-885e-ae749ad4e6e2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:48.521645 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a0715f0-f60b-400a-885e-ae749ad4e6e2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:48.553592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-531dff7e-f64d-4def-aa78-19391c8cd7a4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:48.561589 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-531dff7e-f64d-4def-aa78-19391c8cd7a4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082073 Jul 21 22:21:48.562161 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 629/1386] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:48 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:48.653123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2a0715f0-f60b-400a-885e-ae749ad4e6e2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:48.660979 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2a0715f0-f60b-400a-885e-ae749ad4e6e2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152404 Jul 21 22:21:48.661530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 758/1387] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:48 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:48.784261 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2df00fa9-971a-46d2-9a2b-251128951de0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:48.784798 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2df00fa9-971a-46d2-9a2b-251128951de0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:48.791151 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2df00fa9-971a-46d2-9a2b-251128951de0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:48.791598 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2df00fa9-971a-46d2-9a2b-251128951de0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:48.792362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2df00fa9-971a-46d2-9a2b-251128951de0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:48.792796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2df00fa9-971a-46d2-9a2b-251128951de0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:48.921318 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2df00fa9-971a-46d2-9a2b-251128951de0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:48.929704 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2df00fa9-971a-46d2-9a2b-251128951de0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149412 Jul 21 22:21:48.930267 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 630/1388] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:48 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:49.579324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bf708c5f-1be9-494b-b0d7-c434fcb85a0c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:49.579932 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bf708c5f-1be9-494b-b0d7-c434fcb85a0c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:49.586681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf708c5f-1be9-494b-b0d7-c434fcb85a0c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:49.587155 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf708c5f-1be9-494b-b0d7-c434fcb85a0c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:49.587955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf708c5f-1be9-494b-b0d7-c434fcb85a0c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:49.588392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf708c5f-1be9-494b-b0d7-c434fcb85a0c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:49.607449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:49.656744 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bf708c5f-1be9-494b-b0d7-c434fcb85a0c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:49.664567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bf708c5f-1be9-494b-b0d7-c434fcb85a0c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.089259 Jul 21 22:21:49.665159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 759/1389] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:49 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:49.678085 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-df424b14-845b-423e-95be-db682e1c5f53 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:49.678689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-df424b14-845b-423e-95be-db682e1c5f53 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:49.684854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df424b14-845b-423e-95be-db682e1c5f53 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:49.685303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df424b14-845b-423e-95be-db682e1c5f53 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:49.686057 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df424b14-845b-423e-95be-db682e1c5f53 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:49.686490 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df424b14-845b-423e-95be-db682e1c5f53 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:49.831558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-df424b14-845b-423e-95be-db682e1c5f53 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:49.840624 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-df424b14-845b-423e-95be-db682e1c5f53 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.166192 Jul 21 22:21:49.841217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 631/1390] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:49 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:49.948162 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2502ed75-5436-4cf4-84ee-e24688242376 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:49.948774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2502ed75-5436-4cf4-84ee-e24688242376 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:49.954778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2502ed75-5436-4cf4-84ee-e24688242376 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:49.955276 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2502ed75-5436-4cf4-84ee-e24688242376 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:49.956048 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2502ed75-5436-4cf4-84ee-e24688242376 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:49.956489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2502ed75-5436-4cf4-84ee-e24688242376 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:50.083517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2502ed75-5436-4cf4-84ee-e24688242376 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:50.091436 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2502ed75-5436-4cf4-84ee-e24688242376 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147176 Jul 21 22:21:50.092002 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 760/1391] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:49 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:50.681693 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7702d2a1-f659-437e-89cf-675f6cfae31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:50.682298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7702d2a1-f659-437e-89cf-675f6cfae31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:50.688758 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7702d2a1-f659-437e-89cf-675f6cfae31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:50.689205 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7702d2a1-f659-437e-89cf-675f6cfae31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:50.689963 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7702d2a1-f659-437e-89cf-675f6cfae31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:50.690394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7702d2a1-f659-437e-89cf-675f6cfae31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:50.751665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7702d2a1-f659-437e-89cf-675f6cfae31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:50.759634 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7702d2a1-f659-437e-89cf-675f6cfae31a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081852 Jul 21 22:21:50.760200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 632/1392] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:50 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:50.858005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-91ffee7d-5f70-4332-918a-c54e5fb57aad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:50.858666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-91ffee7d-5f70-4332-918a-c54e5fb57aad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:50.865267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91ffee7d-5f70-4332-918a-c54e5fb57aad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:50.865720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91ffee7d-5f70-4332-918a-c54e5fb57aad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:50.866489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91ffee7d-5f70-4332-918a-c54e5fb57aad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:50.866929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91ffee7d-5f70-4332-918a-c54e5fb57aad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:51.011978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-91ffee7d-5f70-4332-918a-c54e5fb57aad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:51.019905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-91ffee7d-5f70-4332-918a-c54e5fb57aad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.166156 Jul 21 22:21:51.020474 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 761/1393] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:50 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:51.109253 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-972c84f6-764b-4f63-a148-8a094f80a9dd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:51.110366 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-972c84f6-764b-4f63-a148-8a094f80a9dd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:51.116473 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-972c84f6-764b-4f63-a148-8a094f80a9dd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:51.116931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-972c84f6-764b-4f63-a148-8a094f80a9dd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:51.117705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-972c84f6-764b-4f63-a148-8a094f80a9dd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:51.118148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-972c84f6-764b-4f63-a148-8a094f80a9dd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:51.275739 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-972c84f6-764b-4f63-a148-8a094f80a9dd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:51.283696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-972c84f6-764b-4f63-a148-8a094f80a9dd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.178438 Jul 21 22:21:51.284268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 633/1394] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:51 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:51.776813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f189d705-ffd9-4752-bcc8-1d2f2cc52904 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:51.777480 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f189d705-ffd9-4752-bcc8-1d2f2cc52904 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:51.788043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f189d705-ffd9-4752-bcc8-1d2f2cc52904 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:51.788497 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f189d705-ffd9-4752-bcc8-1d2f2cc52904 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:51.789272 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f189d705-ffd9-4752-bcc8-1d2f2cc52904 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:51.789709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f189d705-ffd9-4752-bcc8-1d2f2cc52904 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:51.858904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f189d705-ffd9-4752-bcc8-1d2f2cc52904 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:51.867925 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f189d705-ffd9-4752-bcc8-1d2f2cc52904 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.095225 Jul 21 22:21:51.868495 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 762/1395] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:51 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:52.037207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c4796c0b-def0-429e-b5ab-4b657661fc9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:52.037786 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c4796c0b-def0-429e-b5ab-4b657661fc9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:52.044286 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4796c0b-def0-429e-b5ab-4b657661fc9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:52.044738 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4796c0b-def0-429e-b5ab-4b657661fc9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:52.045505 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4796c0b-def0-429e-b5ab-4b657661fc9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:52.045946 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4796c0b-def0-429e-b5ab-4b657661fc9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:52.177114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c4796c0b-def0-429e-b5ab-4b657661fc9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:52.185058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c4796c0b-def0-429e-b5ab-4b657661fc9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152011 Jul 21 22:21:52.185634 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 634/1396] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:52 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:52.301556 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-127b091e-9813-49bf-aedf-decd1794a1d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:52.302067 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-127b091e-9813-49bf-aedf-decd1794a1d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:52.308121 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-127b091e-9813-49bf-aedf-decd1794a1d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:52.308578 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-127b091e-9813-49bf-aedf-decd1794a1d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:52.309348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-127b091e-9813-49bf-aedf-decd1794a1d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:52.309788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-127b091e-9813-49bf-aedf-decd1794a1d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:52.438537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-127b091e-9813-49bf-aedf-decd1794a1d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:52.446431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-127b091e-9813-49bf-aedf-decd1794a1d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149601 Jul 21 22:21:52.446989 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 763/1397] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:52 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:52.884651 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-66334ef2-71bf-4945-9a1a-7aa444abeb95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:52.885255 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-66334ef2-71bf-4945-9a1a-7aa444abeb95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:52.892161 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66334ef2-71bf-4945-9a1a-7aa444abeb95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:52.892607 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66334ef2-71bf-4945-9a1a-7aa444abeb95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:52.893551 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66334ef2-71bf-4945-9a1a-7aa444abeb95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:52.894136 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66334ef2-71bf-4945-9a1a-7aa444abeb95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:52.961290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-66334ef2-71bf-4945-9a1a-7aa444abeb95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:52.969245 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-66334ef2-71bf-4945-9a1a-7aa444abeb95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.088287 Jul 21 22:21:52.969810 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 635/1398] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:52 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:53.202160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9583c481-c437-438d-aa6e-455b4039de55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:53.202715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9583c481-c437-438d-aa6e-455b4039de55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:53.209266 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9583c481-c437-438d-aa6e-455b4039de55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:53.209711 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9583c481-c437-438d-aa6e-455b4039de55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:53.210476 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9583c481-c437-438d-aa6e-455b4039de55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:53.210907 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9583c481-c437-438d-aa6e-455b4039de55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:53.352091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9583c481-c437-438d-aa6e-455b4039de55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:53.359983 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9583c481-c437-438d-aa6e-455b4039de55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.161770 Jul 21 22:21:53.360550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 764/1399] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:53 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:53.463034 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-07083e97-c787-4532-9199-e1ccc193041a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:53.463623 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-07083e97-c787-4532-9199-e1ccc193041a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:53.470432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07083e97-c787-4532-9199-e1ccc193041a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:53.470887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07083e97-c787-4532-9199-e1ccc193041a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:53.471689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07083e97-c787-4532-9199-e1ccc193041a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:53.472129 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07083e97-c787-4532-9199-e1ccc193041a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:53.602148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-07083e97-c787-4532-9199-e1ccc193041a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:53.611757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-07083e97-c787-4532-9199-e1ccc193041a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.152807 Jul 21 22:21:53.612349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 636/1400] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:53 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:21:53.986387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5c6c1dcb-f3f2-4560-ba23-b054321dc8cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:53.987028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5c6c1dcb-f3f2-4560-ba23-b054321dc8cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:53.993576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5c6c1dcb-f3f2-4560-ba23-b054321dc8cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:53.994031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5c6c1dcb-f3f2-4560-ba23-b054321dc8cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:53.994835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5c6c1dcb-f3f2-4560-ba23-b054321dc8cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:53.995307 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5c6c1dcb-f3f2-4560-ba23-b054321dc8cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:54.063977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5c6c1dcb-f3f2-4560-ba23-b054321dc8cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:54.072097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5c6c1dcb-f3f2-4560-ba23-b054321dc8cd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.090263 Jul 21 22:21:54.072671 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 765/1401] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:53 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:54.377613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9a12639e-3670-4a6e-8c01-21879e3d4f00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:54.378177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9a12639e-3670-4a6e-8c01-21879e3d4f00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:54.384222 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9a12639e-3670-4a6e-8c01-21879e3d4f00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:54.384665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9a12639e-3670-4a6e-8c01-21879e3d4f00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:54.385422 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9a12639e-3670-4a6e-8c01-21879e3d4f00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:54.385853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9a12639e-3670-4a6e-8c01-21879e3d4f00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:54.516649 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9a12639e-3670-4a6e-8c01-21879e3d4f00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:54.524446 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9a12639e-3670-4a6e-8c01-21879e3d4f00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.151233 Jul 21 22:21:54.525008 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 637/1402] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:54 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:54.629061 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fc9a4f51-6829-4991-9e0f-30d7c39e631d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:54.629635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fc9a4f51-6829-4991-9e0f-30d7c39e631d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:54.635975 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fc9a4f51-6829-4991-9e0f-30d7c39e631d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:54.636419 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fc9a4f51-6829-4991-9e0f-30d7c39e631d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:54.637175 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fc9a4f51-6829-4991-9e0f-30d7c39e631d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:54.637603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fc9a4f51-6829-4991-9e0f-30d7c39e631d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:54.766546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fc9a4f51-6829-4991-9e0f-30d7c39e631d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:54.774586 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fc9a4f51-6829-4991-9e0f-30d7c39e631d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149856 Jul 21 22:21:54.775189 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 766/1403] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:54 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:55.089379 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-24492e8b-fd89-4af0-9319-d80741c69c52 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:55.089995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-24492e8b-fd89-4af0-9319-d80741c69c52 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:55.097010 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-24492e8b-fd89-4af0-9319-d80741c69c52 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:55.097466 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-24492e8b-fd89-4af0-9319-d80741c69c52 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:55.098238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-24492e8b-fd89-4af0-9319-d80741c69c52 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:55.098680 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-24492e8b-fd89-4af0-9319-d80741c69c52 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:55.162211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-24492e8b-fd89-4af0-9319-d80741c69c52 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:55.170427 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-24492e8b-fd89-4af0-9319-d80741c69c52 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084805 Jul 21 22:21:55.171092 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 638/1404] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:55 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:55.541297 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7d150e2b-1e49-49d7-b59e-945d750b5455 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:55.541908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7d150e2b-1e49-49d7-b59e-945d750b5455 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:55.548417 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7d150e2b-1e49-49d7-b59e-945d750b5455 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:55.548862 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7d150e2b-1e49-49d7-b59e-945d750b5455 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:55.549627 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7d150e2b-1e49-49d7-b59e-945d750b5455 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:55.550056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7d150e2b-1e49-49d7-b59e-945d750b5455 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:55.675874 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7d150e2b-1e49-49d7-b59e-945d750b5455 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:55.683771 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7d150e2b-1e49-49d7-b59e-945d750b5455 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146314 Jul 21 22:21:55.684334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 767/1405] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:55 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:55.791385 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ace7b069-aa15-46e2-9842-237724685044 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:55.791932 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ace7b069-aa15-46e2-9842-237724685044 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:55.798834 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ace7b069-aa15-46e2-9842-237724685044 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:55.799314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ace7b069-aa15-46e2-9842-237724685044 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:55.800083 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ace7b069-aa15-46e2-9842-237724685044 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:55.800523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ace7b069-aa15-46e2-9842-237724685044 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:55.804481 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:55.929202 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ace7b069-aa15-46e2-9842-237724685044 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:55.937029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ace7b069-aa15-46e2-9842-237724685044 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149504 Jul 21 22:21:55.937599 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 639/1406] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:55 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:56.187584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-23a81e68-c714-47c7-9136-6109f1d710cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:56.188189 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-23a81e68-c714-47c7-9136-6109f1d710cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:56.190043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=80 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:56.195651 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23a81e68-c714-47c7-9136-6109f1d710cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:56.196528 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23a81e68-c714-47c7-9136-6109f1d710cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:56.196859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23a81e68-c714-47c7-9136-6109f1d710cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:56.197296 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23a81e68-c714-47c7-9136-6109f1d710cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:56.271674 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-23a81e68-c714-47c7-9136-6109f1d710cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:56.280178 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-23a81e68-c714-47c7-9136-6109f1d710cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.096400 Jul 21 22:21:56.280759 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 768/1407] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:56 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:56.701234 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c5b54a17-a861-47bc-8b60-6202f7f068aa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:56.701849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c5b54a17-a861-47bc-8b60-6202f7f068aa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:56.704242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=78 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:21:56.710129 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c5b54a17-a861-47bc-8b60-6202f7f068aa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:56.710576 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c5b54a17-a861-47bc-8b60-6202f7f068aa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:56.711365 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c5b54a17-a861-47bc-8b60-6202f7f068aa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:56.711811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c5b54a17-a861-47bc-8b60-6202f7f068aa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:56.840179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c5b54a17-a861-47bc-8b60-6202f7f068aa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:56.848299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c5b54a17-a861-47bc-8b60-6202f7f068aa tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.150908 Jul 21 22:21:56.848872 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 640/1408] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:56 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:56.954592 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-697783f9-08ca-4826-820a-3080c79904cd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:56.955229 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-697783f9-08ca-4826-820a-3080c79904cd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:56.961227 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-697783f9-08ca-4826-820a-3080c79904cd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:56.961674 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-697783f9-08ca-4826-820a-3080c79904cd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:56.962439 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-697783f9-08ca-4826-820a-3080c79904cd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:56.962872 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-697783f9-08ca-4826-820a-3080c79904cd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:57.086257 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-697783f9-08ca-4826-820a-3080c79904cd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:57.094079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-697783f9-08ca-4826-820a-3080c79904cd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.144081 Jul 21 22:21:57.094642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 769/1409] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:56 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:57.297528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-93186c85-e6c1-42ea-813a-6744c253272f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:57.298132 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-93186c85-e6c1-42ea-813a-6744c253272f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:57.304436 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93186c85-e6c1-42ea-813a-6744c253272f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:57.304896 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93186c85-e6c1-42ea-813a-6744c253272f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:57.305703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93186c85-e6c1-42ea-813a-6744c253272f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:57.306145 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93186c85-e6c1-42ea-813a-6744c253272f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:57.370630 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-93186c85-e6c1-42ea-813a-6744c253272f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:57.379141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-93186c85-e6c1-42ea-813a-6744c253272f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085388 Jul 21 22:21:57.379710 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 641/1410] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:57 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:57.865523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1bded5ec-a287-4073-b9d3-cef7d8effa5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:57.866129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1bded5ec-a287-4073-b9d3-cef7d8effa5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:57.872256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1bded5ec-a287-4073-b9d3-cef7d8effa5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:57.872701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1bded5ec-a287-4073-b9d3-cef7d8effa5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:57.873448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1bded5ec-a287-4073-b9d3-cef7d8effa5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:57.873879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1bded5ec-a287-4073-b9d3-cef7d8effa5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:58.006431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1bded5ec-a287-4073-b9d3-cef7d8effa5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:58.014318 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1bded5ec-a287-4073-b9d3-cef7d8effa5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152566 Jul 21 22:21:58.014881 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 770/1411] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:57 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:58.111617 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a68b55df-3a31-4b1d-90ca-d3650abe6db7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:58.112239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a68b55df-3a31-4b1d-90ca-d3650abe6db7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:58.118786 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a68b55df-3a31-4b1d-90ca-d3650abe6db7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:58.119219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a68b55df-3a31-4b1d-90ca-d3650abe6db7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:58.119981 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a68b55df-3a31-4b1d-90ca-d3650abe6db7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:58.120414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a68b55df-3a31-4b1d-90ca-d3650abe6db7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:58.247337 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a68b55df-3a31-4b1d-90ca-d3650abe6db7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:58.255349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a68b55df-3a31-4b1d-90ca-d3650abe6db7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148042 Jul 21 22:21:58.255928 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 642/1412] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:58 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:58.395850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e0cf7731-2076-4696-b72c-6631ce15945c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:58.396469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e0cf7731-2076-4696-b72c-6631ce15945c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:58.402590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0cf7731-2076-4696-b72c-6631ce15945c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:58.403066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0cf7731-2076-4696-b72c-6631ce15945c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:58.403831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0cf7731-2076-4696-b72c-6631ce15945c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:58.404266 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e0cf7731-2076-4696-b72c-6631ce15945c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:58.467891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e0cf7731-2076-4696-b72c-6631ce15945c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:58.476580 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e0cf7731-2076-4696-b72c-6631ce15945c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084613 Jul 21 22:21:58.477140 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 771/1413] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:58 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:59.032022 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-52d88654-84ec-46de-ae16-e8f57dca03ba tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:59.032672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-52d88654-84ec-46de-ae16-e8f57dca03ba tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:59.038661 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52d88654-84ec-46de-ae16-e8f57dca03ba tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:59.039157 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52d88654-84ec-46de-ae16-e8f57dca03ba tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:59.039931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52d88654-84ec-46de-ae16-e8f57dca03ba tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:59.040374 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52d88654-84ec-46de-ae16-e8f57dca03ba tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:59.167960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-52d88654-84ec-46de-ae16-e8f57dca03ba tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:59.176489 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-52d88654-84ec-46de-ae16-e8f57dca03ba tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148794 Jul 21 22:21:59.177055 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 643/1414] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:59 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:59.275500 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f5f1406f-cb00-4902-ba60-0658ae16cb75 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:59.276355 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f5f1406f-cb00-4902-ba60-0658ae16cb75 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:59.285938 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5f1406f-cb00-4902-ba60-0658ae16cb75 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:59.286610 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5f1406f-cb00-4902-ba60-0658ae16cb75 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:59.287815 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5f1406f-cb00-4902-ba60-0658ae16cb75 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:59.288485 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f5f1406f-cb00-4902-ba60-0658ae16cb75 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:59.428195 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f5f1406f-cb00-4902-ba60-0658ae16cb75 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:59.436085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f5f1406f-cb00-4902-ba60-0658ae16cb75 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.167038 Jul 21 22:21:59.436651 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 772/1415] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:59 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:21:59.493750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a8bc7b75-1b40-4079-b5b6-50a61c2aab48 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:21:59.494402 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a8bc7b75-1b40-4079-b5b6-50a61c2aab48 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:21:59.500472 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a8bc7b75-1b40-4079-b5b6-50a61c2aab48 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:59.500928 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a8bc7b75-1b40-4079-b5b6-50a61c2aab48 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:59.501701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a8bc7b75-1b40-4079-b5b6-50a61c2aab48 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:21:59.502145 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a8bc7b75-1b40-4079-b5b6-50a61c2aab48 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:21:59.566885 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a8bc7b75-1b40-4079-b5b6-50a61c2aab48 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:21:59.574894 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a8bc7b75-1b40-4079-b5b6-50a61c2aab48 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085093 Jul 21 22:21:59.575492 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 644/1416] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:21:59 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:00.193930 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-45aba24b-0fb8-4bad-908a-e77946d71906 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:00.194463 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-45aba24b-0fb8-4bad-908a-e77946d71906 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:00.200539 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-45aba24b-0fb8-4bad-908a-e77946d71906 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:00.200999 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-45aba24b-0fb8-4bad-908a-e77946d71906 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:00.201745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-45aba24b-0fb8-4bad-908a-e77946d71906 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:00.202182 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-45aba24b-0fb8-4bad-908a-e77946d71906 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:00.329158 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-45aba24b-0fb8-4bad-908a-e77946d71906 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:00.337012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-45aba24b-0fb8-4bad-908a-e77946d71906 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147005 Jul 21 22:22:00.337577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 773/1417] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:00 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:00.453672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4f6c2608-585e-4479-abec-280d0499746a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:00.454188 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4f6c2608-585e-4479-abec-280d0499746a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:00.460691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f6c2608-585e-4479-abec-280d0499746a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:00.461140 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f6c2608-585e-4479-abec-280d0499746a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:00.461899 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f6c2608-585e-4479-abec-280d0499746a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:00.462334 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f6c2608-585e-4479-abec-280d0499746a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:00.591754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4f6c2608-585e-4479-abec-280d0499746a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:00.591929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-94f910c5-9a66-424d-875d-894b5f4cf2d1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:00.592659 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-94f910c5-9a66-424d-875d-894b5f4cf2d1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:00.599461 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-94f910c5-9a66-424d-875d-894b5f4cf2d1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:00.599986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-94f910c5-9a66-424d-875d-894b5f4cf2d1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:00.600541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4f6c2608-585e-4479-abec-280d0499746a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.151425 Jul 21 22:22:00.600923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-94f910c5-9a66-424d-875d-894b5f4cf2d1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:00.601108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 645/1418] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:00 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:00.601487 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-94f910c5-9a66-424d-875d-894b5f4cf2d1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:00.664907 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-94f910c5-9a66-424d-875d-894b5f4cf2d1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:00.673358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-94f910c5-9a66-424d-875d-894b5f4cf2d1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085530 Jul 21 22:22:00.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 774/1419] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:00 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:01.355419 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6d02f636-d37c-4a6f-b1c3-5159c351c47d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:01.356032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6d02f636-d37c-4a6f-b1c3-5159c351c47d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:01.362625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d02f636-d37c-4a6f-b1c3-5159c351c47d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:01.363109 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d02f636-d37c-4a6f-b1c3-5159c351c47d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:01.363885 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d02f636-d37c-4a6f-b1c3-5159c351c47d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:01.364325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d02f636-d37c-4a6f-b1c3-5159c351c47d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:01.491396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6d02f636-d37c-4a6f-b1c3-5159c351c47d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:01.499339 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6d02f636-d37c-4a6f-b1c3-5159c351c47d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147905 Jul 21 22:22:01.500107 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 646/1420] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:01 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:01.618312 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2e6ef431-4a90-4600-a522-fb5288efac65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:01.618863 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2e6ef431-4a90-4600-a522-fb5288efac65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:01.625264 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e6ef431-4a90-4600-a522-fb5288efac65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:01.625718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e6ef431-4a90-4600-a522-fb5288efac65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:01.626479 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e6ef431-4a90-4600-a522-fb5288efac65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:01.626916 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2e6ef431-4a90-4600-a522-fb5288efac65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:01.689952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-194e3e50-7dee-4892-93ea-2bb69606fcaa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:01.690562 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-194e3e50-7dee-4892-93ea-2bb69606fcaa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:01.698191 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-194e3e50-7dee-4892-93ea-2bb69606fcaa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:01.698764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-194e3e50-7dee-4892-93ea-2bb69606fcaa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:01.699607 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-194e3e50-7dee-4892-93ea-2bb69606fcaa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:01.700047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-194e3e50-7dee-4892-93ea-2bb69606fcaa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:01.776037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-194e3e50-7dee-4892-93ea-2bb69606fcaa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:01.780235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2e6ef431-4a90-4600-a522-fb5288efac65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:01.784600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-194e3e50-7dee-4892-93ea-2bb69606fcaa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.098467 Jul 21 22:22:01.785176 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 647/1421] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:01 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:01.788759 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2e6ef431-4a90-4600-a522-fb5288efac65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.174314 Jul 21 22:22:01.789319 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 775/1422] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:01 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:02.516281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e8e160a3-208f-409e-b38b-dd001d5eccda tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:02.517399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e8e160a3-208f-409e-b38b-dd001d5eccda tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:02.524089 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8e160a3-208f-409e-b38b-dd001d5eccda tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:02.524541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8e160a3-208f-409e-b38b-dd001d5eccda tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:02.525316 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8e160a3-208f-409e-b38b-dd001d5eccda tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:02.525754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8e160a3-208f-409e-b38b-dd001d5eccda tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:02.652773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e8e160a3-208f-409e-b38b-dd001d5eccda tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:02.660674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e8e160a3-208f-409e-b38b-dd001d5eccda tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148239 Jul 21 22:22:02.661248 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 648/1423] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:02 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:02.800772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-25cbaa31-632c-4b44-b620-8108b3b0f9e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:02.801302 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-25cbaa31-632c-4b44-b620-8108b3b0f9e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:02.805304 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-be3fbb43-4bb3-41b7-9cc6-966ef68f08e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:02.805909 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-be3fbb43-4bb3-41b7-9cc6-966ef68f08e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:02.807953 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-25cbaa31-632c-4b44-b620-8108b3b0f9e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:02.808406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-25cbaa31-632c-4b44-b620-8108b3b0f9e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:02.809177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-25cbaa31-632c-4b44-b620-8108b3b0f9e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:02.809618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-25cbaa31-632c-4b44-b620-8108b3b0f9e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:02.811735 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be3fbb43-4bb3-41b7-9cc6-966ef68f08e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:02.812178 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be3fbb43-4bb3-41b7-9cc6-966ef68f08e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:02.812938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be3fbb43-4bb3-41b7-9cc6-966ef68f08e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:02.813376 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be3fbb43-4bb3-41b7-9cc6-966ef68f08e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:02.814125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:02.879889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-25cbaa31-632c-4b44-b620-8108b3b0f9e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:02.888006 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-25cbaa31-632c-4b44-b620-8108b3b0f9e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.091098 Jul 21 22:22:02.888828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 776/1424] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:02 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:02.965683 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-be3fbb43-4bb3-41b7-9cc6-966ef68f08e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:02.973813 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-be3fbb43-4bb3-41b7-9cc6-966ef68f08e3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.172330 Jul 21 22:22:02.974379 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 649/1425] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:02 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:03.678096 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-627ba6a7-41b4-4784-ba70-527ba69b1547 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:03.678704 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-627ba6a7-41b4-4784-ba70-527ba69b1547 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:03.684714 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-627ba6a7-41b4-4784-ba70-527ba69b1547 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:03.685164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-627ba6a7-41b4-4784-ba70-527ba69b1547 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:03.685927 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-627ba6a7-41b4-4784-ba70-527ba69b1547 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:03.686363 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-627ba6a7-41b4-4784-ba70-527ba69b1547 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:03.810769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-627ba6a7-41b4-4784-ba70-527ba69b1547 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:03.818570 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-627ba6a7-41b4-4784-ba70-527ba69b1547 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.144306 Jul 21 22:22:03.819161 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 777/1426] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:03 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:03.904605 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6c65bf39-36f3-44fe-a17c-70be98b3a811 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:03.905219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6c65bf39-36f3-44fe-a17c-70be98b3a811 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:03.911747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6c65bf39-36f3-44fe-a17c-70be98b3a811 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:03.912200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6c65bf39-36f3-44fe-a17c-70be98b3a811 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:03.912967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6c65bf39-36f3-44fe-a17c-70be98b3a811 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:03.913409 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6c65bf39-36f3-44fe-a17c-70be98b3a811 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:03.975594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6c65bf39-36f3-44fe-a17c-70be98b3a811 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:03.983440 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6c65bf39-36f3-44fe-a17c-70be98b3a811 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082711 Jul 21 22:22:03.984191 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 650/1427] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:03 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:03.991217 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4bd2a6f1-26d4-4236-9891-f497688e7c67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:03.991826 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4bd2a6f1-26d4-4236-9891-f497688e7c67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:03.997721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bd2a6f1-26d4-4236-9891-f497688e7c67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:03.998171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bd2a6f1-26d4-4236-9891-f497688e7c67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:03.998935 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bd2a6f1-26d4-4236-9891-f497688e7c67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:03.999397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bd2a6f1-26d4-4236-9891-f497688e7c67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:04.128871 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4bd2a6f1-26d4-4236-9891-f497688e7c67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:04.136688 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4bd2a6f1-26d4-4236-9891-f497688e7c67 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149217 Jul 21 22:22:04.137289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 778/1428] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:03 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:04.836184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d1a4499f-24f9-47c4-951c-1fd0f09e6fe2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:04.836718 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d1a4499f-24f9-47c4-951c-1fd0f09e6fe2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:04.842741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1a4499f-24f9-47c4-951c-1fd0f09e6fe2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:04.843228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1a4499f-24f9-47c4-951c-1fd0f09e6fe2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:04.844020 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1a4499f-24f9-47c4-951c-1fd0f09e6fe2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:04.844461 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1a4499f-24f9-47c4-951c-1fd0f09e6fe2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:04.973378 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d1a4499f-24f9-47c4-951c-1fd0f09e6fe2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:04.982668 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d1a4499f-24f9-47c4-951c-1fd0f09e6fe2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.150396 Jul 21 22:22:04.983282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 651/1429] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:04 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:05.000122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-570afa04-7c58-4528-a833-388645f15069 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:05.003976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-570afa04-7c58-4528-a833-388645f15069 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:05.007366 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-570afa04-7c58-4528-a833-388645f15069 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:05.007813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-570afa04-7c58-4528-a833-388645f15069 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:05.008582 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-570afa04-7c58-4528-a833-388645f15069 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:05.009042 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-570afa04-7c58-4528-a833-388645f15069 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:05.070947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-570afa04-7c58-4528-a833-388645f15069 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:05.078719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-570afa04-7c58-4528-a833-388645f15069 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082449 Jul 21 22:22:05.079321 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 779/1430] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:04 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:05.153502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ad0dc644-638a-427f-88a7-389d172570dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:05.154183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ad0dc644-638a-427f-88a7-389d172570dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:05.160759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad0dc644-638a-427f-88a7-389d172570dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:05.161214 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad0dc644-638a-427f-88a7-389d172570dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:05.161988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad0dc644-638a-427f-88a7-389d172570dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:05.162431 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad0dc644-638a-427f-88a7-389d172570dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:05.293635 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ad0dc644-638a-427f-88a7-389d172570dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:05.303293 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ad0dc644-638a-427f-88a7-389d172570dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.153586 Jul 21 22:22:05.303876 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 652/1431] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:05 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:06.000600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d42cff5e-d2d3-4679-be8a-2359faff84f0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:06.001365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d42cff5e-d2d3-4679-be8a-2359faff84f0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:06.007841 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d42cff5e-d2d3-4679-be8a-2359faff84f0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:06.008297 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d42cff5e-d2d3-4679-be8a-2359faff84f0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:06.009072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d42cff5e-d2d3-4679-be8a-2359faff84f0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:06.009514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d42cff5e-d2d3-4679-be8a-2359faff84f0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:06.096482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3c5b9407-6048-44b4-9108-a2349393530f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:06.097098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3c5b9407-6048-44b4-9108-a2349393530f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:06.104640 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c5b9407-6048-44b4-9108-a2349393530f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:06.105100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c5b9407-6048-44b4-9108-a2349393530f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:06.105886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c5b9407-6048-44b4-9108-a2349393530f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:06.106331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c5b9407-6048-44b4-9108-a2349393530f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:06.143466 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d42cff5e-d2d3-4679-be8a-2359faff84f0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:06.153267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d42cff5e-d2d3-4679-be8a-2359faff84f0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.156385 Jul 21 22:22:06.154051 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 780/1432] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:05 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:06.175747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3c5b9407-6048-44b4-9108-a2349393530f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:06.183595 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3c5b9407-6048-44b4-9108-a2349393530f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.091999 Jul 21 22:22:06.184185 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 653/1433] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:06 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:06.320390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2c7f6707-c78c-45e9-8618-2d76c397680d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:06.321013 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2c7f6707-c78c-45e9-8618-2d76c397680d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:06.326975 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2c7f6707-c78c-45e9-8618-2d76c397680d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:06.327459 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2c7f6707-c78c-45e9-8618-2d76c397680d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:06.328259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2c7f6707-c78c-45e9-8618-2d76c397680d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:06.328699 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2c7f6707-c78c-45e9-8618-2d76c397680d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:06.461997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2c7f6707-c78c-45e9-8618-2d76c397680d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:06.471165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2c7f6707-c78c-45e9-8618-2d76c397680d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.154514 Jul 21 22:22:06.471830 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 781/1434] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:06 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:07.170845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c56ef554-ad0e-40fb-b691-583b26a7ad42 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:07.171518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c56ef554-ad0e-40fb-b691-583b26a7ad42 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:07.178536 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c56ef554-ad0e-40fb-b691-583b26a7ad42 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:07.178988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c56ef554-ad0e-40fb-b691-583b26a7ad42 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:07.179778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c56ef554-ad0e-40fb-b691-583b26a7ad42 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:07.180220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c56ef554-ad0e-40fb-b691-583b26a7ad42 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:07.200189 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8b52c724-38d4-42f7-bd99-f704fa8a2c83 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:07.200832 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8b52c724-38d4-42f7-bd99-f704fa8a2c83 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:07.207278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8b52c724-38d4-42f7-bd99-f704fa8a2c83 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:07.207730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8b52c724-38d4-42f7-bd99-f704fa8a2c83 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:07.208505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8b52c724-38d4-42f7-bd99-f704fa8a2c83 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:07.208946 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8b52c724-38d4-42f7-bd99-f704fa8a2c83 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:07.277049 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8b52c724-38d4-42f7-bd99-f704fa8a2c83 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:07.285402 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8b52c724-38d4-42f7-bd99-f704fa8a2c83 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.089040 Jul 21 22:22:07.285974 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 782/1435] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:07 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:07.334369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c56ef554-ad0e-40fb-b691-583b26a7ad42 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:07.342262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c56ef554-ad0e-40fb-b691-583b26a7ad42 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.175241 Jul 21 22:22:07.342826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 654/1436] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:07 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:07.489186 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c448eff6-eaab-4d7e-a2b7-b171bae79650 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:07.489831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c448eff6-eaab-4d7e-a2b7-b171bae79650 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:07.495867 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c448eff6-eaab-4d7e-a2b7-b171bae79650 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:07.496320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c448eff6-eaab-4d7e-a2b7-b171bae79650 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:07.497090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c448eff6-eaab-4d7e-a2b7-b171bae79650 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:07.497528 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c448eff6-eaab-4d7e-a2b7-b171bae79650 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:07.625120 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c448eff6-eaab-4d7e-a2b7-b171bae79650 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:07.632964 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c448eff6-eaab-4d7e-a2b7-b171bae79650 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148114 Jul 21 22:22:07.633534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 783/1437] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:07 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:08.302523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-89038c4c-6b59-49e3-aa3a-735fe0305ab5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:08.303206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-89038c4c-6b59-49e3-aa3a-735fe0305ab5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:08.309784 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-89038c4c-6b59-49e3-aa3a-735fe0305ab5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:08.310241 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-89038c4c-6b59-49e3-aa3a-735fe0305ab5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:08.311035 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-89038c4c-6b59-49e3-aa3a-735fe0305ab5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:08.311474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-89038c4c-6b59-49e3-aa3a-735fe0305ab5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:08.362731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cd370da5-02ee-4e0d-a1aa-2ae9c30f61f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:08.364104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cd370da5-02ee-4e0d-a1aa-2ae9c30f61f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:08.370811 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd370da5-02ee-4e0d-a1aa-2ae9c30f61f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:08.371287 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd370da5-02ee-4e0d-a1aa-2ae9c30f61f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:08.372146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd370da5-02ee-4e0d-a1aa-2ae9c30f61f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:08.372591 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd370da5-02ee-4e0d-a1aa-2ae9c30f61f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:08.373405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-89038c4c-6b59-49e3-aa3a-735fe0305ab5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:08.377459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:08.383036 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-89038c4c-6b59-49e3-aa3a-735fe0305ab5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084327 Jul 21 22:22:08.383628 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 655/1438] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:08 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:08.502020 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-cd370da5-02ee-4e0d-a1aa-2ae9c30f61f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:08.509887 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cd370da5-02ee-4e0d-a1aa-2ae9c30f61f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152164 Jul 21 22:22:08.510638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 784/1439] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:08 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:08.650356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3256ee7b-a64b-4c3e-a7a9-7d64e4dfa425 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:08.650962 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3256ee7b-a64b-4c3e-a7a9-7d64e4dfa425 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:08.657151 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3256ee7b-a64b-4c3e-a7a9-7d64e4dfa425 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:08.657602 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3256ee7b-a64b-4c3e-a7a9-7d64e4dfa425 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:08.658364 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3256ee7b-a64b-4c3e-a7a9-7d64e4dfa425 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:08.658799 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3256ee7b-a64b-4c3e-a7a9-7d64e4dfa425 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:08.791960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3256ee7b-a64b-4c3e-a7a9-7d64e4dfa425 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:08.799743 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3256ee7b-a64b-4c3e-a7a9-7d64e4dfa425 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.153232 Jul 21 22:22:08.800307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 656/1440] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:08 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:09.399688 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-05cab250-8ab1-4d76-bfc7-e905bcfb069e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:09.400301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-05cab250-8ab1-4d76-bfc7-e905bcfb069e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:09.407486 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-05cab250-8ab1-4d76-bfc7-e905bcfb069e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:09.408027 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-05cab250-8ab1-4d76-bfc7-e905bcfb069e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:09.408791 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-05cab250-8ab1-4d76-bfc7-e905bcfb069e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:09.409253 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-05cab250-8ab1-4d76-bfc7-e905bcfb069e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:09.468761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-05cab250-8ab1-4d76-bfc7-e905bcfb069e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:09.477515 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-05cab250-8ab1-4d76-bfc7-e905bcfb069e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081652 Jul 21 22:22:09.478074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 785/1441] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:09 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:09.526912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c55408cb-ac63-485b-87db-529a112f9cfb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:09.527558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c55408cb-ac63-485b-87db-529a112f9cfb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:09.534141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c55408cb-ac63-485b-87db-529a112f9cfb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:09.534589 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c55408cb-ac63-485b-87db-529a112f9cfb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:09.535458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c55408cb-ac63-485b-87db-529a112f9cfb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:09.535895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c55408cb-ac63-485b-87db-529a112f9cfb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:09.665497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c55408cb-ac63-485b-87db-529a112f9cfb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:09.673608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c55408cb-ac63-485b-87db-529a112f9cfb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.150555 Jul 21 22:22:09.674185 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 657/1442] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:09 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:09.817684 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-be4ab1ba-c2d5-4c51-9333-e3b3555c0094 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:09.818299 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-be4ab1ba-c2d5-4c51-9333-e3b3555c0094 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:09.824257 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-be4ab1ba-c2d5-4c51-9333-e3b3555c0094 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:09.824713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-be4ab1ba-c2d5-4c51-9333-e3b3555c0094 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:09.825482 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-be4ab1ba-c2d5-4c51-9333-e3b3555c0094 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:09.825952 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-be4ab1ba-c2d5-4c51-9333-e3b3555c0094 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:09.951692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-be4ab1ba-c2d5-4c51-9333-e3b3555c0094 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:09.959988 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-be4ab1ba-c2d5-4c51-9333-e3b3555c0094 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146676 Jul 21 22:22:09.960559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 786/1443] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:09 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:10.494425 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4fdde7ef-3575-41b7-b4a8-ad0e0001bc42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:10.495075 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4fdde7ef-3575-41b7-b4a8-ad0e0001bc42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:10.501771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4fdde7ef-3575-41b7-b4a8-ad0e0001bc42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:10.502222 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4fdde7ef-3575-41b7-b4a8-ad0e0001bc42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:10.502993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4fdde7ef-3575-41b7-b4a8-ad0e0001bc42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:10.503459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4fdde7ef-3575-41b7-b4a8-ad0e0001bc42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:10.567550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4fdde7ef-3575-41b7-b4a8-ad0e0001bc42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:10.575465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4fdde7ef-3575-41b7-b4a8-ad0e0001bc42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084844 Jul 21 22:22:10.576033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 658/1444] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:10 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:10.690837 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c24d8136-065d-4749-b560-bd3644a7b910 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:10.691469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c24d8136-065d-4749-b560-bd3644a7b910 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:10.697962 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c24d8136-065d-4749-b560-bd3644a7b910 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:10.698410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c24d8136-065d-4749-b560-bd3644a7b910 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:10.699203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c24d8136-065d-4749-b560-bd3644a7b910 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:10.699640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c24d8136-065d-4749-b560-bd3644a7b910 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:10.824113 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c24d8136-065d-4749-b560-bd3644a7b910 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:10.832007 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c24d8136-065d-4749-b560-bd3644a7b910 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.145596 Jul 21 22:22:10.832566 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 787/1445] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:10 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:10.977544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2ef1855b-36ee-4ab0-a0ac-304149020c34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:10.978191 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2ef1855b-36ee-4ab0-a0ac-304149020c34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:10.984266 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ef1855b-36ee-4ab0-a0ac-304149020c34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:10.984726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ef1855b-36ee-4ab0-a0ac-304149020c34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:10.985496 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ef1855b-36ee-4ab0-a0ac-304149020c34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:10.985940 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ef1855b-36ee-4ab0-a0ac-304149020c34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:11.113274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2ef1855b-36ee-4ab0-a0ac-304149020c34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:11.121192 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2ef1855b-36ee-4ab0-a0ac-304149020c34 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147475 Jul 21 22:22:11.121761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 659/1446] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:10 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:11.592107 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c3798059-22d5-4c43-9dae-055bdb02ce9b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:11.592713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c3798059-22d5-4c43-9dae-055bdb02ce9b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:11.599515 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3798059-22d5-4c43-9dae-055bdb02ce9b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:11.599961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3798059-22d5-4c43-9dae-055bdb02ce9b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:11.600720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3798059-22d5-4c43-9dae-055bdb02ce9b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:11.601149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3798059-22d5-4c43-9dae-055bdb02ce9b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:11.672819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c3798059-22d5-4c43-9dae-055bdb02ce9b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:11.681145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c3798059-22d5-4c43-9dae-055bdb02ce9b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.092819 Jul 21 22:22:11.681695 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 788/1447] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:11 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:11.849149 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-eb408d66-3c39-4758-83c3-832783d56352 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:11.849706 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-eb408d66-3c39-4758-83c3-832783d56352 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:11.856258 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eb408d66-3c39-4758-83c3-832783d56352 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:11.856721 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eb408d66-3c39-4758-83c3-832783d56352 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:11.857493 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eb408d66-3c39-4758-83c3-832783d56352 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:11.857938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eb408d66-3c39-4758-83c3-832783d56352 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:11.984015 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-eb408d66-3c39-4758-83c3-832783d56352 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:11.992547 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-eb408d66-3c39-4758-83c3-832783d56352 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147559 Jul 21 22:22:11.993133 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 660/1448] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:11 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:12.138986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b3e7c18c-1983-47c5-bb27-7d496868a630 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:12.139635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b3e7c18c-1983-47c5-bb27-7d496868a630 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:12.146390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3e7c18c-1983-47c5-bb27-7d496868a630 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:12.146836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3e7c18c-1983-47c5-bb27-7d496868a630 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:12.147647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3e7c18c-1983-47c5-bb27-7d496868a630 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:12.148078 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b3e7c18c-1983-47c5-bb27-7d496868a630 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:12.276033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b3e7c18c-1983-47c5-bb27-7d496868a630 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:12.284133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b3e7c18c-1983-47c5-bb27-7d496868a630 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148951 Jul 21 22:22:12.284696 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 789/1449] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:12 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:12.697608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cdc36949-5d2e-4542-9e6b-04568e6f62fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:12.698222 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cdc36949-5d2e-4542-9e6b-04568e6f62fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:12.705046 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdc36949-5d2e-4542-9e6b-04568e6f62fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:12.705499 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdc36949-5d2e-4542-9e6b-04568e6f62fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:12.706273 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdc36949-5d2e-4542-9e6b-04568e6f62fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:12.706714 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdc36949-5d2e-4542-9e6b-04568e6f62fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:12.771914 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cdc36949-5d2e-4542-9e6b-04568e6f62fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:12.779791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cdc36949-5d2e-4542-9e6b-04568e6f62fc tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.086126 Jul 21 22:22:12.780358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 661/1450] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:12 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:13.009929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9f1658ed-157e-4ce8-80cb-c5acbe2c0fe3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:13.010643 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9f1658ed-157e-4ce8-80cb-c5acbe2c0fe3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:13.016810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9f1658ed-157e-4ce8-80cb-c5acbe2c0fe3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:13.017261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9f1658ed-157e-4ce8-80cb-c5acbe2c0fe3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:13.018009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9f1658ed-157e-4ce8-80cb-c5acbe2c0fe3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:13.018441 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9f1658ed-157e-4ce8-80cb-c5acbe2c0fe3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:13.301558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-76cd52aa-e2d7-49b4-b716-122ba5c137d3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:13.302191 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-76cd52aa-e2d7-49b4-b716-122ba5c137d3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:13.308527 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76cd52aa-e2d7-49b4-b716-122ba5c137d3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:13.309007 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76cd52aa-e2d7-49b4-b716-122ba5c137d3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:13.309768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76cd52aa-e2d7-49b4-b716-122ba5c137d3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:13.310202 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76cd52aa-e2d7-49b4-b716-122ba5c137d3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:13.396453 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9f1658ed-157e-4ce8-80cb-c5acbe2c0fe3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:13.405317 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9f1658ed-157e-4ce8-80cb-c5acbe2c0fe3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.399197 Jul 21 22:22:13.405890 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 790/1451] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:13 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:13.458581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-76cd52aa-e2d7-49b4-b716-122ba5c137d3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:13.466573 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-76cd52aa-e2d7-49b4-b716-122ba5c137d3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.169362 Jul 21 22:22:13.467161 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 662/1452] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:13 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:13.796639 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ffb2a98e-1386-47fa-a2bd-f44714b877f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:13.797241 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ffb2a98e-1386-47fa-a2bd-f44714b877f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:13.803234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ffb2a98e-1386-47fa-a2bd-f44714b877f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:13.803696 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ffb2a98e-1386-47fa-a2bd-f44714b877f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:13.804454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ffb2a98e-1386-47fa-a2bd-f44714b877f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:13.804888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ffb2a98e-1386-47fa-a2bd-f44714b877f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:13.868019 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ffb2a98e-1386-47fa-a2bd-f44714b877f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:13.876422 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ffb2a98e-1386-47fa-a2bd-f44714b877f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082977 Jul 21 22:22:13.876978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 791/1453] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:13 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:14.421593 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6f7a1393-1619-4ad4-af1d-a72e953a1167 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:14.422201 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6f7a1393-1619-4ad4-af1d-a72e953a1167 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:14.429238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f7a1393-1619-4ad4-af1d-a72e953a1167 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:14.429689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f7a1393-1619-4ad4-af1d-a72e953a1167 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:14.430448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f7a1393-1619-4ad4-af1d-a72e953a1167 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:14.430880 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f7a1393-1619-4ad4-af1d-a72e953a1167 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:14.483893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-349a8d01-e79d-4fa4-9c70-b829e517f0b1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:14.484300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-349a8d01-e79d-4fa4-9c70-b829e517f0b1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:14.490915 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-349a8d01-e79d-4fa4-9c70-b829e517f0b1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:14.491397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-349a8d01-e79d-4fa4-9c70-b829e517f0b1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:14.492167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-349a8d01-e79d-4fa4-9c70-b829e517f0b1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:14.492598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-349a8d01-e79d-4fa4-9c70-b829e517f0b1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:14.596803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6f7a1393-1619-4ad4-af1d-a72e953a1167 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:14.604892 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6f7a1393-1619-4ad4-af1d-a72e953a1167 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.187148 Jul 21 22:22:14.605478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 663/1454] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:14 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:14.642514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-349a8d01-e79d-4fa4-9c70-b829e517f0b1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:14.646018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:14.651474 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-349a8d01-e79d-4fa4-9c70-b829e517f0b1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.171873 Jul 21 22:22:14.652037 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 792/1455] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:14 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:14.893516 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-be267ed6-881e-4881-9c93-4df555289c1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:14.894121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-be267ed6-881e-4881-9c93-4df555289c1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:14.900108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be267ed6-881e-4881-9c93-4df555289c1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:14.900556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be267ed6-881e-4881-9c93-4df555289c1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:14.901314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be267ed6-881e-4881-9c93-4df555289c1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:14.901747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be267ed6-881e-4881-9c93-4df555289c1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:14.961576 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-be267ed6-881e-4881-9c93-4df555289c1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:14.969411 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-be267ed6-881e-4881-9c93-4df555289c1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080458 Jul 21 22:22:14.970306 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 664/1456] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:14 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:15.622135 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bb6dd3bd-1db8-452a-a864-b6f1ffed0aec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:15.622738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bb6dd3bd-1db8-452a-a864-b6f1ffed0aec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:15.629158 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bb6dd3bd-1db8-452a-a864-b6f1ffed0aec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:15.629603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bb6dd3bd-1db8-452a-a864-b6f1ffed0aec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:15.630355 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bb6dd3bd-1db8-452a-a864-b6f1ffed0aec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:15.630785 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bb6dd3bd-1db8-452a-a864-b6f1ffed0aec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:15.668473 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e9aa0966-7874-4d60-af5f-874667157821 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:15.669218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e9aa0966-7874-4d60-af5f-874667157821 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:15.676520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9aa0966-7874-4d60-af5f-874667157821 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:15.677053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9aa0966-7874-4d60-af5f-874667157821 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:15.677898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9aa0966-7874-4d60-af5f-874667157821 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:15.678410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9aa0966-7874-4d60-af5f-874667157821 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:15.811420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bb6dd3bd-1db8-452a-a864-b6f1ffed0aec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:15.819508 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bb6dd3bd-1db8-452a-a864-b6f1ffed0aec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.201431 Jul 21 22:22:15.820176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 793/1457] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:15 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:15.837800 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9aa0966-7874-4d60-af5f-874667157821 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:15.846743 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e9aa0966-7874-4d60-af5f-874667157821 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.182099 Jul 21 22:22:15.847363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 665/1458] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:15 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:15.986428 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9607de8f-a6f7-4e1e-a995-33f1fe625ce7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:15.987057 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9607de8f-a6f7-4e1e-a995-33f1fe625ce7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:15.993011 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9607de8f-a6f7-4e1e-a995-33f1fe625ce7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:15.993454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9607de8f-a6f7-4e1e-a995-33f1fe625ce7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:15.994214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9607de8f-a6f7-4e1e-a995-33f1fe625ce7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:15.994646 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9607de8f-a6f7-4e1e-a995-33f1fe625ce7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:16.054060 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9607de8f-a6f7-4e1e-a995-33f1fe625ce7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:16.061870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9607de8f-a6f7-4e1e-a995-33f1fe625ce7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079315 Jul 21 22:22:16.062429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 794/1459] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:15 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:16.836845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-66ff19bf-6104-4f36-a262-5e0fe356b336 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:16.837401 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-66ff19bf-6104-4f36-a262-5e0fe356b336 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:16.843888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66ff19bf-6104-4f36-a262-5e0fe356b336 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:16.844973 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66ff19bf-6104-4f36-a262-5e0fe356b336 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:16.846005 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66ff19bf-6104-4f36-a262-5e0fe356b336 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:16.846456 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66ff19bf-6104-4f36-a262-5e0fe356b336 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:16.863815 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f27abd3f-3e4a-4eb2-8c62-c301edc19498 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:16.864534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f27abd3f-3e4a-4eb2-8c62-c301edc19498 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:16.870845 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f27abd3f-3e4a-4eb2-8c62-c301edc19498 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:16.871331 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f27abd3f-3e4a-4eb2-8c62-c301edc19498 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:16.872127 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f27abd3f-3e4a-4eb2-8c62-c301edc19498 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:16.872591 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f27abd3f-3e4a-4eb2-8c62-c301edc19498 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:17.043828 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-66ff19bf-6104-4f36-a262-5e0fe356b336 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:17.051181 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f27abd3f-3e4a-4eb2-8c62-c301edc19498 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:17.052358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-66ff19bf-6104-4f36-a262-5e0fe356b336 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.219519 Jul 21 22:22:17.052943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 666/1460] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:16 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:17.059268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f27abd3f-3e4a-4eb2-8c62-c301edc19498 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.199250 Jul 21 22:22:17.059841 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 795/1461] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:16 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:17.077998 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2cfd5e63-6d08-46c2-b549-1998a8f1bb22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:17.078613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2cfd5e63-6d08-46c2-b549-1998a8f1bb22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:17.084496 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cfd5e63-6d08-46c2-b549-1998a8f1bb22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:17.084950 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cfd5e63-6d08-46c2-b549-1998a8f1bb22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:17.085719 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cfd5e63-6d08-46c2-b549-1998a8f1bb22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:17.086154 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cfd5e63-6d08-46c2-b549-1998a8f1bb22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:17.146895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2cfd5e63-6d08-46c2-b549-1998a8f1bb22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:17.154913 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2cfd5e63-6d08-46c2-b549-1998a8f1bb22 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080599 Jul 21 22:22:17.155520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 667/1462] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:17 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:18.069067 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-20041dfe-d114-4c8e-b1a7-5dce1fd42350 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:18.069650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-20041dfe-d114-4c8e-b1a7-5dce1fd42350 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:18.076359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-20041dfe-d114-4c8e-b1a7-5dce1fd42350 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:18.076572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-798ad8f6-fa90-4c03-bc94-ea5dd70a0731 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:18.076992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-20041dfe-d114-4c8e-b1a7-5dce1fd42350 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:18.077113 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-798ad8f6-fa90-4c03-bc94-ea5dd70a0731 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:18.077549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-20041dfe-d114-4c8e-b1a7-5dce1fd42350 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:18.077977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-20041dfe-d114-4c8e-b1a7-5dce1fd42350 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:18.083420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-798ad8f6-fa90-4c03-bc94-ea5dd70a0731 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:18.083876 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-798ad8f6-fa90-4c03-bc94-ea5dd70a0731 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:18.084650 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-798ad8f6-fa90-4c03-bc94-ea5dd70a0731 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:18.085088 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-798ad8f6-fa90-4c03-bc94-ea5dd70a0731 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:18.272632 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-20041dfe-d114-4c8e-b1a7-5dce1fd42350 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:18.275815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-798ad8f6-fa90-4c03-bc94-ea5dd70a0731 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:18.280666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-20041dfe-d114-4c8e-b1a7-5dce1fd42350 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.215488 Jul 21 22:22:18.281249 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 796/1463] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:18 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:18.284265 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-798ad8f6-fa90-4c03-bc94-ea5dd70a0731 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.211565 Jul 21 22:22:18.284991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 668/1464] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:18 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:18.285757 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8c889bca-a379-446e-bbd0-feffb0f30cce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:18.286234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8c889bca-a379-446e-bbd0-feffb0f30cce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:18.292101 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c889bca-a379-446e-bbd0-feffb0f30cce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:18.292558 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c889bca-a379-446e-bbd0-feffb0f30cce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:18.293328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c889bca-a379-446e-bbd0-feffb0f30cce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:18.293768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c889bca-a379-446e-bbd0-feffb0f30cce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:18.356654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8c889bca-a379-446e-bbd0-feffb0f30cce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:18.365046 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8c889bca-a379-446e-bbd0-feffb0f30cce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082863 Jul 21 22:22:18.365669 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 797/1465] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:18 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:19.297813 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2fe6f22f-7a2f-40eb-96ac-804508ed9a49 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:19.298349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2fe6f22f-7a2f-40eb-96ac-804508ed9a49 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:19.301071 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e9e6697b-0a5c-4dfd-8492-13458b64fd83 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:19.301685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e9e6697b-0a5c-4dfd-8492-13458b64fd83 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:19.305367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2fe6f22f-7a2f-40eb-96ac-804508ed9a49 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:19.305816 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2fe6f22f-7a2f-40eb-96ac-804508ed9a49 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:19.306585 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2fe6f22f-7a2f-40eb-96ac-804508ed9a49 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:19.307047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2fe6f22f-7a2f-40eb-96ac-804508ed9a49 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:19.308168 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e9e6697b-0a5c-4dfd-8492-13458b64fd83 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:19.308619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e9e6697b-0a5c-4dfd-8492-13458b64fd83 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:19.309384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e9e6697b-0a5c-4dfd-8492-13458b64fd83 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:19.309821 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e9e6697b-0a5c-4dfd-8492-13458b64fd83 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:19.503331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2fe6f22f-7a2f-40eb-96ac-804508ed9a49 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:19.507262 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e9e6697b-0a5c-4dfd-8492-13458b64fd83 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:19.511244 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2fe6f22f-7a2f-40eb-96ac-804508ed9a49 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.217476 Jul 21 22:22:19.511820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 669/1466] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:19 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:19.515292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e9e6697b-0a5c-4dfd-8492-13458b64fd83 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.217930 Jul 21 22:22:19.519490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 798/1467] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:19 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:19.519658 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-58e0ab28-ca24-49dc-b1f7-aa4561413925 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:19.519658 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-58e0ab28-ca24-49dc-b1f7-aa4561413925 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:19.522508 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-58e0ab28-ca24-49dc-b1f7-aa4561413925 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:19.522965 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-58e0ab28-ca24-49dc-b1f7-aa4561413925 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:19.523782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-58e0ab28-ca24-49dc-b1f7-aa4561413925 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:19.524222 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-58e0ab28-ca24-49dc-b1f7-aa4561413925 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:19.585952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-58e0ab28-ca24-49dc-b1f7-aa4561413925 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:19.593813 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-58e0ab28-ca24-49dc-b1f7-aa4561413925 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081070 Jul 21 22:22:19.594420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 670/1468] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:19 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:20.529014 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-42fee6f9-2b3c-46dd-a125-0d471bf8f1b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:20.529620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-42fee6f9-2b3c-46dd-a125-0d471bf8f1b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:20.532884 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-091978d7-b1ab-4ca7-a0e1-91730299b8a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:20.533506 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-091978d7-b1ab-4ca7-a0e1-91730299b8a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:20.537238 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-42fee6f9-2b3c-46dd-a125-0d471bf8f1b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:20.537685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-42fee6f9-2b3c-46dd-a125-0d471bf8f1b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:20.538446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-42fee6f9-2b3c-46dd-a125-0d471bf8f1b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:20.538905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-42fee6f9-2b3c-46dd-a125-0d471bf8f1b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:20.539903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-091978d7-b1ab-4ca7-a0e1-91730299b8a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:20.540363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-091978d7-b1ab-4ca7-a0e1-91730299b8a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:20.541141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-091978d7-b1ab-4ca7-a0e1-91730299b8a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:20.541590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-091978d7-b1ab-4ca7-a0e1-91730299b8a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:20.737149 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-091978d7-b1ab-4ca7-a0e1-91730299b8a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:20.740423 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-42fee6f9-2b3c-46dd-a125-0d471bf8f1b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:20.745343 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-091978d7-b1ab-4ca7-a0e1-91730299b8a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.216909 Jul 21 22:22:20.746268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 671/1469] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:20 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:20.751136 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e7ddf33e-dd3e-42dd-a5fb-b571b6022ee2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:20.751742 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e7ddf33e-dd3e-42dd-a5fb-b571b6022ee2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:20.753774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-42fee6f9-2b3c-46dd-a125-0d471bf8f1b6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.228672 Jul 21 22:22:20.754422 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 799/1470] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:20 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:20.757637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e7ddf33e-dd3e-42dd-a5fb-b571b6022ee2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:20.758088 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e7ddf33e-dd3e-42dd-a5fb-b571b6022ee2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:20.758855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e7ddf33e-dd3e-42dd-a5fb-b571b6022ee2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:20.759320 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e7ddf33e-dd3e-42dd-a5fb-b571b6022ee2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:20.777290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:20.825314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e7ddf33e-dd3e-42dd-a5fb-b571b6022ee2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:20.833936 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e7ddf33e-dd3e-42dd-a5fb-b571b6022ee2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.086726 Jul 21 22:22:20.834506 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 672/1471] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:20 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:21.763322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-116b9b5f-6dd3-4225-bcbf-7c971b782fec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:21.763879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-116b9b5f-6dd3-4225-bcbf-7c971b782fec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:21.770736 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0368a5a5-4e25-4cfa-974b-360c169ebe16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:21.771203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-116b9b5f-6dd3-4225-bcbf-7c971b782fec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:21.771326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-116b9b5f-6dd3-4225-bcbf-7c971b782fec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:21.771500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0368a5a5-4e25-4cfa-974b-360c169ebe16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:21.772129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-116b9b5f-6dd3-4225-bcbf-7c971b782fec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:21.772581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-116b9b5f-6dd3-4225-bcbf-7c971b782fec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:21.777483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0368a5a5-4e25-4cfa-974b-360c169ebe16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:21.777936 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0368a5a5-4e25-4cfa-974b-360c169ebe16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:21.778707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0368a5a5-4e25-4cfa-974b-360c169ebe16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:21.779179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0368a5a5-4e25-4cfa-974b-360c169ebe16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:21.963088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-116b9b5f-6dd3-4225-bcbf-7c971b782fec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:21.969790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0368a5a5-4e25-4cfa-974b-360c169ebe16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:21.971231 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-116b9b5f-6dd3-4225-bcbf-7c971b782fec tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.211776 Jul 21 22:22:21.971813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 800/1472] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:21 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:21.976260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f8574bf0-71d3-443a-a6df-b48e37483e69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:21.976857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f8574bf0-71d3-443a-a6df-b48e37483e69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:21.978346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0368a5a5-4e25-4cfa-974b-360c169ebe16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.211356 Jul 21 22:22:21.979116 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 673/1473] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:21 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:21.982656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f8574bf0-71d3-443a-a6df-b48e37483e69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:21.983132 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f8574bf0-71d3-443a-a6df-b48e37483e69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:21.983903 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f8574bf0-71d3-443a-a6df-b48e37483e69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:21.984338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f8574bf0-71d3-443a-a6df-b48e37483e69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:22.048345 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f8574bf0-71d3-443a-a6df-b48e37483e69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:22.056231 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f8574bf0-71d3-443a-a6df-b48e37483e69 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083413 Jul 21 22:22:22.056803 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 801/1474] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:21 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:22.988711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3754fab3-b598-49c2-a5d5-8801a6678580 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:22.989466 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3754fab3-b598-49c2-a5d5-8801a6678580 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:22.995395 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f9d1497c-6790-4517-839e-0f4bc8428295 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:22.996052 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f9d1497c-6790-4517-839e-0f4bc8428295 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:22.996211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3754fab3-b598-49c2-a5d5-8801a6678580 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:22.996597 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3754fab3-b598-49c2-a5d5-8801a6678580 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:22.997376 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3754fab3-b598-49c2-a5d5-8801a6678580 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:22.997818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3754fab3-b598-49c2-a5d5-8801a6678580 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:23.002892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9d1497c-6790-4517-839e-0f4bc8428295 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:23.003371 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9d1497c-6790-4517-839e-0f4bc8428295 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:23.004132 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9d1497c-6790-4517-839e-0f4bc8428295 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:23.004562 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f9d1497c-6790-4517-839e-0f4bc8428295 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:23.187054 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3754fab3-b598-49c2-a5d5-8801a6678580 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:23.194147 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f9d1497c-6790-4517-839e-0f4bc8428295 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:23.195872 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3754fab3-b598-49c2-a5d5-8801a6678580 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.211002 Jul 21 22:22:23.196466 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 674/1475] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:22 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:23.201070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c56ccf01-ff0e-4197-9160-adb5cbf9b34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:23.201681 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c56ccf01-ff0e-4197-9160-adb5cbf9b34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:23.202481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f9d1497c-6790-4517-839e-0f4bc8428295 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.210795 Jul 21 22:22:23.204964 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 802/1476] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:22 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:23.208057 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c56ccf01-ff0e-4197-9160-adb5cbf9b34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:23.208513 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c56ccf01-ff0e-4197-9160-adb5cbf9b34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:23.209272 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c56ccf01-ff0e-4197-9160-adb5cbf9b34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:23.209714 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c56ccf01-ff0e-4197-9160-adb5cbf9b34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:23.272947 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c56ccf01-ff0e-4197-9160-adb5cbf9b34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:23.280865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c56ccf01-ff0e-4197-9160-adb5cbf9b34a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083472 Jul 21 22:22:23.281441 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 675/1477] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:23 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:24.213242 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a97e0739-74b0-4cce-a859-e274c0ae5cd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:24.213848 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a97e0739-74b0-4cce-a859-e274c0ae5cd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:24.219925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-03702a2c-dc92-4f12-9500-34cc3edff607 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:24.220738 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-03702a2c-dc92-4f12-9500-34cc3edff607 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:24.221713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a97e0739-74b0-4cce-a859-e274c0ae5cd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:24.222172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a97e0739-74b0-4cce-a859-e274c0ae5cd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:24.222960 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a97e0739-74b0-4cce-a859-e274c0ae5cd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:24.223434 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a97e0739-74b0-4cce-a859-e274c0ae5cd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:24.227236 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-03702a2c-dc92-4f12-9500-34cc3edff607 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:24.227736 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-03702a2c-dc92-4f12-9500-34cc3edff607 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:24.228550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-03702a2c-dc92-4f12-9500-34cc3edff607 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:24.228985 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-03702a2c-dc92-4f12-9500-34cc3edff607 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:24.419230 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a97e0739-74b0-4cce-a859-e274c0ae5cd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:24.423293 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-03702a2c-dc92-4f12-9500-34cc3edff607 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:24.429145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a97e0739-74b0-4cce-a859-e274c0ae5cd1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.219620 Jul 21 22:22:24.429890 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 803/1478] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:24 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:24.432212 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-03702a2c-dc92-4f12-9500-34cc3edff607 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.216237 Jul 21 22:22:24.432947 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 676/1479] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:24 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:24.434279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-51adbda3-5836-4200-9640-4743ad55f547 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:24.435024 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-51adbda3-5836-4200-9640-4743ad55f547 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:24.441052 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-51adbda3-5836-4200-9640-4743ad55f547 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:24.441507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-51adbda3-5836-4200-9640-4743ad55f547 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:24.442283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-51adbda3-5836-4200-9640-4743ad55f547 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:24.442725 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-51adbda3-5836-4200-9640-4743ad55f547 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:24.505213 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-51adbda3-5836-4200-9640-4743ad55f547 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:24.513057 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-51adbda3-5836-4200-9640-4743ad55f547 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082239 Jul 21 22:22:24.513618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 804/1480] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:24 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:25.447631 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4971419d-fe43-4be5-bbaf-c98a91b0218d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:25.448385 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4971419d-fe43-4be5-bbaf-c98a91b0218d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:25.448974 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8d5ba136-150e-4016-887e-7a652be4b220 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:25.449589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8d5ba136-150e-4016-887e-7a652be4b220 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:25.455762 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4971419d-fe43-4be5-bbaf-c98a91b0218d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:25.456345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4971419d-fe43-4be5-bbaf-c98a91b0218d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:25.456612 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8d5ba136-150e-4016-887e-7a652be4b220 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:25.457068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8d5ba136-150e-4016-887e-7a652be4b220 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:25.457182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4971419d-fe43-4be5-bbaf-c98a91b0218d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:25.457559 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4971419d-fe43-4be5-bbaf-c98a91b0218d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:25.457836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8d5ba136-150e-4016-887e-7a652be4b220 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:25.458273 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8d5ba136-150e-4016-887e-7a652be4b220 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:25.664522 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8d5ba136-150e-4016-887e-7a652be4b220 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:25.667791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4971419d-fe43-4be5-bbaf-c98a91b0218d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:25.673145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8d5ba136-150e-4016-887e-7a652be4b220 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.227892 Jul 21 22:22:25.674040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 805/1481] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:25 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:25.676262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4971419d-fe43-4be5-bbaf-c98a91b0218d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.233338 Jul 21 22:22:25.683054 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 677/1482] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:25 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:25.683204 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9b60cd4c-6238-4fff-87e6-5506c8107025 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:25.683204 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9b60cd4c-6238-4fff-87e6-5506c8107025 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:25.684964 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b60cd4c-6238-4fff-87e6-5506c8107025 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:25.685418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b60cd4c-6238-4fff-87e6-5506c8107025 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:25.686185 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b60cd4c-6238-4fff-87e6-5506c8107025 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:25.686622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b60cd4c-6238-4fff-87e6-5506c8107025 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:25.746424 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9b60cd4c-6238-4fff-87e6-5506c8107025 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:25.754831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9b60cd4c-6238-4fff-87e6-5506c8107025 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080086 Jul 21 22:22:25.755430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 806/1483] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:25 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:26.690581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ce3b97f2-b402-42dd-bb66-dbaa18e9cd5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:26.691227 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ce3b97f2-b402-42dd-bb66-dbaa18e9cd5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:26.692969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4b758eec-856f-476e-92f3-0f8e659418c3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:26.693577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4b758eec-856f-476e-92f3-0f8e659418c3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:26.695454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=78 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:26.697487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce3b97f2-b402-42dd-bb66-dbaa18e9cd5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:26.697943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce3b97f2-b402-42dd-bb66-dbaa18e9cd5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:26.698724 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce3b97f2-b402-42dd-bb66-dbaa18e9cd5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:26.699308 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce3b97f2-b402-42dd-bb66-dbaa18e9cd5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:26.700884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b758eec-856f-476e-92f3-0f8e659418c3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:26.701339 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b758eec-856f-476e-92f3-0f8e659418c3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:26.702108 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b758eec-856f-476e-92f3-0f8e659418c3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:26.702546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b758eec-856f-476e-92f3-0f8e659418c3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:26.893393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ce3b97f2-b402-42dd-bb66-dbaa18e9cd5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:26.899699 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4b758eec-856f-476e-92f3-0f8e659418c3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:26.901641 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ce3b97f2-b402-42dd-bb66-dbaa18e9cd5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.215132 Jul 21 22:22:26.902218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 678/1484] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:26 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:26.907115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0ca518be-156d-4f79-816e-9deb76fbc15b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:26.907717 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0ca518be-156d-4f79-816e-9deb76fbc15b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:26.908301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4b758eec-856f-476e-92f3-0f8e659418c3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.219233 Jul 21 22:22:26.909088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 807/1485] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:26 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:26.910367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=78 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:26.914147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ca518be-156d-4f79-816e-9deb76fbc15b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:26.914604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ca518be-156d-4f79-816e-9deb76fbc15b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:26.915410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ca518be-156d-4f79-816e-9deb76fbc15b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:26.915850 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ca518be-156d-4f79-816e-9deb76fbc15b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:26.979246 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0ca518be-156d-4f79-816e-9deb76fbc15b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:26.987219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0ca518be-156d-4f79-816e-9deb76fbc15b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084044 Jul 21 22:22:26.987791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 679/1486] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:26 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:27.919196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-66ac8be7-8c67-4f7e-b756-47bd1784c662 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:27.919813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-66ac8be7-8c67-4f7e-b756-47bd1784c662 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:27.925738 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-38f2b6a5-9d76-41a1-9720-fd9a764e95e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:27.926356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-38f2b6a5-9d76-41a1-9720-fd9a764e95e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:27.926817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66ac8be7-8c67-4f7e-b756-47bd1784c662 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:27.927304 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66ac8be7-8c67-4f7e-b756-47bd1784c662 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:27.928075 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66ac8be7-8c67-4f7e-b756-47bd1784c662 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:27.928511 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66ac8be7-8c67-4f7e-b756-47bd1784c662 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:27.932885 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-38f2b6a5-9d76-41a1-9720-fd9a764e95e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:27.933350 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-38f2b6a5-9d76-41a1-9720-fd9a764e95e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:27.934127 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-38f2b6a5-9d76-41a1-9720-fd9a764e95e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:27.934604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-38f2b6a5-9d76-41a1-9720-fd9a764e95e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:28.127179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-66ac8be7-8c67-4f7e-b756-47bd1784c662 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:28.130819 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-38f2b6a5-9d76-41a1-9720-fd9a764e95e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:28.135330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-66ac8be7-8c67-4f7e-b756-47bd1784c662 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.219978 Jul 21 22:22:28.135909 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 808/1487] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:27 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:28.138765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-38f2b6a5-9d76-41a1-9720-fd9a764e95e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.217276 Jul 21 22:22:28.139500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 680/1488] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:27 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:28.140517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8bc1bcc1-30c3-49ed-b856-c75eb20ea0d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:28.141126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8bc1bcc1-30c3-49ed-b856-c75eb20ea0d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:28.146804 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8bc1bcc1-30c3-49ed-b856-c75eb20ea0d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:28.147269 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8bc1bcc1-30c3-49ed-b856-c75eb20ea0d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:28.148030 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8bc1bcc1-30c3-49ed-b856-c75eb20ea0d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:28.148458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8bc1bcc1-30c3-49ed-b856-c75eb20ea0d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:28.166255 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:28.213622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8bc1bcc1-30c3-49ed-b856-c75eb20ea0d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:28.222218 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8bc1bcc1-30c3-49ed-b856-c75eb20ea0d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085359 Jul 21 22:22:28.222778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 809/1489] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:28 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:29.152330 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1b25dc2d-2500-4573-9b13-4c59064af830 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:29.152921 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1b25dc2d-2500-4573-9b13-4c59064af830 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:29.155542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c6cb7866-d526-4052-9e40-726556e18da4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:29.156666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c6cb7866-d526-4052-9e40-726556e18da4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:29.160043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b25dc2d-2500-4573-9b13-4c59064af830 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:29.160495 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b25dc2d-2500-4573-9b13-4c59064af830 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:29.161260 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b25dc2d-2500-4573-9b13-4c59064af830 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:29.161693 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b25dc2d-2500-4573-9b13-4c59064af830 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:29.163271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c6cb7866-d526-4052-9e40-726556e18da4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:29.163729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c6cb7866-d526-4052-9e40-726556e18da4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:29.164499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c6cb7866-d526-4052-9e40-726556e18da4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:29.164947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c6cb7866-d526-4052-9e40-726556e18da4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:29.358630 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c6cb7866-d526-4052-9e40-726556e18da4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:29.361865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1b25dc2d-2500-4573-9b13-4c59064af830 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:29.366651 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c6cb7866-d526-4052-9e40-726556e18da4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.214840 Jul 21 22:22:29.367401 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 810/1490] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:29 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:29.369904 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1b25dc2d-2500-4573-9b13-4c59064af830 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.221416 Jul 21 22:22:29.378050 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 681/1491] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:29 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:29.378209 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dd99be0e-8b3c-4d0c-aac7-8a75bbbf02b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:29.378209 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dd99be0e-8b3c-4d0c-aac7-8a75bbbf02b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:29.378433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dd99be0e-8b3c-4d0c-aac7-8a75bbbf02b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:29.378864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dd99be0e-8b3c-4d0c-aac7-8a75bbbf02b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:29.379657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dd99be0e-8b3c-4d0c-aac7-8a75bbbf02b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:29.380092 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dd99be0e-8b3c-4d0c-aac7-8a75bbbf02b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:29.439733 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dd99be0e-8b3c-4d0c-aac7-8a75bbbf02b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:29.447465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dd99be0e-8b3c-4d0c-aac7-8a75bbbf02b8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079200 Jul 21 22:22:29.448025 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 811/1492] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:29 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:29.750392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-85d24954-ed65-46af-8244-09e47962cb63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:29.750913 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-85d24954-ed65-46af-8244-09e47962cb63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:29.756921 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-85d24954-ed65-46af-8244-09e47962cb63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:29.757375 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-85d24954-ed65-46af-8244-09e47962cb63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:29.758132 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-85d24954-ed65-46af-8244-09e47962cb63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:29.758573 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-85d24954-ed65-46af-8244-09e47962cb63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:29.783222 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-85d24954-ed65-46af-8244-09e47962cb63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:22:29.861163 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-85d24954-ed65-46af-8244-09e47962cb63 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "DELETE /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 204 len: 0 microversion: 2.20 time: 0.114877 Jul 21 22:22:29.861772 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 682/1493] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jul 21 22:22:29 2022] DELETE /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 21 22:22:29.870289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9a9a430d-f3ce-405e-ad9f-e9d92610f110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:29.870893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9a9a430d-f3ce-405e-ad9f-e9d92610f110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:29.877667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a9a430d-f3ce-405e-ad9f-e9d92610f110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:29.878125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a9a430d-f3ce-405e-ad9f-e9d92610f110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:29.878892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a9a430d-f3ce-405e-ad9f-e9d92610f110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:29.879357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a9a430d-f3ce-405e-ad9f-e9d92610f110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:30.006864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9a9a430d-f3ce-405e-ad9f-e9d92610f110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:30.015143 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9a9a430d-f3ce-405e-ad9f-e9d92610f110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:30.016656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9a9a430d-f3ce-405e-ad9f-e9d92610f110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:30.018167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9a9a430d-f3ce-405e-ad9f-e9d92610f110 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 200 len: 1722 microversion: 2.20 time: 0.151892 Jul 21 22:22:30.018727 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 812/1494] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:22:29 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:22:30.383800 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-30ebd19a-a967-46dd-9132-5d8261d8623e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:30.384505 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-30ebd19a-a967-46dd-9132-5d8261d8623e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:30.386316 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7211a7da-ef8f-4f16-8dfe-67a2d9777eeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:30.387283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7211a7da-ef8f-4f16-8dfe-67a2d9777eeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:30.391221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30ebd19a-a967-46dd-9132-5d8261d8623e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:30.391679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30ebd19a-a967-46dd-9132-5d8261d8623e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:30.392464 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30ebd19a-a967-46dd-9132-5d8261d8623e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:30.392907 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30ebd19a-a967-46dd-9132-5d8261d8623e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:30.394098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7211a7da-ef8f-4f16-8dfe-67a2d9777eeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:30.394545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7211a7da-ef8f-4f16-8dfe-67a2d9777eeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:30.395706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7211a7da-ef8f-4f16-8dfe-67a2d9777eeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:30.396136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7211a7da-ef8f-4f16-8dfe-67a2d9777eeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:30.600856 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-30ebd19a-a967-46dd-9132-5d8261d8623e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:30.603912 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7211a7da-ef8f-4f16-8dfe-67a2d9777eeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:30.609035 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-30ebd19a-a967-46dd-9132-5d8261d8623e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.229417 Jul 21 22:22:30.610184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 683/1495] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:30 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:30.612703 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7211a7da-ef8f-4f16-8dfe-67a2d9777eeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.230005 Jul 21 22:22:30.613346 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 813/1496] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:30 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:30.614570 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0ab79edd-d4b5-4a7c-ad56-f3ed4c501d71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:30.615205 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0ab79edd-d4b5-4a7c-ad56-f3ed4c501d71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:30.620967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ab79edd-d4b5-4a7c-ad56-f3ed4c501d71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:30.621431 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ab79edd-d4b5-4a7c-ad56-f3ed4c501d71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:30.622197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ab79edd-d4b5-4a7c-ad56-f3ed4c501d71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:30.622636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ab79edd-d4b5-4a7c-ad56-f3ed4c501d71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:30.682529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0ab79edd-d4b5-4a7c-ad56-f3ed4c501d71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:30.690442 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0ab79edd-d4b5-4a7c-ad56-f3ed4c501d71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079338 Jul 21 22:22:30.691023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 684/1497] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:30 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:31.037066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e2440ee0-db70-472f-b42d-eba113871823 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:31.037675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e2440ee0-db70-472f-b42d-eba113871823 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:31.043640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2440ee0-db70-472f-b42d-eba113871823 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:31.044094 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2440ee0-db70-472f-b42d-eba113871823 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:31.044863 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2440ee0-db70-472f-b42d-eba113871823 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:31.045301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e2440ee0-db70-472f-b42d-eba113871823 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:31.176330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e2440ee0-db70-472f-b42d-eba113871823 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:31.184325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e2440ee0-db70-472f-b42d-eba113871823 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:31.185834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e2440ee0-db70-472f-b42d-eba113871823 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1c86ce2899b6485da1517e3b5a1c64de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a85f96959d48c5810ea0d38f65f22c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:31.186987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e2440ee0-db70-472f-b42d-eba113871823 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 200 len: 1722 microversion: 2.20 time: 0.153897 Jul 21 22:22:31.188082 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 814/1498] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:22:31 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 21 22:22:31.627430 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ee3dd249-0c36-4fd7-94aa-d77ef992b265 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:31.628033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ee3dd249-0c36-4fd7-94aa-d77ef992b265 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:31.631246 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d5828902-d140-47eb-b129-289af1b19042 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:31.632353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d5828902-d140-47eb-b129-289af1b19042 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:31.635628 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee3dd249-0c36-4fd7-94aa-d77ef992b265 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:31.636305 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee3dd249-0c36-4fd7-94aa-d77ef992b265 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:31.637282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee3dd249-0c36-4fd7-94aa-d77ef992b265 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:31.637926 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee3dd249-0c36-4fd7-94aa-d77ef992b265 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:31.639566 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d5828902-d140-47eb-b129-289af1b19042 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:31.640294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d5828902-d140-47eb-b129-289af1b19042 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:31.641284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d5828902-d140-47eb-b129-289af1b19042 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:31.641999 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d5828902-d140-47eb-b129-289af1b19042 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:31.877883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ee3dd249-0c36-4fd7-94aa-d77ef992b265 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:31.880598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d5828902-d140-47eb-b129-289af1b19042 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:31.888901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ee3dd249-0c36-4fd7-94aa-d77ef992b265 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.264606 Jul 21 22:22:31.889316 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d5828902-d140-47eb-b129-289af1b19042 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.263000 Jul 21 22:22:31.891819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 815/1499] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:31 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:31.896847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-d9f33317-e4a3-4984-9da5-206336d3caa5 req-e9a95f14-4acc-49af-873b-ea3a2ba62d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59867bfc-c5f4-4bd8-8b01-e3e622d5178b", "name": "network-vif-deleted", "tag": "a51d074c-c328-442a-8e06-ad5469efefc0"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:22:31.900502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 685/1500] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:31 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:31.906258 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b880d4d8-6d05-4e48-988d-ceebfaa7bb74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:31.907083 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-d9f33317-e4a3-4984-9da5-206336d3caa5 req-e9a95f14-4acc-49af-873b-ea3a2ba62d7e service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:31.907547 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b880d4d8-6d05-4e48-988d-ceebfaa7bb74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:31.907677 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-d9f33317-e4a3-4984-9da5-206336d3caa5 req-e9a95f14-4acc-49af-873b-ea3a2ba62d7e service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:31.915650 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b880d4d8-6d05-4e48-988d-ceebfaa7bb74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:31.916674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b880d4d8-6d05-4e48-988d-ceebfaa7bb74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:31.917689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b880d4d8-6d05-4e48-988d-ceebfaa7bb74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:31.918334 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b880d4d8-6d05-4e48-988d-ceebfaa7bb74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:31.924017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-d9f33317-e4a3-4984-9da5-206336d3caa5 req-e9a95f14-4acc-49af-873b-ea3a2ba62d7e service nova] Creating event network-vif-deleted:a51d074c-c328-442a-8e06-ad5469efefc0 for instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b on hv-cinder-82002 Jul 21 22:22:31.929307 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-d9f33317-e4a3-4984-9da5-206336d3caa5 req-e9a95f14-4acc-49af-873b-ea3a2ba62d7e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036096 Jul 21 22:22:31.930338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 816/1501] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:22:31.987346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b880d4d8-6d05-4e48-988d-ceebfaa7bb74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:31.995438 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b880d4d8-6d05-4e48-988d-ceebfaa7bb74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.093636 Jul 21 22:22:31.996018 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 686/1502] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:31 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:32.206575 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5b1b4255-d724-49bb-94b8-fb2514481b9a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:32.207232 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5b1b4255-d724-49bb-94b8-fb2514481b9a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:32.213848 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b1b4255-d724-49bb-94b8-fb2514481b9a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:32.214958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b1b4255-d724-49bb-94b8-fb2514481b9a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:32.215819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b1b4255-d724-49bb-94b8-fb2514481b9a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:32.216406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b1b4255-d724-49bb-94b8-fb2514481b9a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:32.232257 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-5b1b4255-d724-49bb-94b8-fb2514481b9a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] HTTP exception thrown: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5b1b4255-d724-49bb-94b8-fb2514481b9a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Request method failure captured: Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b HTTP/1.1 Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwhZgP2lKPueRsocGvaeMq7ROSs_8wgYETfg7lnpeTphjU1mZBhgSWUCnPew9ATJxnZrdwROuYzDAxEYKfUoMY0z8OoM9keregwq9KJtQz6YeDH9JwkorofRQ47251yiOVRYTWxjeL63B-O49ANd9ZAyv-_JpV7cnuTmGDLsrRp3uM Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:22:32.233954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:22:32.235809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36a85f96959d48c5810ea0d38f65f22c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:22:32.235809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:22:32.235809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:22:32.235809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:22:32.235809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:22:32.235809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:22:32.235809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:22:32.235809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 1c86ce2899b6485da1517e3b5a1c64de Jul 21 22:22:32.235809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:22:32.235809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:22:32.235809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:22:32.235809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '59867bfc-c5f4-4bd8-8b01-e3e622d5178b'} Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:22:32.236758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:22:32.238359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:22:32.240351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5b1b4255-d724-49bb-94b8-fb2514481b9a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Returning 404 to user: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:22:32.240351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5b1b4255-d724-49bb-94b8-fb2514481b9a tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 404 len: 111 microversion: 2.20 time: 0.033760 Jul 21 22:22:32.240351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 817/1503] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:22:32 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:22:32.245069 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-de5cb890-6d48-46ca-88e0-9dc64fb88964 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '.version_select at 0x7faca1de8550>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:32.264520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-de5cb890-6d48-46ca-88e0-9dc64fb88964 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346038580" status: 204 len: 0 microversion: 2.20 time: 0.023975 Jul 21 22:22:32.265825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 687/1504] 10.222.0.44 () {60 vars in 1261 bytes} [Thu Jul 21 22:22:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1346038580 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 21 22:22:32.906525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f12734aa-c5ef-4bd3-9ff5-e94688041c3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:32.907814 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f12734aa-c5ef-4bd3-9ff5-e94688041c3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:32.910121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3422bdbb-ce24-401d-b77f-56055ed01972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:32.910774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3422bdbb-ce24-401d-b77f-56055ed01972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:32.915478 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f12734aa-c5ef-4bd3-9ff5-e94688041c3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:32.915921 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f12734aa-c5ef-4bd3-9ff5-e94688041c3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:32.916864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f12734aa-c5ef-4bd3-9ff5-e94688041c3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:32.917341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3422bdbb-ce24-401d-b77f-56055ed01972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:32.917774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f12734aa-c5ef-4bd3-9ff5-e94688041c3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:32.917898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3422bdbb-ce24-401d-b77f-56055ed01972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:32.918697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3422bdbb-ce24-401d-b77f-56055ed01972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:32.919173 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3422bdbb-ce24-401d-b77f-56055ed01972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:32.938159 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:33.128046 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3422bdbb-ce24-401d-b77f-56055ed01972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:33.131183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f12734aa-c5ef-4bd3-9ff5-e94688041c3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:33.136113 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3422bdbb-ce24-401d-b77f-56055ed01972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.232377 Jul 21 22:22:33.136776 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 688/1505] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:32 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:33.139339 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f12734aa-c5ef-4bd3-9ff5-e94688041c3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.236587 Jul 21 22:22:33.139897 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 818/1506] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:32 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:33.141605 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e7e91f6d-e130-4dcc-a868-f75e87f2c7ea tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:33.142270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e7e91f6d-e130-4dcc-a868-f75e87f2c7ea tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:33.148084 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e7e91f6d-e130-4dcc-a868-f75e87f2c7ea tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:33.148533 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e7e91f6d-e130-4dcc-a868-f75e87f2c7ea tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:33.149296 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e7e91f6d-e130-4dcc-a868-f75e87f2c7ea tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:33.149738 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e7e91f6d-e130-4dcc-a868-f75e87f2c7ea tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:33.213393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e7e91f6d-e130-4dcc-a868-f75e87f2c7ea tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:33.221411 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e7e91f6d-e130-4dcc-a868-f75e87f2c7ea tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083551 Jul 21 22:22:33.221974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 689/1507] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:33 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:34.153392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-263de17a-d599-4a08-be90-21b73d43279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:34.153999 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-263de17a-d599-4a08-be90-21b73d43279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:34.155408 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8cdb2d2b-ecae-4748-a1d2-2d726e3f64db tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:34.156058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8cdb2d2b-ecae-4748-a1d2-2d726e3f64db tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:34.160506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-263de17a-d599-4a08-be90-21b73d43279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:34.160953 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-263de17a-d599-4a08-be90-21b73d43279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:34.161728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-263de17a-d599-4a08-be90-21b73d43279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:34.162164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-263de17a-d599-4a08-be90-21b73d43279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:34.162449 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8cdb2d2b-ecae-4748-a1d2-2d726e3f64db tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:34.162906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8cdb2d2b-ecae-4748-a1d2-2d726e3f64db tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:34.163725 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8cdb2d2b-ecae-4748-a1d2-2d726e3f64db tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:34.164167 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8cdb2d2b-ecae-4748-a1d2-2d726e3f64db tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:34.352609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-263de17a-d599-4a08-be90-21b73d43279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:34.356668 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8cdb2d2b-ecae-4748-a1d2-2d726e3f64db tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:34.361208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-263de17a-d599-4a08-be90-21b73d43279d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.211893 Jul 21 22:22:34.361782 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 819/1508] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:34 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:34.366320 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8cdb2d2b-ecae-4748-a1d2-2d726e3f64db tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.213945 Jul 21 22:22:34.366320 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 690/1509] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:34 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:34.366527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bd042770-de7e-48ca-8097-1139d711650b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:34.366890 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bd042770-de7e-48ca-8097-1139d711650b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:34.372875 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd042770-de7e-48ca-8097-1139d711650b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:34.373323 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd042770-de7e-48ca-8097-1139d711650b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:34.374093 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd042770-de7e-48ca-8097-1139d711650b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:34.374533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd042770-de7e-48ca-8097-1139d711650b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:34.447156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bd042770-de7e-48ca-8097-1139d711650b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:34.456702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bd042770-de7e-48ca-8097-1139d711650b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.093942 Jul 21 22:22:34.457267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 820/1510] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:34 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:35.378897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7308e97c-3909-47bb-b58e-81aa7487cda8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:35.379535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7308e97c-3909-47bb-b58e-81aa7487cda8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:35.381768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7891dcad-7567-46b4-9f5f-b950ad12d663 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:35.382383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7891dcad-7567-46b4-9f5f-b950ad12d663 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:35.385982 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7308e97c-3909-47bb-b58e-81aa7487cda8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:35.386430 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7308e97c-3909-47bb-b58e-81aa7487cda8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:35.387229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7308e97c-3909-47bb-b58e-81aa7487cda8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:35.387666 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7308e97c-3909-47bb-b58e-81aa7487cda8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:35.388712 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7891dcad-7567-46b4-9f5f-b950ad12d663 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:35.389163 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7891dcad-7567-46b4-9f5f-b950ad12d663 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:35.389969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7891dcad-7567-46b4-9f5f-b950ad12d663 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:35.390922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7891dcad-7567-46b4-9f5f-b950ad12d663 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:35.581574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7308e97c-3909-47bb-b58e-81aa7487cda8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:35.584070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7891dcad-7567-46b4-9f5f-b950ad12d663 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:35.589638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7308e97c-3909-47bb-b58e-81aa7487cda8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.215254 Jul 21 22:22:35.590216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 691/1511] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:35 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:35.591928 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7891dcad-7567-46b4-9f5f-b950ad12d663 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.214225 Jul 21 22:22:35.592705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 821/1512] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:35 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:35.595605 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-32bcb169-d174-4e78-b210-6e536e371e67 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:35.596277 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-32bcb169-d174-4e78-b210-6e536e371e67 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:35.602022 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32bcb169-d174-4e78-b210-6e536e371e67 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:35.602476 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32bcb169-d174-4e78-b210-6e536e371e67 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:35.603277 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32bcb169-d174-4e78-b210-6e536e371e67 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:35.603718 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32bcb169-d174-4e78-b210-6e536e371e67 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:35.663734 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-32bcb169-d174-4e78-b210-6e536e371e67 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:35.672431 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-32bcb169-d174-4e78-b210-6e536e371e67 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080561 Jul 21 22:22:35.673014 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 692/1513] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:35 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:36.607474 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-34fcc69a-0708-40b9-a3df-6e76ad752d47 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:36.608085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-34fcc69a-0708-40b9-a3df-6e76ad752d47 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:36.609352 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d465ea87-cce1-40a6-ac08-e491be3a4504 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:36.610119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d465ea87-cce1-40a6-ac08-e491be3a4504 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:36.614581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-34fcc69a-0708-40b9-a3df-6e76ad752d47 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:36.615066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-34fcc69a-0708-40b9-a3df-6e76ad752d47 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:36.615836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-34fcc69a-0708-40b9-a3df-6e76ad752d47 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:36.616271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-34fcc69a-0708-40b9-a3df-6e76ad752d47 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:36.616434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d465ea87-cce1-40a6-ac08-e491be3a4504 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:36.616894 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d465ea87-cce1-40a6-ac08-e491be3a4504 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:36.617655 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d465ea87-cce1-40a6-ac08-e491be3a4504 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:36.618088 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d465ea87-cce1-40a6-ac08-e491be3a4504 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:36.807240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-34fcc69a-0708-40b9-a3df-6e76ad752d47 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:36.811218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d465ea87-cce1-40a6-ac08-e491be3a4504 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:36.816156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-34fcc69a-0708-40b9-a3df-6e76ad752d47 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.212437 Jul 21 22:22:36.816738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 822/1514] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:36 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:36.820029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d465ea87-cce1-40a6-ac08-e491be3a4504 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.214384 Jul 21 22:22:36.820708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 693/1515] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:36 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:36.821113 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b5a4c71f-e884-400a-9c17-1d4bd56bb1a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:36.821717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b5a4c71f-e884-400a-9c17-1d4bd56bb1a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:36.827421 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b5a4c71f-e884-400a-9c17-1d4bd56bb1a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:36.827909 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b5a4c71f-e884-400a-9c17-1d4bd56bb1a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:36.828643 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b5a4c71f-e884-400a-9c17-1d4bd56bb1a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:36.829078 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b5a4c71f-e884-400a-9c17-1d4bd56bb1a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:36.891148 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b5a4c71f-e884-400a-9c17-1d4bd56bb1a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:36.898900 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b5a4c71f-e884-400a-9c17-1d4bd56bb1a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081232 Jul 21 22:22:36.899495 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 823/1516] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:36 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:37.833809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7d6fe3f4-2997-4343-97ae-069299ae5b30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:37.834334 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7d6fe3f4-2997-4343-97ae-069299ae5b30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:37.837056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e75ab261-62eb-45a9-8696-52d11301476d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:37.837690 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e75ab261-62eb-45a9-8696-52d11301476d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:37.840940 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7d6fe3f4-2997-4343-97ae-069299ae5b30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:37.841392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7d6fe3f4-2997-4343-97ae-069299ae5b30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:37.842160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7d6fe3f4-2997-4343-97ae-069299ae5b30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:37.842645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7d6fe3f4-2997-4343-97ae-069299ae5b30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:37.844783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e75ab261-62eb-45a9-8696-52d11301476d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:37.845492 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e75ab261-62eb-45a9-8696-52d11301476d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:37.846257 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e75ab261-62eb-45a9-8696-52d11301476d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:37.846697 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e75ab261-62eb-45a9-8696-52d11301476d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:37.988723 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7d6fe3f4-2997-4343-97ae-069299ae5b30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:37.997807 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7d6fe3f4-2997-4343-97ae-069299ae5b30 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.167885 Jul 21 22:22:37.998771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 694/1517] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:37 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:38.006580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e66f6c44-e490-423a-8716-1941c33e4cf0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:38.006993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e66f6c44-e490-423a-8716-1941c33e4cf0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:38.013774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e66f6c44-e490-423a-8716-1941c33e4cf0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:38.014227 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e66f6c44-e490-423a-8716-1941c33e4cf0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:38.015037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e66f6c44-e490-423a-8716-1941c33e4cf0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:38.016100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e66f6c44-e490-423a-8716-1941c33e4cf0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:38.097487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e66f6c44-e490-423a-8716-1941c33e4cf0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:38.105544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e66f6c44-e490-423a-8716-1941c33e4cf0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.104710 Jul 21 22:22:38.106121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 695/1518] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:37 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:38.152373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e75ab261-62eb-45a9-8696-52d11301476d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:38.160201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e75ab261-62eb-45a9-8696-52d11301476d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.326984 Jul 21 22:22:38.161913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 824/1519] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:37 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:38.563245 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:22:38.563431 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:22:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:22:39.015795 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-01807c43-c287-466f-926d-9758385ff584 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:39.016969 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-01807c43-c287-466f-926d-9758385ff584 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:39.023278 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-01807c43-c287-466f-926d-9758385ff584 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:39.023730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-01807c43-c287-466f-926d-9758385ff584 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:39.024499 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-01807c43-c287-466f-926d-9758385ff584 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:39.024937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-01807c43-c287-466f-926d-9758385ff584 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:39.121703 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fe5387dc-e5bc-4a28-9c97-7161af16563b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:39.122419 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fe5387dc-e5bc-4a28-9c97-7161af16563b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:39.128852 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe5387dc-e5bc-4a28-9c97-7161af16563b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:39.129299 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe5387dc-e5bc-4a28-9c97-7161af16563b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:39.130060 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe5387dc-e5bc-4a28-9c97-7161af16563b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:39.130490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fe5387dc-e5bc-4a28-9c97-7161af16563b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:39.157708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-01807c43-c287-466f-926d-9758385ff584 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:39.166090 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-01807c43-c287-466f-926d-9758385ff584 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.154401 Jul 21 22:22:39.166689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 696/1520] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:39 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:39.181505 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-69361d39-a7b3-4ba0-9794-49261fc590a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:39.182139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-69361d39-a7b3-4ba0-9794-49261fc590a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:39.188207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-69361d39-a7b3-4ba0-9794-49261fc590a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:39.188822 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-69361d39-a7b3-4ba0-9794-49261fc590a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:39.189433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-69361d39-a7b3-4ba0-9794-49261fc590a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:39.189871 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-69361d39-a7b3-4ba0-9794-49261fc590a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:39.191798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fe5387dc-e5bc-4a28-9c97-7161af16563b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:39.199665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fe5387dc-e5bc-4a28-9c97-7161af16563b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081864 Jul 21 22:22:39.200407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 825/1521] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:39 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:39.315589 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-69361d39-a7b3-4ba0-9794-49261fc590a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:39.323371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-69361d39-a7b3-4ba0-9794-49261fc590a3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.145598 Jul 21 22:22:39.323970 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 697/1522] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:39 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:40.184986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-792a7efd-82c4-46f6-a521-7c2c1b0b82fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:40.184986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-792a7efd-82c4-46f6-a521-7c2c1b0b82fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:40.191841 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-792a7efd-82c4-46f6-a521-7c2c1b0b82fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:40.192289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-792a7efd-82c4-46f6-a521-7c2c1b0b82fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:40.193180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-792a7efd-82c4-46f6-a521-7c2c1b0b82fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:40.193608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-792a7efd-82c4-46f6-a521-7c2c1b0b82fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:40.216903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8b057924-5ed0-4566-add3-800febda6ea9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:40.217526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8b057924-5ed0-4566-add3-800febda6ea9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:40.225049 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b057924-5ed0-4566-add3-800febda6ea9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:40.225512 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b057924-5ed0-4566-add3-800febda6ea9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:40.226311 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b057924-5ed0-4566-add3-800febda6ea9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:40.226755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b057924-5ed0-4566-add3-800febda6ea9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:40.296428 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8b057924-5ed0-4566-add3-800febda6ea9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:40.305006 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8b057924-5ed0-4566-add3-800febda6ea9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.091915 Jul 21 22:22:40.305595 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 698/1523] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:40 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:40.341213 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-af3109c0-b875-414f-8748-d12b8329b84f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:40.341833 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-af3109c0-b875-414f-8748-d12b8329b84f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:40.348730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af3109c0-b875-414f-8748-d12b8329b84f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:40.349179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af3109c0-b875-414f-8748-d12b8329b84f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:40.349954 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af3109c0-b875-414f-8748-d12b8329b84f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:40.350389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af3109c0-b875-414f-8748-d12b8329b84f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:40.355039 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-792a7efd-82c4-46f6-a521-7c2c1b0b82fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:40.363617 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-792a7efd-82c4-46f6-a521-7c2c1b0b82fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.183309 Jul 21 22:22:40.364173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 826/1524] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:40 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:40.480115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-af3109c0-b875-414f-8748-d12b8329b84f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:40.488518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-af3109c0-b875-414f-8748-d12b8329b84f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.151158 Jul 21 22:22:40.489093 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 699/1525] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:40 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:41.321960 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a1118bd2-d781-4491-9165-714eff48137e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:41.322569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a1118bd2-d781-4491-9165-714eff48137e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:41.329167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1118bd2-d781-4491-9165-714eff48137e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:41.329622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1118bd2-d781-4491-9165-714eff48137e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:41.330394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1118bd2-d781-4491-9165-714eff48137e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:41.330835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1118bd2-d781-4491-9165-714eff48137e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:41.348767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:41.381276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ff591772-89f8-4e7e-abe4-77b98ff3d61c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:41.381897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ff591772-89f8-4e7e-abe4-77b98ff3d61c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:41.388451 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff591772-89f8-4e7e-abe4-77b98ff3d61c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:41.388908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff591772-89f8-4e7e-abe4-77b98ff3d61c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:41.389680 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff591772-89f8-4e7e-abe4-77b98ff3d61c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:41.390119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff591772-89f8-4e7e-abe4-77b98ff3d61c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:41.396084 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a1118bd2-d781-4491-9165-714eff48137e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:41.403857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a1118bd2-d781-4491-9165-714eff48137e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085800 Jul 21 22:22:41.404412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 827/1526] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:41 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:41.506446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-993974c6-f63d-4ff6-96b8-e448b41f7d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:41.507074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-993974c6-f63d-4ff6-96b8-e448b41f7d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:41.513032 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-993974c6-f63d-4ff6-96b8-e448b41f7d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:41.513460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-993974c6-f63d-4ff6-96b8-e448b41f7d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:41.514225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-993974c6-f63d-4ff6-96b8-e448b41f7d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:41.514656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-993974c6-f63d-4ff6-96b8-e448b41f7d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:41.517493 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ff591772-89f8-4e7e-abe4-77b98ff3d61c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:41.525550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ff591772-89f8-4e7e-abe4-77b98ff3d61c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148181 Jul 21 22:22:41.526119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 700/1527] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:41 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:41.642847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-993974c6-f63d-4ff6-96b8-e448b41f7d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:41.650687 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-993974c6-f63d-4ff6-96b8-e448b41f7d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148176 Jul 21 22:22:41.651274 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 828/1528] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:41 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:42.420870 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f0619de8-9d28-4d49-a0ec-8a32e04c7a0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:42.421564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f0619de8-9d28-4d49-a0ec-8a32e04c7a0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:42.428565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0619de8-9d28-4d49-a0ec-8a32e04c7a0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:42.429021 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0619de8-9d28-4d49-a0ec-8a32e04c7a0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:42.429805 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0619de8-9d28-4d49-a0ec-8a32e04c7a0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:42.430252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0619de8-9d28-4d49-a0ec-8a32e04c7a0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:42.495012 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f0619de8-9d28-4d49-a0ec-8a32e04c7a0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:42.503693 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f0619de8-9d28-4d49-a0ec-8a32e04c7a0f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.086983 Jul 21 22:22:42.504260 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 701/1529] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:42 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:42.542323 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6a2a49ad-280a-4416-a2de-df593aa6b06c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:42.542934 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6a2a49ad-280a-4416-a2de-df593aa6b06c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:42.549420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a2a49ad-280a-4416-a2de-df593aa6b06c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:42.549958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a2a49ad-280a-4416-a2de-df593aa6b06c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:42.550732 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a2a49ad-280a-4416-a2de-df593aa6b06c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:42.551219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a2a49ad-280a-4416-a2de-df593aa6b06c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:42.668776 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-07c1aabd-cab4-4aba-902f-50076b1ef5d6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:42.669305 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-07c1aabd-cab4-4aba-902f-50076b1ef5d6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:42.678371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07c1aabd-cab4-4aba-902f-50076b1ef5d6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:42.678823 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07c1aabd-cab4-4aba-902f-50076b1ef5d6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:42.679656 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07c1aabd-cab4-4aba-902f-50076b1ef5d6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:42.680090 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07c1aabd-cab4-4aba-902f-50076b1ef5d6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:42.974698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6a2a49ad-280a-4416-a2de-df593aa6b06c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:42.977748 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-07c1aabd-cab4-4aba-902f-50076b1ef5d6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:42.987339 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-07c1aabd-cab4-4aba-902f-50076b1ef5d6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.322519 Jul 21 22:22:42.988238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 702/1530] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:42 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:42.989431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6a2a49ad-280a-4416-a2de-df593aa6b06c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.450649 Jul 21 22:22:42.990146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 829/1531] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:42 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:43.520965 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7b04b2e8-d7bb-4009-961e-d16ef35cf63f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:43.521582 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7b04b2e8-d7bb-4009-961e-d16ef35cf63f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:43.528103 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b04b2e8-d7bb-4009-961e-d16ef35cf63f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:43.528562 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b04b2e8-d7bb-4009-961e-d16ef35cf63f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:43.529366 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b04b2e8-d7bb-4009-961e-d16ef35cf63f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:43.529809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b04b2e8-d7bb-4009-961e-d16ef35cf63f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:43.590779 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7b04b2e8-d7bb-4009-961e-d16ef35cf63f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:43.599613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7b04b2e8-d7bb-4009-961e-d16ef35cf63f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082487 Jul 21 22:22:43.600178 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 703/1532] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:43 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:44.005855 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a4293467-594b-4495-a41f-da69ccfdb6ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:44.006472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a4293467-594b-4495-a41f-da69ccfdb6ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:44.008831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8fb092d1-8ab0-4a81-9580-8f0a31ca6d52 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:44.009448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8fb092d1-8ab0-4a81-9580-8f0a31ca6d52 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:44.012997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a4293467-594b-4495-a41f-da69ccfdb6ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:44.013446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a4293467-594b-4495-a41f-da69ccfdb6ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:44.014213 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a4293467-594b-4495-a41f-da69ccfdb6ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:44.014648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a4293467-594b-4495-a41f-da69ccfdb6ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:44.015377 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fb092d1-8ab0-4a81-9580-8f0a31ca6d52 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:44.016433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fb092d1-8ab0-4a81-9580-8f0a31ca6d52 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:44.017215 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fb092d1-8ab0-4a81-9580-8f0a31ca6d52 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:44.017658 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fb092d1-8ab0-4a81-9580-8f0a31ca6d52 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:44.209507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a4293467-594b-4495-a41f-da69ccfdb6ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:44.216206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8fb092d1-8ab0-4a81-9580-8f0a31ca6d52 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:44.217410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a4293467-594b-4495-a41f-da69ccfdb6ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.215585 Jul 21 22:22:44.218078 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 830/1533] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:44 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:44.224794 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8fb092d1-8ab0-4a81-9580-8f0a31ca6d52 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.219657 Jul 21 22:22:44.231778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 704/1534] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:44 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:44.616593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2a3bf5eb-821c-4ab5-9262-9efc39038ae6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:44.617199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2a3bf5eb-821c-4ab5-9262-9efc39038ae6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:44.623186 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a3bf5eb-821c-4ab5-9262-9efc39038ae6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:44.623657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a3bf5eb-821c-4ab5-9262-9efc39038ae6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:44.624398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a3bf5eb-821c-4ab5-9262-9efc39038ae6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:44.624886 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a3bf5eb-821c-4ab5-9262-9efc39038ae6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:44.685373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2a3bf5eb-821c-4ab5-9262-9efc39038ae6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:44.693118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2a3bf5eb-821c-4ab5-9262-9efc39038ae6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080375 Jul 21 22:22:44.693672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 831/1535] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:44 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:45.234089 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1a6d3b76-a4ca-4208-83e2-fbe2bb71d7b3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:45.234716 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1a6d3b76-a4ca-4208-83e2-fbe2bb71d7b3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:45.241190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a6d3b76-a4ca-4208-83e2-fbe2bb71d7b3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:45.241402 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d471cade-3de0-4269-9dc7-29ffdeb7373c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:45.241832 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a6d3b76-a4ca-4208-83e2-fbe2bb71d7b3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:45.242022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d471cade-3de0-4269-9dc7-29ffdeb7373c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:45.242403 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a6d3b76-a4ca-4208-83e2-fbe2bb71d7b3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:45.242843 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a6d3b76-a4ca-4208-83e2-fbe2bb71d7b3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:45.246778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:45.248671 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d471cade-3de0-4269-9dc7-29ffdeb7373c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:45.249154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d471cade-3de0-4269-9dc7-29ffdeb7373c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:45.249965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d471cade-3de0-4269-9dc7-29ffdeb7373c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:45.250406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d471cade-3de0-4269-9dc7-29ffdeb7373c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:45.438420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1a6d3b76-a4ca-4208-83e2-fbe2bb71d7b3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:45.442827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d471cade-3de0-4269-9dc7-29ffdeb7373c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:45.446358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1a6d3b76-a4ca-4208-83e2-fbe2bb71d7b3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.216163 Jul 21 22:22:45.446933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 705/1536] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:45 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:45.450687 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d471cade-3de0-4269-9dc7-29ffdeb7373c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.213087 Jul 21 22:22:45.451410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 832/1537] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:45 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:45.710102 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-11449346-eab4-47ff-bd07-17ae92e6f12b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:45.710708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-11449346-eab4-47ff-bd07-17ae92e6f12b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:45.716670 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-11449346-eab4-47ff-bd07-17ae92e6f12b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:45.717115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-11449346-eab4-47ff-bd07-17ae92e6f12b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:45.717874 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-11449346-eab4-47ff-bd07-17ae92e6f12b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:45.718307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-11449346-eab4-47ff-bd07-17ae92e6f12b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:45.778378 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-11449346-eab4-47ff-bd07-17ae92e6f12b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:45.786238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-11449346-eab4-47ff-bd07-17ae92e6f12b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079942 Jul 21 22:22:45.786801 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 706/1538] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:45 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:46.465367 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-72fd60d0-20c1-4837-9f6a-94a2e27e851b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:46.465955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-72fd60d0-20c1-4837-9f6a-94a2e27e851b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:46.470985 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-65fa34fb-7f89-45b9-8e92-f93ce09aa75f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:46.471621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-65fa34fb-7f89-45b9-8e92-f93ce09aa75f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:46.473552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72fd60d0-20c1-4837-9f6a-94a2e27e851b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:46.473942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72fd60d0-20c1-4837-9f6a-94a2e27e851b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:46.474790 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72fd60d0-20c1-4837-9f6a-94a2e27e851b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:46.475250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72fd60d0-20c1-4837-9f6a-94a2e27e851b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:46.478138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-65fa34fb-7f89-45b9-8e92-f93ce09aa75f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:46.478592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-65fa34fb-7f89-45b9-8e92-f93ce09aa75f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:46.479401 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-65fa34fb-7f89-45b9-8e92-f93ce09aa75f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:46.479846 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-65fa34fb-7f89-45b9-8e92-f93ce09aa75f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:46.659375 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-72fd60d0-20c1-4837-9f6a-94a2e27e851b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:46.667377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-72fd60d0-20c1-4837-9f6a-94a2e27e851b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.205819 Jul 21 22:22:46.668172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 833/1539] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:46 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:46.670930 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-65fa34fb-7f89-45b9-8e92-f93ce09aa75f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:46.679026 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-65fa34fb-7f89-45b9-8e92-f93ce09aa75f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.212669 Jul 21 22:22:46.679615 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 707/1540] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:46 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:46.802823 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f3bcacc8-a2e2-4448-a5f0-8239fe58fb06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:46.803490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f3bcacc8-a2e2-4448-a5f0-8239fe58fb06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:46.809430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f3bcacc8-a2e2-4448-a5f0-8239fe58fb06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:46.809886 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f3bcacc8-a2e2-4448-a5f0-8239fe58fb06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:46.810654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f3bcacc8-a2e2-4448-a5f0-8239fe58fb06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:46.811130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f3bcacc8-a2e2-4448-a5f0-8239fe58fb06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:46.871585 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f3bcacc8-a2e2-4448-a5f0-8239fe58fb06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:46.880185 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f3bcacc8-a2e2-4448-a5f0-8239fe58fb06 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081213 Jul 21 22:22:46.880752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 834/1541] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:46 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:47.684568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-41f50900-bd37-4901-8471-21dea504ec95 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:47.685205 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-41f50900-bd37-4901-8471-21dea504ec95 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:47.692253 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41f50900-bd37-4901-8471-21dea504ec95 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:47.692700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41f50900-bd37-4901-8471-21dea504ec95 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:47.693465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41f50900-bd37-4901-8471-21dea504ec95 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:47.693897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41f50900-bd37-4901-8471-21dea504ec95 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:47.695612 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d08b7195-58be-47e3-b62f-4a1c909bc75b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:47.696230 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d08b7195-58be-47e3-b62f-4a1c909bc75b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:47.702581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d08b7195-58be-47e3-b62f-4a1c909bc75b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:47.703107 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d08b7195-58be-47e3-b62f-4a1c909bc75b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:47.704412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d08b7195-58be-47e3-b62f-4a1c909bc75b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:47.704849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d08b7195-58be-47e3-b62f-4a1c909bc75b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:47.885755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-41f50900-bd37-4901-8471-21dea504ec95 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:47.888829 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d08b7195-58be-47e3-b62f-4a1c909bc75b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:47.894395 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-41f50900-bd37-4901-8471-21dea504ec95 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.213702 Jul 21 22:22:47.899905 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 708/1542] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:47 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:47.900067 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d08b7195-58be-47e3-b62f-4a1c909bc75b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.205701 Jul 21 22:22:47.900067 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 835/1543] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:47 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:47.900257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2cacb6e3-a2e8-481c-8804-eea48dde00da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:47.900257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2cacb6e3-a2e8-481c-8804-eea48dde00da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:47.906193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cacb6e3-a2e8-481c-8804-eea48dde00da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:47.906645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cacb6e3-a2e8-481c-8804-eea48dde00da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:47.907441 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cacb6e3-a2e8-481c-8804-eea48dde00da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:47.907877 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cacb6e3-a2e8-481c-8804-eea48dde00da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:47.971399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2cacb6e3-a2e8-481c-8804-eea48dde00da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:47.979199 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2cacb6e3-a2e8-481c-8804-eea48dde00da tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083247 Jul 21 22:22:47.979757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 709/1544] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:47 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:48.911917 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a63b7a34-8bad-417b-a1a4-63ed686a7ec0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:48.912534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a63b7a34-8bad-417b-a1a4-63ed686a7ec0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:48.913468 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1c0b292e-34f8-4583-ab9e-bd49734836dc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:48.914093 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1c0b292e-34f8-4583-ab9e-bd49734836dc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:48.919191 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a63b7a34-8bad-417b-a1a4-63ed686a7ec0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:48.919647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a63b7a34-8bad-417b-a1a4-63ed686a7ec0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:48.920421 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a63b7a34-8bad-417b-a1a4-63ed686a7ec0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:48.920551 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1c0b292e-34f8-4583-ab9e-bd49734836dc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:48.920859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a63b7a34-8bad-417b-a1a4-63ed686a7ec0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:48.920972 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1c0b292e-34f8-4583-ab9e-bd49734836dc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:48.921700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1c0b292e-34f8-4583-ab9e-bd49734836dc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:48.922141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1c0b292e-34f8-4583-ab9e-bd49734836dc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:49.114853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a63b7a34-8bad-417b-a1a4-63ed686a7ec0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:49.118640 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1c0b292e-34f8-4583-ab9e-bd49734836dc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:49.123253 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a63b7a34-8bad-417b-a1a4-63ed686a7ec0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.215218 Jul 21 22:22:49.123822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 836/1545] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:48 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:49.126895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1c0b292e-34f8-4583-ab9e-bd49734836dc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.217280 Jul 21 22:22:49.127639 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 710/1546] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:48 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:49.128699 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-35c75173-0eb4-4637-ab8a-38ea2563862a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:49.129300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-35c75173-0eb4-4637-ab8a-38ea2563862a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:49.135081 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-35c75173-0eb4-4637-ab8a-38ea2563862a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:49.135533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-35c75173-0eb4-4637-ab8a-38ea2563862a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:49.136399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-35c75173-0eb4-4637-ab8a-38ea2563862a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:49.136834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-35c75173-0eb4-4637-ab8a-38ea2563862a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:49.196231 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-35c75173-0eb4-4637-ab8a-38ea2563862a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:49.204735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-35c75173-0eb4-4637-ab8a-38ea2563862a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079990 Jul 21 22:22:49.205294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 837/1547] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:49 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:50.144054 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cc2f2e19-3c4c-4957-81f6-d8c254ad10cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:50.144704 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cc2f2e19-3c4c-4957-81f6-d8c254ad10cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:50.146678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b4df1e49-bce5-4ce1-bbd1-495accfeb645 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:50.147359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b4df1e49-bce5-4ce1-bbd1-495accfeb645 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:50.151355 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cc2f2e19-3c4c-4957-81f6-d8c254ad10cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:50.151803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cc2f2e19-3c4c-4957-81f6-d8c254ad10cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:50.152579 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cc2f2e19-3c4c-4957-81f6-d8c254ad10cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:50.153012 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cc2f2e19-3c4c-4957-81f6-d8c254ad10cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:50.153723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b4df1e49-bce5-4ce1-bbd1-495accfeb645 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:50.154181 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b4df1e49-bce5-4ce1-bbd1-495accfeb645 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:50.154961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b4df1e49-bce5-4ce1-bbd1-495accfeb645 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:50.155431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b4df1e49-bce5-4ce1-bbd1-495accfeb645 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:50.356773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cc2f2e19-3c4c-4957-81f6-d8c254ad10cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:50.360078 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b4df1e49-bce5-4ce1-bbd1-495accfeb645 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:50.364788 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cc2f2e19-3c4c-4957-81f6-d8c254ad10cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.224820 Jul 21 22:22:50.365453 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 711/1548] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:50 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:50.368376 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b4df1e49-bce5-4ce1-bbd1-495accfeb645 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.225427 Jul 21 22:22:50.369072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 838/1549] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:50 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:50.370030 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c6c0345d-b32e-4f64-933f-96efa340e435 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:50.370766 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c6c0345d-b32e-4f64-933f-96efa340e435 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:50.376596 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c6c0345d-b32e-4f64-933f-96efa340e435 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:50.377046 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c6c0345d-b32e-4f64-933f-96efa340e435 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:50.377809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c6c0345d-b32e-4f64-933f-96efa340e435 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:50.378257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c6c0345d-b32e-4f64-933f-96efa340e435 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:50.437918 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c6c0345d-b32e-4f64-933f-96efa340e435 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:50.445650 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c6c0345d-b32e-4f64-933f-96efa340e435 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079281 Jul 21 22:22:50.446217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 712/1550] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:50 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:51.380988 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8961c579-e5ff-42b9-80b8-1349d0ca12a7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:51.381606 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8961c579-e5ff-42b9-80b8-1349d0ca12a7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:51.384748 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fd48d1c3-fa07-4dd8-8402-351a76781f1b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:51.385358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fd48d1c3-fa07-4dd8-8402-351a76781f1b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:51.388189 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8961c579-e5ff-42b9-80b8-1349d0ca12a7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:51.388636 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8961c579-e5ff-42b9-80b8-1349d0ca12a7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:51.389412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8961c579-e5ff-42b9-80b8-1349d0ca12a7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:51.389848 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8961c579-e5ff-42b9-80b8-1349d0ca12a7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:51.392022 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fd48d1c3-fa07-4dd8-8402-351a76781f1b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:51.392478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fd48d1c3-fa07-4dd8-8402-351a76781f1b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:51.393270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fd48d1c3-fa07-4dd8-8402-351a76781f1b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:51.394980 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fd48d1c3-fa07-4dd8-8402-351a76781f1b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:51.584461 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8961c579-e5ff-42b9-80b8-1349d0ca12a7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:51.590982 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fd48d1c3-fa07-4dd8-8402-351a76781f1b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:51.592538 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8961c579-e5ff-42b9-80b8-1349d0ca12a7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.215448 Jul 21 22:22:51.600825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 839/1551] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:51 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:51.600825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cee9af18-202d-417e-8658-4b5770dce240 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:51.600825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cee9af18-202d-417e-8658-4b5770dce240 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:51.605132 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cee9af18-202d-417e-8658-4b5770dce240 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:51.605594 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cee9af18-202d-417e-8658-4b5770dce240 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:51.606231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fd48d1c3-fa07-4dd8-8402-351a76781f1b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.225225 Jul 21 22:22:51.606372 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cee9af18-202d-417e-8658-4b5770dce240 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:51.606793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cee9af18-202d-417e-8658-4b5770dce240 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:51.606928 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 713/1552] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:51 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:51.669736 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-cee9af18-202d-417e-8658-4b5770dce240 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:51.678438 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cee9af18-202d-417e-8658-4b5770dce240 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083500 Jul 21 22:22:51.679020 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 840/1553] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:51 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:52.610004 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-71082954-dee2-4f22-b8f4-15d5ca7d1c34 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:52.610614 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-71082954-dee2-4f22-b8f4-15d5ca7d1c34 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:52.617030 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-71082954-dee2-4f22-b8f4-15d5ca7d1c34 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:52.617479 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-71082954-dee2-4f22-b8f4-15d5ca7d1c34 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:52.618235 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-71082954-dee2-4f22-b8f4-15d5ca7d1c34 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:52.618671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-71082954-dee2-4f22-b8f4-15d5ca7d1c34 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:52.625920 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-aa642abe-6951-4745-9498-ddb11eb59971 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:52.626531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-aa642abe-6951-4745-9498-ddb11eb59971 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:52.632997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa642abe-6951-4745-9498-ddb11eb59971 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:52.633477 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa642abe-6951-4745-9498-ddb11eb59971 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:52.634244 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa642abe-6951-4745-9498-ddb11eb59971 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:52.634688 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa642abe-6951-4745-9498-ddb11eb59971 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:52.817809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-71082954-dee2-4f22-b8f4-15d5ca7d1c34 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:52.820726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-aa642abe-6951-4745-9498-ddb11eb59971 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:52.825835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-71082954-dee2-4f22-b8f4-15d5ca7d1c34 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.219826 Jul 21 22:22:52.826420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 714/1554] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:52 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:52.829719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-aa642abe-6951-4745-9498-ddb11eb59971 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.207603 Jul 21 22:22:52.830278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 841/1555] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:52 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:52.831393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8f2fc2f1-721b-4957-9e72-170709d722e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:52.832006 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8f2fc2f1-721b-4957-9e72-170709d722e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:52.837765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f2fc2f1-721b-4957-9e72-170709d722e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:52.838219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f2fc2f1-721b-4957-9e72-170709d722e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:52.839010 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f2fc2f1-721b-4957-9e72-170709d722e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:52.839456 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f2fc2f1-721b-4957-9e72-170709d722e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:52.899714 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8f2fc2f1-721b-4957-9e72-170709d722e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:52.907515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8f2fc2f1-721b-4957-9e72-170709d722e7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080152 Jul 21 22:22:52.908095 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 715/1556] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:52 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:53.844336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-098f5c6a-abf1-4324-b479-c74e6a4d21f2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:53.845134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-098f5c6a-abf1-4324-b479-c74e6a4d21f2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:53.847470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-39ea4609-928e-4519-8f62-2b578d0ca0d7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:53.848082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-39ea4609-928e-4519-8f62-2b578d0ca0d7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:53.854914 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39ea4609-928e-4519-8f62-2b578d0ca0d7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:53.855399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39ea4609-928e-4519-8f62-2b578d0ca0d7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:53.855506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-098f5c6a-abf1-4324-b479-c74e6a4d21f2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:53.855897 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-098f5c6a-abf1-4324-b479-c74e6a4d21f2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:53.856176 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39ea4609-928e-4519-8f62-2b578d0ca0d7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:53.856612 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39ea4609-928e-4519-8f62-2b578d0ca0d7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:53.856812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-098f5c6a-abf1-4324-b479-c74e6a4d21f2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:53.857271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-098f5c6a-abf1-4324-b479-c74e6a4d21f2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:54.053432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-39ea4609-928e-4519-8f62-2b578d0ca0d7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:54.057545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-098f5c6a-abf1-4324-b479-c74e6a4d21f2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:54.061580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-39ea4609-928e-4519-8f62-2b578d0ca0d7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.218802 Jul 21 22:22:54.062240 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 716/1557] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:53 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:54.065657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-098f5c6a-abf1-4324-b479-c74e6a4d21f2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.225924 Jul 21 22:22:54.066357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 842/1558] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:53 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:54.067197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ad5cc2a1-3cfd-4d58-b5ee-5da85dae2a74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:54.067804 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ad5cc2a1-3cfd-4d58-b5ee-5da85dae2a74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:54.073664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad5cc2a1-3cfd-4d58-b5ee-5da85dae2a74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:54.074110 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad5cc2a1-3cfd-4d58-b5ee-5da85dae2a74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:54.074873 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad5cc2a1-3cfd-4d58-b5ee-5da85dae2a74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:54.075335 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad5cc2a1-3cfd-4d58-b5ee-5da85dae2a74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:54.135826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ad5cc2a1-3cfd-4d58-b5ee-5da85dae2a74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:54.144150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ad5cc2a1-3cfd-4d58-b5ee-5da85dae2a74 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080982 Jul 21 22:22:54.144718 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 717/1559] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:54 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:55.078516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-15b9a2a0-a4db-4088-b3b3-b2c812d61546 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:55.079164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-15b9a2a0-a4db-4088-b3b3-b2c812d61546 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:55.081472 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1e894884-3a1e-44a2-9e0f-6f1f92455799 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:55.082081 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1e894884-3a1e-44a2-9e0f-6f1f92455799 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:55.085814 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15b9a2a0-a4db-4088-b3b3-b2c812d61546 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:55.086273 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15b9a2a0-a4db-4088-b3b3-b2c812d61546 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:55.087071 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15b9a2a0-a4db-4088-b3b3-b2c812d61546 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:55.087515 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15b9a2a0-a4db-4088-b3b3-b2c812d61546 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:55.088457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e894884-3a1e-44a2-9e0f-6f1f92455799 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:55.088907 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e894884-3a1e-44a2-9e0f-6f1f92455799 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:55.089666 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e894884-3a1e-44a2-9e0f-6f1f92455799 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:55.090101 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e894884-3a1e-44a2-9e0f-6f1f92455799 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:55.289224 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1e894884-3a1e-44a2-9e0f-6f1f92455799 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:55.292466 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-15b9a2a0-a4db-4088-b3b3-b2c812d61546 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:55.297765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1e894884-3a1e-44a2-9e0f-6f1f92455799 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.220054 Jul 21 22:22:55.298567 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 718/1560] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:55 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:55.301476 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-15b9a2a0-a4db-4088-b3b3-b2c812d61546 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.226804 Jul 21 22:22:55.302163 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 843/1561] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:55 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:55.302768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cd45d9c9-b7a9-41bf-881d-e3549d1fc65c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:55.303392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cd45d9c9-b7a9-41bf-881d-e3549d1fc65c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:55.309080 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd45d9c9-b7a9-41bf-881d-e3549d1fc65c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:55.309531 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd45d9c9-b7a9-41bf-881d-e3549d1fc65c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:55.310293 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd45d9c9-b7a9-41bf-881d-e3549d1fc65c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:55.310726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd45d9c9-b7a9-41bf-881d-e3549d1fc65c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:55.375909 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cd45d9c9-b7a9-41bf-881d-e3549d1fc65c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:55.383746 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cd45d9c9-b7a9-41bf-881d-e3549d1fc65c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084491 Jul 21 22:22:55.384311 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 719/1562] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:55 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:56.314603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3e9ff28d-d215-40a7-b34b-01eefeccbc4f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:56.315241 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3e9ff28d-d215-40a7-b34b-01eefeccbc4f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:56.317497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ce352272-f4d8-49a4-9d97-48cfed0c06c7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:56.318112 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ce352272-f4d8-49a4-9d97-48cfed0c06c7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:56.321923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3e9ff28d-d215-40a7-b34b-01eefeccbc4f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:56.322380 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3e9ff28d-d215-40a7-b34b-01eefeccbc4f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:56.323222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3e9ff28d-d215-40a7-b34b-01eefeccbc4f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:56.323668 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3e9ff28d-d215-40a7-b34b-01eefeccbc4f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:56.324458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce352272-f4d8-49a4-9d97-48cfed0c06c7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:56.324919 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce352272-f4d8-49a4-9d97-48cfed0c06c7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:56.325692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce352272-f4d8-49a4-9d97-48cfed0c06c7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:56.326131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce352272-f4d8-49a4-9d97-48cfed0c06c7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:56.328359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:56.517768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ce352272-f4d8-49a4-9d97-48cfed0c06c7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:56.522408 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3e9ff28d-d215-40a7-b34b-01eefeccbc4f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:56.525795 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ce352272-f4d8-49a4-9d97-48cfed0c06c7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.212037 Jul 21 22:22:56.526377 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 720/1563] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:56 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:56.531445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-67b03e58-14ae-4b2b-972f-ef4dee5141d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:56.531585 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3e9ff28d-d215-40a7-b34b-01eefeccbc4f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.219985 Jul 21 22:22:56.532155 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 844/1564] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:56 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:56.532288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-67b03e58-14ae-4b2b-972f-ef4dee5141d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:56.538016 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67b03e58-14ae-4b2b-972f-ef4dee5141d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:56.538467 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67b03e58-14ae-4b2b-972f-ef4dee5141d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:56.539262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67b03e58-14ae-4b2b-972f-ef4dee5141d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:56.539703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67b03e58-14ae-4b2b-972f-ef4dee5141d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:56.605882 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-67b03e58-14ae-4b2b-972f-ef4dee5141d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:56.609357 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:56.614550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-67b03e58-14ae-4b2b-972f-ef4dee5141d8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.087244 Jul 21 22:22:56.615148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 721/1565] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:56 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:57.543502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6e2cb8d7-b58d-4405-a1fa-ae5f4dd7d886 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:57.544136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6e2cb8d7-b58d-4405-a1fa-ae5f4dd7d886 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:57.545978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=76 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:57.548641 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b6a2c8df-cc98-4aa8-b0a2-15101076760d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:57.549260 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b6a2c8df-cc98-4aa8-b0a2-15101076760d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:57.551792 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:22:57.552184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e2cb8d7-b58d-4405-a1fa-ae5f4dd7d886 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:57.552636 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e2cb8d7-b58d-4405-a1fa-ae5f4dd7d886 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:57.553500 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e2cb8d7-b58d-4405-a1fa-ae5f4dd7d886 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:57.554056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e2cb8d7-b58d-4405-a1fa-ae5f4dd7d886 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:57.556993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b6a2c8df-cc98-4aa8-b0a2-15101076760d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:57.557446 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b6a2c8df-cc98-4aa8-b0a2-15101076760d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:57.558225 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b6a2c8df-cc98-4aa8-b0a2-15101076760d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:57.558664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b6a2c8df-cc98-4aa8-b0a2-15101076760d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:57.754544 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6e2cb8d7-b58d-4405-a1fa-ae5f4dd7d886 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:57.757416 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b6a2c8df-cc98-4aa8-b0a2-15101076760d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:57.762766 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6e2cb8d7-b58d-4405-a1fa-ae5f4dd7d886 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.223206 Jul 21 22:22:57.763378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 845/1566] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:57 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:57.765985 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b6a2c8df-cc98-4aa8-b0a2-15101076760d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.221213 Jul 21 22:22:57.766728 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 722/1567] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:57 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:57.768485 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-519b8263-b5fe-41f9-8756-70e8f9b2fecd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:57.769090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-519b8263-b5fe-41f9-8756-70e8f9b2fecd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:57.774994 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-519b8263-b5fe-41f9-8756-70e8f9b2fecd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:57.775482 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-519b8263-b5fe-41f9-8756-70e8f9b2fecd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:57.776259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-519b8263-b5fe-41f9-8756-70e8f9b2fecd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:57.776702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-519b8263-b5fe-41f9-8756-70e8f9b2fecd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:57.837047 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-519b8263-b5fe-41f9-8756-70e8f9b2fecd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:57.845673 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-519b8263-b5fe-41f9-8756-70e8f9b2fecd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081360 Jul 21 22:22:57.846248 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 846/1568] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:57 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:58.779723 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-52db879b-1d17-412e-8895-d31a54f43507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:58.780267 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-52db879b-1d17-412e-8895-d31a54f43507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:58.781576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7ccf8e46-ed4f-4ace-8acf-1afacf748c85 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:58.782186 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7ccf8e46-ed4f-4ace-8acf-1afacf748c85 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:58.786914 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52db879b-1d17-412e-8895-d31a54f43507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:58.787393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52db879b-1d17-412e-8895-d31a54f43507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:58.788157 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52db879b-1d17-412e-8895-d31a54f43507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:58.788590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52db879b-1d17-412e-8895-d31a54f43507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:58.788698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ccf8e46-ed4f-4ace-8acf-1afacf748c85 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:58.789074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ccf8e46-ed4f-4ace-8acf-1afacf748c85 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:58.789843 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ccf8e46-ed4f-4ace-8acf-1afacf748c85 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:58.790283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ccf8e46-ed4f-4ace-8acf-1afacf748c85 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:58.980550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-52db879b-1d17-412e-8895-d31a54f43507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:58.983535 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7ccf8e46-ed4f-4ace-8acf-1afacf748c85 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:58.989288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-52db879b-1d17-412e-8895-d31a54f43507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.213444 Jul 21 22:22:58.989871 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 723/1569] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:58 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:22:58.992126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7ccf8e46-ed4f-4ace-8acf-1afacf748c85 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.214337 Jul 21 22:22:58.993354 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 847/1570] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:58 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:22:58.994314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-214e60e3-ea21-4ecd-9339-8dfb84229d4a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:22:58.994931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-214e60e3-ea21-4ecd-9339-8dfb84229d4a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:22:59.000935 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-214e60e3-ea21-4ecd-9339-8dfb84229d4a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:59.001393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-214e60e3-ea21-4ecd-9339-8dfb84229d4a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:59.002183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-214e60e3-ea21-4ecd-9339-8dfb84229d4a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:22:59.002627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-214e60e3-ea21-4ecd-9339-8dfb84229d4a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:22:59.064010 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-214e60e3-ea21-4ecd-9339-8dfb84229d4a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:22:59.071916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-214e60e3-ea21-4ecd-9339-8dfb84229d4a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081115 Jul 21 22:22:59.072486 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 724/1571] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:22:58 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:00.006782 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e27239f3-d26a-44c2-8642-78e28c5fc6e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:00.007429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e27239f3-d26a-44c2-8642-78e28c5fc6e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:00.009218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-691c781c-9736-4f82-969a-b3459e7c906e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:00.009829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-691c781c-9736-4f82-969a-b3459e7c906e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:00.013974 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e27239f3-d26a-44c2-8642-78e28c5fc6e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:00.014476 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e27239f3-d26a-44c2-8642-78e28c5fc6e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:00.015260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e27239f3-d26a-44c2-8642-78e28c5fc6e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:00.015700 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e27239f3-d26a-44c2-8642-78e28c5fc6e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:00.016219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-691c781c-9736-4f82-969a-b3459e7c906e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:00.016666 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-691c781c-9736-4f82-969a-b3459e7c906e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:00.017432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-691c781c-9736-4f82-969a-b3459e7c906e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:00.017866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-691c781c-9736-4f82-969a-b3459e7c906e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:00.207565 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e27239f3-d26a-44c2-8642-78e28c5fc6e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:00.211520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-691c781c-9736-4f82-969a-b3459e7c906e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:00.215708 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e27239f3-d26a-44c2-8642-78e28c5fc6e9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.212759 Jul 21 22:23:00.216517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 848/1572] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:00 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:00.219502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-691c781c-9736-4f82-969a-b3459e7c906e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.213978 Jul 21 22:23:00.220466 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 725/1573] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:00 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:00.221781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8cc1f790-ac7e-4914-85bd-38da45021702 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:00.222396 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8cc1f790-ac7e-4914-85bd-38da45021702 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:00.228423 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8cc1f790-ac7e-4914-85bd-38da45021702 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:00.228946 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8cc1f790-ac7e-4914-85bd-38da45021702 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:00.230255 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8cc1f790-ac7e-4914-85bd-38da45021702 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:00.230360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8cc1f790-ac7e-4914-85bd-38da45021702 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:00.291258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8cc1f790-ac7e-4914-85bd-38da45021702 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:00.299510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8cc1f790-ac7e-4914-85bd-38da45021702 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081924 Jul 21 22:23:00.300080 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 849/1574] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:00 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:01.233286 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-678fa832-70b9-46e3-be7c-aec1b9f1aedd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:01.233941 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-678fa832-70b9-46e3-be7c-aec1b9f1aedd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:01.236649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8b86f3a3-1fc5-4dea-88dc-00d479ab83c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:01.237265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8b86f3a3-1fc5-4dea-88dc-00d479ab83c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:01.240584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-678fa832-70b9-46e3-be7c-aec1b9f1aedd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:01.241197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-678fa832-70b9-46e3-be7c-aec1b9f1aedd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:01.242058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-678fa832-70b9-46e3-be7c-aec1b9f1aedd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:01.242508 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-678fa832-70b9-46e3-be7c-aec1b9f1aedd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:01.244017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8b86f3a3-1fc5-4dea-88dc-00d479ab83c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:01.244470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8b86f3a3-1fc5-4dea-88dc-00d479ab83c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:01.245259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8b86f3a3-1fc5-4dea-88dc-00d479ab83c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:01.245701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8b86f3a3-1fc5-4dea-88dc-00d479ab83c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:01.446630 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8b86f3a3-1fc5-4dea-88dc-00d479ab83c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:01.453895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-678fa832-70b9-46e3-be7c-aec1b9f1aedd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:01.455378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8b86f3a3-1fc5-4dea-88dc-00d479ab83c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.222850 Jul 21 22:23:01.455960 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 850/1575] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:01 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:01.461876 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-678fa832-70b9-46e3-be7c-aec1b9f1aedd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.232531 Jul 21 22:23:01.462706 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 726/1576] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:01 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:01.466398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3117abf6-be61-4dee-959d-4c701daba038 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:01.467011 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3117abf6-be61-4dee-959d-4c701daba038 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:01.473288 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3117abf6-be61-4dee-959d-4c701daba038 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:01.473737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3117abf6-be61-4dee-959d-4c701daba038 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:01.474506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3117abf6-be61-4dee-959d-4c701daba038 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:01.474947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3117abf6-be61-4dee-959d-4c701daba038 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:01.536952 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3117abf6-be61-4dee-959d-4c701daba038 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:01.544842 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3117abf6-be61-4dee-959d-4c701daba038 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082639 Jul 21 22:23:01.545407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 851/1577] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:01 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:02.472782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0fa123a2-ab66-4b36-bcb5-f2dc0abb93f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:02.473361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0fa123a2-ab66-4b36-bcb5-f2dc0abb93f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:02.478533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-46984853-4510-41de-96ce-f0e82deeb4ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:02.479146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-46984853-4510-41de-96ce-f0e82deeb4ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:02.480082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0fa123a2-ab66-4b36-bcb5-f2dc0abb93f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:02.480539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0fa123a2-ab66-4b36-bcb5-f2dc0abb93f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:02.481525 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0fa123a2-ab66-4b36-bcb5-f2dc0abb93f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:02.481861 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0fa123a2-ab66-4b36-bcb5-f2dc0abb93f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:02.486380 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-46984853-4510-41de-96ce-f0e82deeb4ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:02.486827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-46984853-4510-41de-96ce-f0e82deeb4ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:02.487631 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-46984853-4510-41de-96ce-f0e82deeb4ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:02.488063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-46984853-4510-41de-96ce-f0e82deeb4ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:02.670951 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0fa123a2-ab66-4b36-bcb5-f2dc0abb93f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:02.677908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-46984853-4510-41de-96ce-f0e82deeb4ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:02.678897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0fa123a2-ab66-4b36-bcb5-f2dc0abb93f8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.210881 Jul 21 22:23:02.679495 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 727/1578] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:02 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:02.683938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-149c64a0-a7e2-4552-92fc-b9160020fbe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:02.684540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-149c64a0-a7e2-4552-92fc-b9160020fbe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:02.686148 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-46984853-4510-41de-96ce-f0e82deeb4ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.211503 Jul 21 22:23:02.687531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 852/1579] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:02 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:02.692998 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-149c64a0-a7e2-4552-92fc-b9160020fbe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:02.693527 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-149c64a0-a7e2-4552-92fc-b9160020fbe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:02.694370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-149c64a0-a7e2-4552-92fc-b9160020fbe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:02.694880 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-149c64a0-a7e2-4552-92fc-b9160020fbe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:02.759858 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-149c64a0-a7e2-4552-92fc-b9160020fbe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:02.768180 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-149c64a0-a7e2-4552-92fc-b9160020fbe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.087761 Jul 21 22:23:02.768747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 728/1580] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:02 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:03.697106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-249bad17-c3a7-4671-8a49-20aa402c01f3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:03.697705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-249bad17-c3a7-4671-8a49-20aa402c01f3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:03.703707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-78db1c85-fcd4-46ee-903e-ba4497d61653 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:03.704292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-249bad17-c3a7-4671-8a49-20aa402c01f3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:03.704451 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-78db1c85-fcd4-46ee-903e-ba4497d61653 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:03.704740 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-249bad17-c3a7-4671-8a49-20aa402c01f3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:03.705511 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-249bad17-c3a7-4671-8a49-20aa402c01f3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:03.705944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-249bad17-c3a7-4671-8a49-20aa402c01f3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:03.711354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78db1c85-fcd4-46ee-903e-ba4497d61653 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:03.711809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78db1c85-fcd4-46ee-903e-ba4497d61653 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:03.712582 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78db1c85-fcd4-46ee-903e-ba4497d61653 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:03.713018 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78db1c85-fcd4-46ee-903e-ba4497d61653 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:03.907219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-249bad17-c3a7-4671-8a49-20aa402c01f3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:03.910911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-78db1c85-fcd4-46ee-903e-ba4497d61653 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:03.915089 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-249bad17-c3a7-4671-8a49-20aa402c01f3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.222002 Jul 21 22:23:03.915652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 853/1581] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:03 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:03.919231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-78db1c85-fcd4-46ee-903e-ba4497d61653 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.219411 Jul 21 22:23:03.931029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 729/1582] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:03 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:03.931225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-79bfc74e-5fc9-449a-b918-d89af4163fb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:03.931225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-79bfc74e-5fc9-449a-b918-d89af4163fb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:03.931225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79bfc74e-5fc9-449a-b918-d89af4163fb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:03.931225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79bfc74e-5fc9-449a-b918-d89af4163fb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:03.931613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79bfc74e-5fc9-449a-b918-d89af4163fb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:03.931613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79bfc74e-5fc9-449a-b918-d89af4163fb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:03.989862 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-79bfc74e-5fc9-449a-b918-d89af4163fb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:03.997868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-79bfc74e-5fc9-449a-b918-d89af4163fb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081300 Jul 21 22:23:03.998420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 854/1583] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:03 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:04.933287 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b142545f-3b7b-4f59-af6d-81baac8a44cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:04.933894 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b142545f-3b7b-4f59-af6d-81baac8a44cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:04.940941 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b142545f-3b7b-4f59-af6d-81baac8a44cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:04.941389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b142545f-3b7b-4f59-af6d-81baac8a44cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:04.941823 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-03a6bae1-4081-4407-b5d8-20c808841d9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:04.942237 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b142545f-3b7b-4f59-af6d-81baac8a44cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:04.942432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-03a6bae1-4081-4407-b5d8-20c808841d9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:04.942630 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b142545f-3b7b-4f59-af6d-81baac8a44cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:04.948818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-03a6bae1-4081-4407-b5d8-20c808841d9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:04.949265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-03a6bae1-4081-4407-b5d8-20c808841d9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:04.950028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-03a6bae1-4081-4407-b5d8-20c808841d9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:04.950460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-03a6bae1-4081-4407-b5d8-20c808841d9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:05.132731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b142545f-3b7b-4f59-af6d-81baac8a44cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:05.142062 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b142545f-3b7b-4f59-af6d-81baac8a44cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.212619 Jul 21 22:23:05.142647 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 730/1584] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:04 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:05.147164 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-987b233f-5606-47a0-875c-0fd89a8060fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:05.147775 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-987b233f-5606-47a0-875c-0fd89a8060fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:05.150351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-03a6bae1-4081-4407-b5d8-20c808841d9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:05.153745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-987b233f-5606-47a0-875c-0fd89a8060fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:05.154196 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-987b233f-5606-47a0-875c-0fd89a8060fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:05.154971 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-987b233f-5606-47a0-875c-0fd89a8060fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:05.155443 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-987b233f-5606-47a0-875c-0fd89a8060fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:05.158497 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-03a6bae1-4081-4407-b5d8-20c808841d9f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.220424 Jul 21 22:23:05.159249 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 855/1585] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:04 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:05.215676 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-987b233f-5606-47a0-875c-0fd89a8060fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:05.223715 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-987b233f-5606-47a0-875c-0fd89a8060fe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080123 Jul 21 22:23:05.224281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 731/1586] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:05 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:06.159623 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5a15de87-b4d4-4064-bd41-9adca3b52119 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:06.160257 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5a15de87-b4d4-4064-bd41-9adca3b52119 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:06.166632 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a15de87-b4d4-4064-bd41-9adca3b52119 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:06.167109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a15de87-b4d4-4064-bd41-9adca3b52119 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:06.167864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a15de87-b4d4-4064-bd41-9adca3b52119 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:06.168294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a15de87-b4d4-4064-bd41-9adca3b52119 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:06.175314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8c485ecc-0c57-4031-8dfa-0c6f5ae22adf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:06.175929 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8c485ecc-0c57-4031-8dfa-0c6f5ae22adf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:06.182341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8c485ecc-0c57-4031-8dfa-0c6f5ae22adf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:06.182791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8c485ecc-0c57-4031-8dfa-0c6f5ae22adf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:06.183605 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8c485ecc-0c57-4031-8dfa-0c6f5ae22adf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:06.184044 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8c485ecc-0c57-4031-8dfa-0c6f5ae22adf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:06.365744 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5a15de87-b4d4-4064-bd41-9adca3b52119 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:06.369685 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8c485ecc-0c57-4031-8dfa-0c6f5ae22adf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:06.373876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5a15de87-b4d4-4064-bd41-9adca3b52119 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.218692 Jul 21 22:23:06.374961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 856/1587] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:06 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:06.378392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8c485ecc-0c57-4031-8dfa-0c6f5ae22adf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.206801 Jul 21 22:23:06.379124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 732/1588] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:06 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:06.379717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8fa91b71-25bc-4bf6-b688-b0df07536e04 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:06.380267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8fa91b71-25bc-4bf6-b688-b0df07536e04 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:06.386137 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8fa91b71-25bc-4bf6-b688-b0df07536e04 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:06.386590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8fa91b71-25bc-4bf6-b688-b0df07536e04 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:06.387390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8fa91b71-25bc-4bf6-b688-b0df07536e04 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:06.387828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8fa91b71-25bc-4bf6-b688-b0df07536e04 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:06.448604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8fa91b71-25bc-4bf6-b688-b0df07536e04 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:06.457193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8fa91b71-25bc-4bf6-b688-b0df07536e04 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081264 Jul 21 22:23:06.457755 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 857/1589] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:06 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:07.391598 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ffc67118-642e-4b89-9481-8cf20b62055f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:07.392368 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ffc67118-642e-4b89-9481-8cf20b62055f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:07.395769 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bd7eeca4-3eb1-49d1-a6a9-60e9b3077ead tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:07.396213 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bd7eeca4-3eb1-49d1-a6a9-60e9b3077ead tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:07.398993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ffc67118-642e-4b89-9481-8cf20b62055f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:07.399371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ffc67118-642e-4b89-9481-8cf20b62055f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:07.400144 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ffc67118-642e-4b89-9481-8cf20b62055f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:07.400581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ffc67118-642e-4b89-9481-8cf20b62055f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:07.402500 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd7eeca4-3eb1-49d1-a6a9-60e9b3077ead tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:07.402958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd7eeca4-3eb1-49d1-a6a9-60e9b3077ead tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:07.403766 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd7eeca4-3eb1-49d1-a6a9-60e9b3077ead tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:07.404208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd7eeca4-3eb1-49d1-a6a9-60e9b3077ead tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:07.597217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ffc67118-642e-4b89-9481-8cf20b62055f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:07.601166 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bd7eeca4-3eb1-49d1-a6a9-60e9b3077ead tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:07.605318 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ffc67118-642e-4b89-9481-8cf20b62055f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.217664 Jul 21 22:23:07.605899 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 733/1590] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:07 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:07.609163 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bd7eeca4-3eb1-49d1-a6a9-60e9b3077ead tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.217715 Jul 21 22:23:07.611049 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 858/1591] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:07 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:07.611207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-de9e1c98-01e2-41d8-9896-0c66663a9835 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:07.611207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-de9e1c98-01e2-41d8-9896-0c66663a9835 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:07.616868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de9e1c98-01e2-41d8-9896-0c66663a9835 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:07.617325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de9e1c98-01e2-41d8-9896-0c66663a9835 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:07.618098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de9e1c98-01e2-41d8-9896-0c66663a9835 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:07.618536 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de9e1c98-01e2-41d8-9896-0c66663a9835 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:07.677852 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-de9e1c98-01e2-41d8-9896-0c66663a9835 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:07.685660 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-de9e1c98-01e2-41d8-9896-0c66663a9835 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.078844 Jul 21 22:23:07.686232 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 734/1592] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:07 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:08.622238 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-49feceb1-5062-4f9f-a969-51aff1bb1836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:08.622796 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-49feceb1-5062-4f9f-a969-51aff1bb1836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:08.625610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8eed6060-182c-4ab7-9329-f39653e31e92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:08.626216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8eed6060-182c-4ab7-9329-f39653e31e92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:08.629470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49feceb1-5062-4f9f-a969-51aff1bb1836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:08.629923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49feceb1-5062-4f9f-a969-51aff1bb1836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:08.630694 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49feceb1-5062-4f9f-a969-51aff1bb1836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:08.631170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49feceb1-5062-4f9f-a969-51aff1bb1836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:08.632570 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8eed6060-182c-4ab7-9329-f39653e31e92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:08.633015 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8eed6060-182c-4ab7-9329-f39653e31e92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:08.633773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8eed6060-182c-4ab7-9329-f39653e31e92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:08.634207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8eed6060-182c-4ab7-9329-f39653e31e92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:08.821700 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-49feceb1-5062-4f9f-a969-51aff1bb1836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:08.825582 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8eed6060-182c-4ab7-9329-f39653e31e92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:08.831095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-49feceb1-5062-4f9f-a969-51aff1bb1836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.212694 Jul 21 22:23:08.831616 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 859/1593] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:08 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:08.833807 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8eed6060-182c-4ab7-9329-f39653e31e92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.212151 Jul 21 22:23:08.834370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 735/1594] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:08 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:08.836052 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a1a50d4f-7bd2-4016-b59e-b9f349f167b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:08.836654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a1a50d4f-7bd2-4016-b59e-b9f349f167b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:08.842415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1a50d4f-7bd2-4016-b59e-b9f349f167b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:08.843387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1a50d4f-7bd2-4016-b59e-b9f349f167b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:08.844155 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1a50d4f-7bd2-4016-b59e-b9f349f167b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:08.844593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a1a50d4f-7bd2-4016-b59e-b9f349f167b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:08.904894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a1a50d4f-7bd2-4016-b59e-b9f349f167b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:08.908789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:08.913984 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a1a50d4f-7bd2-4016-b59e-b9f349f167b3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081442 Jul 21 22:23:08.914545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 860/1595] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:08 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:09.847898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8ab8dd71-b1d8-459c-84c9-2caa10708dd5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:09.848443 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8ab8dd71-b1d8-459c-84c9-2caa10708dd5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:09.851475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-05cdca15-fc60-4485-a916-71e632e5d0ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:09.852086 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-05cdca15-fc60-4485-a916-71e632e5d0ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:09.854947 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ab8dd71-b1d8-459c-84c9-2caa10708dd5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:09.855429 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ab8dd71-b1d8-459c-84c9-2caa10708dd5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:09.856191 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ab8dd71-b1d8-459c-84c9-2caa10708dd5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:09.856623 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ab8dd71-b1d8-459c-84c9-2caa10708dd5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:09.859100 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-05cdca15-fc60-4485-a916-71e632e5d0ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:09.859551 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-05cdca15-fc60-4485-a916-71e632e5d0ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:09.860318 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-05cdca15-fc60-4485-a916-71e632e5d0ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:09.860755 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-05cdca15-fc60-4485-a916-71e632e5d0ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:10.044266 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8ab8dd71-b1d8-459c-84c9-2caa10708dd5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:10.051482 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-05cdca15-fc60-4485-a916-71e632e5d0ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:10.052908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8ab8dd71-b1d8-459c-84c9-2caa10708dd5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.209173 Jul 21 22:23:10.053489 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 736/1596] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:09 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:10.057853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b0eede9a-1ac1-4eba-a00f-e24f99ab1bfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:10.058457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b0eede9a-1ac1-4eba-a00f-e24f99ab1bfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:10.060559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-05cdca15-fc60-4485-a916-71e632e5d0ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.212941 Jul 21 22:23:10.061332 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 861/1597] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:09 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:10.067276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0eede9a-1ac1-4eba-a00f-e24f99ab1bfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:10.067724 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0eede9a-1ac1-4eba-a00f-e24f99ab1bfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:10.068492 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0eede9a-1ac1-4eba-a00f-e24f99ab1bfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:10.068926 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0eede9a-1ac1-4eba-a00f-e24f99ab1bfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:10.132983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b0eede9a-1ac1-4eba-a00f-e24f99ab1bfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:10.140838 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b0eede9a-1ac1-4eba-a00f-e24f99ab1bfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.086426 Jul 21 22:23:10.141403 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 737/1598] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:10 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:11.070298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3aededa7-62dc-4420-97a3-54ffbb41795b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:11.070940 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3aededa7-62dc-4420-97a3-54ffbb41795b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:11.077931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0e15db32-a036-4adc-b58c-497ced39b186 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:11.078602 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3aededa7-62dc-4420-97a3-54ffbb41795b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:11.078729 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0e15db32-a036-4adc-b58c-497ced39b186 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:11.079085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3aededa7-62dc-4420-97a3-54ffbb41795b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:11.079864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3aededa7-62dc-4420-97a3-54ffbb41795b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:11.080448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3aededa7-62dc-4420-97a3-54ffbb41795b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:11.085253 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0e15db32-a036-4adc-b58c-497ced39b186 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:11.085713 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0e15db32-a036-4adc-b58c-497ced39b186 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:11.086492 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0e15db32-a036-4adc-b58c-497ced39b186 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:11.086931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0e15db32-a036-4adc-b58c-497ced39b186 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:11.105051 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:11.276901 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3aededa7-62dc-4420-97a3-54ffbb41795b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:11.279757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0e15db32-a036-4adc-b58c-497ced39b186 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:11.285058 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3aededa7-62dc-4420-97a3-54ffbb41795b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.218587 Jul 21 22:23:11.285621 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 862/1599] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:11 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:11.287591 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0e15db32-a036-4adc-b58c-497ced39b186 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.213979 Jul 21 22:23:11.288148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 738/1600] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:11 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:11.290036 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-81aa27e4-a0e7-442a-bfdb-70ea47d5ee11 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:11.290665 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-81aa27e4-a0e7-442a-bfdb-70ea47d5ee11 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:11.298514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81aa27e4-a0e7-442a-bfdb-70ea47d5ee11 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:11.298961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81aa27e4-a0e7-442a-bfdb-70ea47d5ee11 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:11.299755 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81aa27e4-a0e7-442a-bfdb-70ea47d5ee11 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:11.300190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81aa27e4-a0e7-442a-bfdb-70ea47d5ee11 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:11.360391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-81aa27e4-a0e7-442a-bfdb-70ea47d5ee11 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:11.368074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-81aa27e4-a0e7-442a-bfdb-70ea47d5ee11 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081540 Jul 21 22:23:11.368638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 863/1601] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:11 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:12.302595 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b8ca99f0-34e1-40d9-8acd-8430b03739f7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:12.303372 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b8ca99f0-34e1-40d9-8acd-8430b03739f7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:12.306320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-23af8c4d-232d-43f1-a8a1-7bbe803c48a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:12.306940 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-23af8c4d-232d-43f1-a8a1-7bbe803c48a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:12.310313 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8ca99f0-34e1-40d9-8acd-8430b03739f7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:12.310714 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8ca99f0-34e1-40d9-8acd-8430b03739f7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:12.311528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8ca99f0-34e1-40d9-8acd-8430b03739f7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:12.311973 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8ca99f0-34e1-40d9-8acd-8430b03739f7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:12.314468 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23af8c4d-232d-43f1-a8a1-7bbe803c48a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:12.314923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23af8c4d-232d-43f1-a8a1-7bbe803c48a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:12.315874 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23af8c4d-232d-43f1-a8a1-7bbe803c48a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:12.316317 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-23af8c4d-232d-43f1-a8a1-7bbe803c48a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:12.517684 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b8ca99f0-34e1-40d9-8acd-8430b03739f7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:12.524871 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-23af8c4d-232d-43f1-a8a1-7bbe803c48a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:12.534202 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b8ca99f0-34e1-40d9-8acd-8430b03739f7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.236184 Jul 21 22:23:12.534810 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 739/1602] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:12 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:12.536165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-23af8c4d-232d-43f1-a8a1-7bbe803c48a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.233971 Jul 21 22:23:12.536880 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 864/1603] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:12 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:12.539440 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-344d510c-517b-4080-a50e-ae146a6db9a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:12.540058 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-344d510c-517b-4080-a50e-ae146a6db9a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:12.545869 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-344d510c-517b-4080-a50e-ae146a6db9a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:12.546358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-344d510c-517b-4080-a50e-ae146a6db9a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:12.547217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-344d510c-517b-4080-a50e-ae146a6db9a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:12.547664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-344d510c-517b-4080-a50e-ae146a6db9a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:12.608760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-344d510c-517b-4080-a50e-ae146a6db9a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:12.616735 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-344d510c-517b-4080-a50e-ae146a6db9a8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080964 Jul 21 22:23:12.617310 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 740/1604] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:12 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:13.551461 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4b85169d-7db6-4be4-95d4-eb7f33180d08 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:13.552127 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4b85169d-7db6-4be4-95d4-eb7f33180d08 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:13.552964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cd576164-eb4e-4722-8cf4-2c8b620490d4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:13.553598 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cd576164-eb4e-4722-8cf4-2c8b620490d4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:13.558571 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b85169d-7db6-4be4-95d4-eb7f33180d08 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:13.559036 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b85169d-7db6-4be4-95d4-eb7f33180d08 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:13.559816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b85169d-7db6-4be4-95d4-eb7f33180d08 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:13.560030 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd576164-eb4e-4722-8cf4-2c8b620490d4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:13.560275 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b85169d-7db6-4be4-95d4-eb7f33180d08 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:13.560491 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd576164-eb4e-4722-8cf4-2c8b620490d4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:13.561262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd576164-eb4e-4722-8cf4-2c8b620490d4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:13.561706 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd576164-eb4e-4722-8cf4-2c8b620490d4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:13.976221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cd576164-eb4e-4722-8cf4-2c8b620490d4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:13.983673 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4b85169d-7db6-4be4-95d4-eb7f33180d08 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:13.984734 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cd576164-eb4e-4722-8cf4-2c8b620490d4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.435455 Jul 21 22:23:13.985336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 741/1605] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:13 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:13.991919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4b85169d-7db6-4be4-95d4-eb7f33180d08 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.444336 Jul 21 22:23:13.992641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 865/1606] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:13 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:13.992767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-26da7b25-a4ea-4a82-abef-dc91df74cf40 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:13.993480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-26da7b25-a4ea-4a82-abef-dc91df74cf40 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:14.003219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-26da7b25-a4ea-4a82-abef-dc91df74cf40 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:14.003671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-26da7b25-a4ea-4a82-abef-dc91df74cf40 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:14.006264 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-26da7b25-a4ea-4a82-abef-dc91df74cf40 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:14.006703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-26da7b25-a4ea-4a82-abef-dc91df74cf40 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:14.067675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-26da7b25-a4ea-4a82-abef-dc91df74cf40 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:14.075449 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-26da7b25-a4ea-4a82-abef-dc91df74cf40 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.088929 Jul 21 22:23:14.076043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 742/1607] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:13 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:15.001896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9b7a2b8e-12f1-46d2-818e-5408627d10f8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:15.002512 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9b7a2b8e-12f1-46d2-818e-5408627d10f8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:15.009038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b7a2b8e-12f1-46d2-818e-5408627d10f8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:15.009494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b7a2b8e-12f1-46d2-818e-5408627d10f8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:15.010269 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b7a2b8e-12f1-46d2-818e-5408627d10f8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:15.010733 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b7a2b8e-12f1-46d2-818e-5408627d10f8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:15.011435 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cfa848c4-7861-47b9-9fdf-56f5291566da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:15.012078 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cfa848c4-7861-47b9-9fdf-56f5291566da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:15.018961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cfa848c4-7861-47b9-9fdf-56f5291566da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:15.019457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cfa848c4-7861-47b9-9fdf-56f5291566da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:15.020254 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cfa848c4-7861-47b9-9fdf-56f5291566da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:15.020688 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cfa848c4-7861-47b9-9fdf-56f5291566da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:15.201598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9b7a2b8e-12f1-46d2-818e-5408627d10f8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:15.205889 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cfa848c4-7861-47b9-9fdf-56f5291566da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:15.210365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9b7a2b8e-12f1-46d2-818e-5408627d10f8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.212305 Jul 21 22:23:15.210933 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 866/1608] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:14 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:15.213789 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cfa848c4-7861-47b9-9fdf-56f5291566da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.206170 Jul 21 22:23:15.214486 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 743/1609] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:15 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:15.215443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f459f37b-1ed1-4e60-a842-1bf1e01add7c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:15.216051 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f459f37b-1ed1-4e60-a842-1bf1e01add7c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:15.223075 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f459f37b-1ed1-4e60-a842-1bf1e01add7c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:15.223530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f459f37b-1ed1-4e60-a842-1bf1e01add7c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:15.224301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f459f37b-1ed1-4e60-a842-1bf1e01add7c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:15.224737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f459f37b-1ed1-4e60-a842-1bf1e01add7c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:15.285222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f459f37b-1ed1-4e60-a842-1bf1e01add7c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:15.293171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f459f37b-1ed1-4e60-a842-1bf1e01add7c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081285 Jul 21 22:23:15.293730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 867/1610] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:15 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:16.228340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1faacb3d-c1ec-4cce-90af-53acf05eae27 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:16.228981 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1faacb3d-c1ec-4cce-90af-53acf05eae27 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:16.231235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-02422f82-50b6-49e8-bb37-ad245e48bdd8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:16.231857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-02422f82-50b6-49e8-bb37-ad245e48bdd8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:16.235597 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1faacb3d-c1ec-4cce-90af-53acf05eae27 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:16.236052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1faacb3d-c1ec-4cce-90af-53acf05eae27 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:16.236824 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1faacb3d-c1ec-4cce-90af-53acf05eae27 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:16.237298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1faacb3d-c1ec-4cce-90af-53acf05eae27 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:16.238251 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02422f82-50b6-49e8-bb37-ad245e48bdd8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:16.238712 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02422f82-50b6-49e8-bb37-ad245e48bdd8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:16.239712 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02422f82-50b6-49e8-bb37-ad245e48bdd8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:16.239969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02422f82-50b6-49e8-bb37-ad245e48bdd8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:16.428462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1faacb3d-c1ec-4cce-90af-53acf05eae27 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:16.436448 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1faacb3d-c1ec-4cce-90af-53acf05eae27 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.212018 Jul 21 22:23:16.437032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 744/1611] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:16 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:16.442081 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b642efc5-2519-4ec1-b050-b9a430b452dd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:16.442679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b642efc5-2519-4ec1-b050-b9a430b452dd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:16.446487 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-02422f82-50b6-49e8-bb37-ad245e48bdd8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:16.448475 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b642efc5-2519-4ec1-b050-b9a430b452dd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:16.448933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b642efc5-2519-4ec1-b050-b9a430b452dd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:16.449698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b642efc5-2519-4ec1-b050-b9a430b452dd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:16.450134 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b642efc5-2519-4ec1-b050-b9a430b452dd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:16.454760 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-02422f82-50b6-49e8-bb37-ad245e48bdd8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.227408 Jul 21 22:23:16.455371 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 868/1612] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:16 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:16.511193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b642efc5-2519-4ec1-b050-b9a430b452dd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:16.519160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b642efc5-2519-4ec1-b050-b9a430b452dd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081151 Jul 21 22:23:16.519728 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 745/1613] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:16 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:17.455283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5c7b5a6a-561b-43f4-a133-07107ba905bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:17.455664 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5c7b5a6a-561b-43f4-a133-07107ba905bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:17.461786 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5c7b5a6a-561b-43f4-a133-07107ba905bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:17.462247 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5c7b5a6a-561b-43f4-a133-07107ba905bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:17.463051 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5c7b5a6a-561b-43f4-a133-07107ba905bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:17.463498 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5c7b5a6a-561b-43f4-a133-07107ba905bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:17.472578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-efeb5c18-8500-467c-bcdc-4df7d090b43b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:17.473189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-efeb5c18-8500-467c-bcdc-4df7d090b43b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:17.479796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efeb5c18-8500-467c-bcdc-4df7d090b43b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:17.480214 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efeb5c18-8500-467c-bcdc-4df7d090b43b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:17.480984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efeb5c18-8500-467c-bcdc-4df7d090b43b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:17.481418 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efeb5c18-8500-467c-bcdc-4df7d090b43b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:17.660064 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5c7b5a6a-561b-43f4-a133-07107ba905bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:17.666622 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-efeb5c18-8500-467c-bcdc-4df7d090b43b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:17.668062 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5c7b5a6a-561b-43f4-a133-07107ba905bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.217829 Jul 21 22:23:17.668642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 869/1614] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:17 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:17.673167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6408bf39-d27b-4d36-8357-033787a668f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:17.673780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6408bf39-d27b-4d36-8357-033787a668f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:17.678914 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-efeb5c18-8500-467c-bcdc-4df7d090b43b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.210960 Jul 21 22:23:17.679567 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 746/1615] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:17 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:17.679705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6408bf39-d27b-4d36-8357-033787a668f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:17.680146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6408bf39-d27b-4d36-8357-033787a668f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:17.680935 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6408bf39-d27b-4d36-8357-033787a668f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:17.681376 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6408bf39-d27b-4d36-8357-033787a668f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:17.746679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6408bf39-d27b-4d36-8357-033787a668f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:17.755145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6408bf39-d27b-4d36-8357-033787a668f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085538 Jul 21 22:23:17.755708 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 870/1616] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:17 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:18.685224 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f4bc8b93-2cb0-421d-8d4f-4abebe24888c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:18.685880 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f4bc8b93-2cb0-421d-8d4f-4abebe24888c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:18.693304 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f4bc8b93-2cb0-421d-8d4f-4abebe24888c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:18.693750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f4bc8b93-2cb0-421d-8d4f-4abebe24888c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:18.694519 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f4bc8b93-2cb0-421d-8d4f-4abebe24888c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:18.694951 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f4bc8b93-2cb0-421d-8d4f-4abebe24888c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:18.696193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0b808077-51f6-4f74-83a5-c01654563da5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:18.696811 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0b808077-51f6-4f74-83a5-c01654563da5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:18.703285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b808077-51f6-4f74-83a5-c01654563da5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:18.703741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b808077-51f6-4f74-83a5-c01654563da5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:18.704514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b808077-51f6-4f74-83a5-c01654563da5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:18.704950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0b808077-51f6-4f74-83a5-c01654563da5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:18.883574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f4bc8b93-2cb0-421d-8d4f-4abebe24888c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:18.886602 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0b808077-51f6-4f74-83a5-c01654563da5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:18.891889 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f4bc8b93-2cb0-421d-8d4f-4abebe24888c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.210492 Jul 21 22:23:18.895953 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 747/1617] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:18 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:18.896121 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0b808077-51f6-4f74-83a5-c01654563da5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.202117 Jul 21 22:23:18.896121 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 871/1618] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:18 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:18.897036 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4cd82b17-3874-44df-982d-03865fef5af0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:18.897853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4cd82b17-3874-44df-982d-03865fef5af0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:18.903691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4cd82b17-3874-44df-982d-03865fef5af0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:18.904143 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4cd82b17-3874-44df-982d-03865fef5af0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:18.904944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4cd82b17-3874-44df-982d-03865fef5af0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:18.905385 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4cd82b17-3874-44df-982d-03865fef5af0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:18.969961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4cd82b17-3874-44df-982d-03865fef5af0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:18.977916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4cd82b17-3874-44df-982d-03865fef5af0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084434 Jul 21 22:23:18.978484 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 748/1619] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:18 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:19.909381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-69f48b52-0dfd-48ea-a2ac-70dad6738c12 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:19.909989 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-69f48b52-0dfd-48ea-a2ac-70dad6738c12 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:19.911877 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2158e8a4-c95a-4eec-aae7-a443f6a28994 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:19.912483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2158e8a4-c95a-4eec-aae7-a443f6a28994 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:19.916555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69f48b52-0dfd-48ea-a2ac-70dad6738c12 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:19.917026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69f48b52-0dfd-48ea-a2ac-70dad6738c12 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:19.917798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69f48b52-0dfd-48ea-a2ac-70dad6738c12 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:19.918229 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-69f48b52-0dfd-48ea-a2ac-70dad6738c12 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:19.918771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2158e8a4-c95a-4eec-aae7-a443f6a28994 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:19.919259 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2158e8a4-c95a-4eec-aae7-a443f6a28994 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:19.920024 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2158e8a4-c95a-4eec-aae7-a443f6a28994 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:19.920458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2158e8a4-c95a-4eec-aae7-a443f6a28994 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:20.112808 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-69f48b52-0dfd-48ea-a2ac-70dad6738c12 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:20.115967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2158e8a4-c95a-4eec-aae7-a443f6a28994 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:20.120904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-69f48b52-0dfd-48ea-a2ac-70dad6738c12 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.216243 Jul 21 22:23:20.121477 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 872/1620] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:19 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:20.124341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2158e8a4-c95a-4eec-aae7-a443f6a28994 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.216239 Jul 21 22:23:20.125039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 749/1621] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:19 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:20.125882 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5d31674c-df47-4a0d-8285-0a14b117a6f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:20.126488 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5d31674c-df47-4a0d-8285-0a14b117a6f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:20.132263 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d31674c-df47-4a0d-8285-0a14b117a6f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:20.132715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d31674c-df47-4a0d-8285-0a14b117a6f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:20.133486 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d31674c-df47-4a0d-8285-0a14b117a6f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:20.133923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d31674c-df47-4a0d-8285-0a14b117a6f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:20.195246 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5d31674c-df47-4a0d-8285-0a14b117a6f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:20.202993 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5d31674c-df47-4a0d-8285-0a14b117a6f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080590 Jul 21 22:23:20.204120 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 873/1622] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:20 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:21.138315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d7729035-c7c7-4164-b5af-b3c37be06e11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:21.138921 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d7729035-c7c7-4164-b5af-b3c37be06e11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:21.140860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2c874ee8-04ce-416d-a7d5-69c7b552ee4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:21.141468 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2c874ee8-04ce-416d-a7d5-69c7b552ee4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:21.145681 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d7729035-c7c7-4164-b5af-b3c37be06e11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:21.146133 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d7729035-c7c7-4164-b5af-b3c37be06e11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:21.146908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d7729035-c7c7-4164-b5af-b3c37be06e11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:21.147375 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d7729035-c7c7-4164-b5af-b3c37be06e11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:21.147944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2c874ee8-04ce-416d-a7d5-69c7b552ee4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:21.148388 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2c874ee8-04ce-416d-a7d5-69c7b552ee4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:21.149146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2c874ee8-04ce-416d-a7d5-69c7b552ee4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:21.149581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2c874ee8-04ce-416d-a7d5-69c7b552ee4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:21.339546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d7729035-c7c7-4164-b5af-b3c37be06e11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:21.342531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2c874ee8-04ce-416d-a7d5-69c7b552ee4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:21.348634 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d7729035-c7c7-4164-b5af-b3c37be06e11 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.214042 Jul 21 22:23:21.349239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 750/1623] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:21 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:21.353654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2c874ee8-04ce-416d-a7d5-69c7b552ee4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.216314 Jul 21 22:23:21.353848 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7fa60577-6cd4-4b58-9581-5647b58d5fe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:21.354563 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 874/1624] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:21 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:21.354702 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7fa60577-6cd4-4b58-9581-5647b58d5fe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:21.361219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7fa60577-6cd4-4b58-9581-5647b58d5fe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:21.361673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7fa60577-6cd4-4b58-9581-5647b58d5fe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:21.362455 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7fa60577-6cd4-4b58-9581-5647b58d5fe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:21.362895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7fa60577-6cd4-4b58-9581-5647b58d5fe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:21.424338 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7fa60577-6cd4-4b58-9581-5647b58d5fe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:21.432306 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7fa60577-6cd4-4b58-9581-5647b58d5fe4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082128 Jul 21 22:23:21.432875 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 751/1625] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:21 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:22.366400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-970cc35b-8e9f-4d8a-84fc-fd2e472e341f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:22.367041 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-970cc35b-8e9f-4d8a-84fc-fd2e472e341f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:22.371239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8a4831aa-5c5e-46ae-8580-3b498c33fd67 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:22.371847 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8a4831aa-5c5e-46ae-8580-3b498c33fd67 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:22.373607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-970cc35b-8e9f-4d8a-84fc-fd2e472e341f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:22.374060 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-970cc35b-8e9f-4d8a-84fc-fd2e472e341f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:22.375336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-970cc35b-8e9f-4d8a-84fc-fd2e472e341f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:22.375785 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-970cc35b-8e9f-4d8a-84fc-fd2e472e341f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:22.378657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a4831aa-5c5e-46ae-8580-3b498c33fd67 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:22.379144 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a4831aa-5c5e-46ae-8580-3b498c33fd67 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:22.379912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a4831aa-5c5e-46ae-8580-3b498c33fd67 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:22.380346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a4831aa-5c5e-46ae-8580-3b498c33fd67 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:22.569419 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-970cc35b-8e9f-4d8a-84fc-fd2e472e341f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:22.572362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8a4831aa-5c5e-46ae-8580-3b498c33fd67 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:22.577581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-970cc35b-8e9f-4d8a-84fc-fd2e472e341f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.215109 Jul 21 22:23:22.578161 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 875/1626] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:22 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:22.580299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8a4831aa-5c5e-46ae-8580-3b498c33fd67 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.212893 Jul 21 22:23:22.580994 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 752/1627] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:22 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:22.582524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ed423840-c42a-4be3-9cbc-a10e88145e47 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:22.583157 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ed423840-c42a-4be3-9cbc-a10e88145e47 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:22.588926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ed423840-c42a-4be3-9cbc-a10e88145e47 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:22.589383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ed423840-c42a-4be3-9cbc-a10e88145e47 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:22.590181 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ed423840-c42a-4be3-9cbc-a10e88145e47 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:22.590619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ed423840-c42a-4be3-9cbc-a10e88145e47 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:22.650877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ed423840-c42a-4be3-9cbc-a10e88145e47 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:22.658836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ed423840-c42a-4be3-9cbc-a10e88145e47 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079753 Jul 21 22:23:22.659430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 876/1628] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:22 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:23.593683 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6ea8afec-3ee0-460e-8e86-46a300be6e22 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:23.594319 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6ea8afec-3ee0-460e-8e86-46a300be6e22 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:23.596575 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-90b4e555-bfbd-4aee-845a-d19f7809997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:23.597193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-90b4e555-bfbd-4aee-845a-d19f7809997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:23.601129 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6ea8afec-3ee0-460e-8e86-46a300be6e22 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:23.601579 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6ea8afec-3ee0-460e-8e86-46a300be6e22 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:23.602345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6ea8afec-3ee0-460e-8e86-46a300be6e22 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:23.602781 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6ea8afec-3ee0-460e-8e86-46a300be6e22 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:23.603602 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-90b4e555-bfbd-4aee-845a-d19f7809997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:23.604057 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-90b4e555-bfbd-4aee-845a-d19f7809997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:23.604825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-90b4e555-bfbd-4aee-845a-d19f7809997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:23.605261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-90b4e555-bfbd-4aee-845a-d19f7809997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:23.622900 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:23.793705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6ea8afec-3ee0-460e-8e86-46a300be6e22 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:23.801915 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6ea8afec-3ee0-460e-8e86-46a300be6e22 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.212100 Jul 21 22:23:23.802437 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 753/1629] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:23 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:23.804475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-90b4e555-bfbd-4aee-845a-d19f7809997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:23.807218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-23b513b0-1e2d-408b-8db7-7caaaf952c37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:23.807830 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-23b513b0-1e2d-408b-8db7-7caaaf952c37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:23.812986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-90b4e555-bfbd-4aee-845a-d19f7809997b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.220042 Jul 21 22:23:23.813554 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 877/1630] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:23 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:23.814399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-23b513b0-1e2d-408b-8db7-7caaaf952c37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:23.814854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-23b513b0-1e2d-408b-8db7-7caaaf952c37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:23.815652 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-23b513b0-1e2d-408b-8db7-7caaaf952c37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:23.816091 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-23b513b0-1e2d-408b-8db7-7caaaf952c37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:23.880010 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-23b513b0-1e2d-408b-8db7-7caaaf952c37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:23.887982 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-23b513b0-1e2d-408b-8db7-7caaaf952c37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084628 Jul 21 22:23:23.888548 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 754/1631] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:23 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:24.818637 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e00a1870-5094-49c7-8898-08b8ee790d6b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:24.819179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e00a1870-5094-49c7-8898-08b8ee790d6b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:24.825755 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e00a1870-5094-49c7-8898-08b8ee790d6b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:24.826245 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e00a1870-5094-49c7-8898-08b8ee790d6b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:24.827074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e00a1870-5094-49c7-8898-08b8ee790d6b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:24.827509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e00a1870-5094-49c7-8898-08b8ee790d6b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:24.829972 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-68525daf-b527-473c-9865-f05e05569c4b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:24.830590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-68525daf-b527-473c-9865-f05e05569c4b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:24.837036 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68525daf-b527-473c-9865-f05e05569c4b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:24.837494 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68525daf-b527-473c-9865-f05e05569c4b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:24.838261 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68525daf-b527-473c-9865-f05e05569c4b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:24.838706 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-68525daf-b527-473c-9865-f05e05569c4b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:24.842988 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:25.026197 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e00a1870-5094-49c7-8898-08b8ee790d6b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:25.030147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-68525daf-b527-473c-9865-f05e05569c4b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:25.034720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e00a1870-5094-49c7-8898-08b8ee790d6b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.220023 Jul 21 22:23:25.035318 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 878/1632] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:24 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:25.038785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-68525daf-b527-473c-9865-f05e05569c4b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.213099 Jul 21 22:23:25.039637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 755/1633] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:24 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:25.039782 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-da082a0e-1397-4877-b1dd-791ec7785908 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:25.040324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-da082a0e-1397-4877-b1dd-791ec7785908 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:25.046048 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-da082a0e-1397-4877-b1dd-791ec7785908 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:25.046497 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-da082a0e-1397-4877-b1dd-791ec7785908 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:25.047296 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-da082a0e-1397-4877-b1dd-791ec7785908 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:25.047753 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-da082a0e-1397-4877-b1dd-791ec7785908 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:25.108260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-da082a0e-1397-4877-b1dd-791ec7785908 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:25.116060 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-da082a0e-1397-4877-b1dd-791ec7785908 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079825 Jul 21 22:23:25.116621 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 879/1634] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:25 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:26.055398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-585b7bce-1488-4882-8648-84d6ac83d9a4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:26.056154 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e364ccdf-6649-48f6-8e1d-77e2b5ca2292 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:26.056540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-585b7bce-1488-4882-8648-84d6ac83d9a4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:26.056648 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e364ccdf-6649-48f6-8e1d-77e2b5ca2292 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:26.062652 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e364ccdf-6649-48f6-8e1d-77e2b5ca2292 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:26.063131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e364ccdf-6649-48f6-8e1d-77e2b5ca2292 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:26.063243 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-585b7bce-1488-4882-8648-84d6ac83d9a4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:26.063922 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e364ccdf-6649-48f6-8e1d-77e2b5ca2292 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:26.064363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e364ccdf-6649-48f6-8e1d-77e2b5ca2292 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:26.066133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-585b7bce-1488-4882-8648-84d6ac83d9a4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:26.066978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-585b7bce-1488-4882-8648-84d6ac83d9a4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:26.067452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-585b7bce-1488-4882-8648-84d6ac83d9a4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:26.255728 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e364ccdf-6649-48f6-8e1d-77e2b5ca2292 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:26.263214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-585b7bce-1488-4882-8648-84d6ac83d9a4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:26.264160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e364ccdf-6649-48f6-8e1d-77e2b5ca2292 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.212533 Jul 21 22:23:26.264882 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 756/1635] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:26 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:26.272311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-585b7bce-1488-4882-8648-84d6ac83d9a4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.220677 Jul 21 22:23:26.273552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 880/1636] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:26 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:26.277078 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0eb25bb6-8817-445e-b37d-4c50b456182f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:26.277689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0eb25bb6-8817-445e-b37d-4c50b456182f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:26.284467 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0eb25bb6-8817-445e-b37d-4c50b456182f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:26.284916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0eb25bb6-8817-445e-b37d-4c50b456182f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:26.285675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0eb25bb6-8817-445e-b37d-4c50b456182f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:26.286103 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0eb25bb6-8817-445e-b37d-4c50b456182f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:26.350557 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0eb25bb6-8817-445e-b37d-4c50b456182f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:26.358733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0eb25bb6-8817-445e-b37d-4c50b456182f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085611 Jul 21 22:23:26.359394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 757/1637] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:26 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:27.282592 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-63d0ee69-c881-496b-9a99-762af704f45a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:27.283231 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-63d0ee69-c881-496b-9a99-762af704f45a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:27.289272 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-63d0ee69-c881-496b-9a99-762af704f45a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:27.289659 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-92c5d73f-1958-459c-83b5-e7fcb4687786 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:27.290076 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-63d0ee69-c881-496b-9a99-762af704f45a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:27.290271 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-92c5d73f-1958-459c-83b5-e7fcb4687786 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:27.290469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-63d0ee69-c881-496b-9a99-762af704f45a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:27.290888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-63d0ee69-c881-496b-9a99-762af704f45a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:27.296399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-92c5d73f-1958-459c-83b5-e7fcb4687786 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:27.296848 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-92c5d73f-1958-459c-83b5-e7fcb4687786 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:27.298403 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-92c5d73f-1958-459c-83b5-e7fcb4687786 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:27.298836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-92c5d73f-1958-459c-83b5-e7fcb4687786 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:27.489674 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-63d0ee69-c881-496b-9a99-762af704f45a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:27.493216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-92c5d73f-1958-459c-83b5-e7fcb4687786 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:27.497899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-63d0ee69-c881-496b-9a99-762af704f45a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.219773 Jul 21 22:23:27.498520 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 881/1638] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:27 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:27.501384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-92c5d73f-1958-459c-83b5-e7fcb4687786 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.215649 Jul 21 22:23:27.502051 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 758/1639] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:27 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:27.503598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-85f2c697-e0f3-4c62-a55b-edfb0aa6760b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:27.504290 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-85f2c697-e0f3-4c62-a55b-edfb0aa6760b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:27.510109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-85f2c697-e0f3-4c62-a55b-edfb0aa6760b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:27.510561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-85f2c697-e0f3-4c62-a55b-edfb0aa6760b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:27.511347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-85f2c697-e0f3-4c62-a55b-edfb0aa6760b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:27.511780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-85f2c697-e0f3-4c62-a55b-edfb0aa6760b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:27.573134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-85f2c697-e0f3-4c62-a55b-edfb0aa6760b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:27.580999 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-85f2c697-e0f3-4c62-a55b-edfb0aa6760b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081600 Jul 21 22:23:27.581569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 882/1640] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:27 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:28.514962 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e53f5fe4-a6c8-47dc-97da-927276067e45 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:28.515598 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e53f5fe4-a6c8-47dc-97da-927276067e45 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:28.517786 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4c406996-7aaa-4bd9-8adb-67938134223b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:28.518216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=74 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:28.518482 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4c406996-7aaa-4bd9-8adb-67938134223b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:28.520743 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=76 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:28.522926 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e53f5fe4-a6c8-47dc-97da-927276067e45 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:28.523411 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e53f5fe4-a6c8-47dc-97da-927276067e45 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:28.524185 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e53f5fe4-a6c8-47dc-97da-927276067e45 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:28.524622 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e53f5fe4-a6c8-47dc-97da-927276067e45 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:28.526215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c406996-7aaa-4bd9-8adb-67938134223b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:28.526674 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c406996-7aaa-4bd9-8adb-67938134223b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:28.527487 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c406996-7aaa-4bd9-8adb-67938134223b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:28.527931 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4c406996-7aaa-4bd9-8adb-67938134223b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:28.718273 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e53f5fe4-a6c8-47dc-97da-927276067e45 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:28.725226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4c406996-7aaa-4bd9-8adb-67938134223b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:28.726467 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e53f5fe4-a6c8-47dc-97da-927276067e45 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.215401 Jul 21 22:23:28.727159 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 759/1641] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:28 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:28.731460 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5473accb-9319-4519-8997-68d0a4f80f35 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:28.732065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5473accb-9319-4519-8997-68d0a4f80f35 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:28.733367 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4c406996-7aaa-4bd9-8adb-67938134223b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.219542 Jul 21 22:23:28.743279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 883/1642] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:28 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:28.743447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5473accb-9319-4519-8997-68d0a4f80f35 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:28.743447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5473accb-9319-4519-8997-68d0a4f80f35 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:28.743447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5473accb-9319-4519-8997-68d0a4f80f35 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:28.743447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5473accb-9319-4519-8997-68d0a4f80f35 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:28.801459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5473accb-9319-4519-8997-68d0a4f80f35 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:28.809373 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5473accb-9319-4519-8997-68d0a4f80f35 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081385 Jul 21 22:23:28.809952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 760/1643] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:28 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:29.744377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-17a3292f-b715-4d59-bd8f-f2eddef47d21 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:29.744911 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-17a3292f-b715-4d59-bd8f-f2eddef47d21 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:29.751073 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-09cc7849-e4ba-4eb6-ad5e-fffad7391f50 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:29.751692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-09cc7849-e4ba-4eb6-ad5e-fffad7391f50 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:29.751992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-17a3292f-b715-4d59-bd8f-f2eddef47d21 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:29.752444 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-17a3292f-b715-4d59-bd8f-f2eddef47d21 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:29.753224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-17a3292f-b715-4d59-bd8f-f2eddef47d21 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:29.753658 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-17a3292f-b715-4d59-bd8f-f2eddef47d21 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:29.758088 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09cc7849-e4ba-4eb6-ad5e-fffad7391f50 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:29.758544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09cc7849-e4ba-4eb6-ad5e-fffad7391f50 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:29.759345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09cc7849-e4ba-4eb6-ad5e-fffad7391f50 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:29.759785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09cc7849-e4ba-4eb6-ad5e-fffad7391f50 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:29.949757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-09cc7849-e4ba-4eb6-ad5e-fffad7391f50 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:29.952766 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-17a3292f-b715-4d59-bd8f-f2eddef47d21 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:29.957791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-09cc7849-e4ba-4eb6-ad5e-fffad7391f50 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.210951 Jul 21 22:23:29.958374 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 761/1644] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:29 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:29.960946 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-17a3292f-b715-4d59-bd8f-f2eddef47d21 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.220532 Jul 21 22:23:29.961657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 884/1645] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:29 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:29.962733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-34516cd3-2280-4ed2-a7d5-ec5a260d95bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:29.963359 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-34516cd3-2280-4ed2-a7d5-ec5a260d95bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:29.969093 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34516cd3-2280-4ed2-a7d5-ec5a260d95bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:29.969543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34516cd3-2280-4ed2-a7d5-ec5a260d95bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:29.970564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34516cd3-2280-4ed2-a7d5-ec5a260d95bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:29.971024 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34516cd3-2280-4ed2-a7d5-ec5a260d95bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:30.032103 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-34516cd3-2280-4ed2-a7d5-ec5a260d95bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:30.039949 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-34516cd3-2280-4ed2-a7d5-ec5a260d95bf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080655 Jul 21 22:23:30.040521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 762/1646] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:29 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:30.975053 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b42d02d5-472d-44b8-9cdb-c1eefa7a8291 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:30.975643 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b42d02d5-472d-44b8-9cdb-c1eefa7a8291 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:30.977296 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ec1bf1e5-966a-4f4e-8ab3-153feab9a470 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:30.977911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ec1bf1e5-966a-4f4e-8ab3-153feab9a470 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:30.982091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b42d02d5-472d-44b8-9cdb-c1eefa7a8291 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:30.982547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b42d02d5-472d-44b8-9cdb-c1eefa7a8291 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:30.983335 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b42d02d5-472d-44b8-9cdb-c1eefa7a8291 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:30.983763 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b42d02d5-472d-44b8-9cdb-c1eefa7a8291 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:30.984349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec1bf1e5-966a-4f4e-8ab3-153feab9a470 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:30.985306 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec1bf1e5-966a-4f4e-8ab3-153feab9a470 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:30.986076 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec1bf1e5-966a-4f4e-8ab3-153feab9a470 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:30.986516 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec1bf1e5-966a-4f4e-8ab3-153feab9a470 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:31.178355 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b42d02d5-472d-44b8-9cdb-c1eefa7a8291 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:31.182307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ec1bf1e5-966a-4f4e-8ab3-153feab9a470 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:31.186791 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b42d02d5-472d-44b8-9cdb-c1eefa7a8291 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.215654 Jul 21 22:23:31.187472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 885/1647] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:30 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:31.190413 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ec1bf1e5-966a-4f4e-8ab3-153feab9a470 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.216882 Jul 21 22:23:31.191227 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 763/1648] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:30 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:31.192063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5b4c18c2-c893-491f-9bf1-6f3e783c89b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:31.192663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5b4c18c2-c893-491f-9bf1-6f3e783c89b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:31.198338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b4c18c2-c893-491f-9bf1-6f3e783c89b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:31.198792 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b4c18c2-c893-491f-9bf1-6f3e783c89b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:31.199623 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b4c18c2-c893-491f-9bf1-6f3e783c89b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:31.200064 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b4c18c2-c893-491f-9bf1-6f3e783c89b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:31.264070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5b4c18c2-c893-491f-9bf1-6f3e783c89b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:31.271844 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5b4c18c2-c893-491f-9bf1-6f3e783c89b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083254 Jul 21 22:23:31.272412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 886/1649] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:31 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:32.203883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-613e1703-fc91-4398-9c02-65dcf9ba7755 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:32.204546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-613e1703-fc91-4398-9c02-65dcf9ba7755 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:32.207269 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dc249df0-f244-48fe-8334-e8c3b2068aff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:32.207880 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dc249df0-f244-48fe-8334-e8c3b2068aff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:32.211299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-613e1703-fc91-4398-9c02-65dcf9ba7755 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:32.211748 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-613e1703-fc91-4398-9c02-65dcf9ba7755 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:32.212514 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-613e1703-fc91-4398-9c02-65dcf9ba7755 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:32.212965 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-613e1703-fc91-4398-9c02-65dcf9ba7755 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:32.214297 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc249df0-f244-48fe-8334-e8c3b2068aff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:32.214752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc249df0-f244-48fe-8334-e8c3b2068aff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:32.215556 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc249df0-f244-48fe-8334-e8c3b2068aff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:32.215995 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dc249df0-f244-48fe-8334-e8c3b2068aff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:32.401953 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-613e1703-fc91-4398-9c02-65dcf9ba7755 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:32.408618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dc249df0-f244-48fe-8334-e8c3b2068aff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:32.410210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-613e1703-fc91-4398-9c02-65dcf9ba7755 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.210058 Jul 21 22:23:32.410803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 764/1650] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:32 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:32.415525 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c397e713-69af-4465-96f0-59af9b7d23ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:32.416137 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c397e713-69af-4465-96f0-59af9b7d23ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:32.417388 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dc249df0-f244-48fe-8334-e8c3b2068aff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.214030 Jul 21 22:23:32.418044 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 887/1651] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:32 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:32.421937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c397e713-69af-4465-96f0-59af9b7d23ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:32.422885 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c397e713-69af-4465-96f0-59af9b7d23ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:32.423689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c397e713-69af-4465-96f0-59af9b7d23ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:32.424131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c397e713-69af-4465-96f0-59af9b7d23ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:32.491263 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c397e713-69af-4465-96f0-59af9b7d23ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:32.499357 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c397e713-69af-4465-96f0-59af9b7d23ce tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.087316 Jul 21 22:23:32.499851 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 765/1652] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:32 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:33.426625 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6d7c204c-a1ff-4e31-bb88-16d1ba92108d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:33.427266 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6d7c204c-a1ff-4e31-bb88-16d1ba92108d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:33.433985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6d7c204c-a1ff-4e31-bb88-16d1ba92108d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:33.434441 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6d7c204c-a1ff-4e31-bb88-16d1ba92108d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:33.434803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-54e247bb-bb27-4be1-b67d-febd0802a8e8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:33.435326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6d7c204c-a1ff-4e31-bb88-16d1ba92108d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:33.435446 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-54e247bb-bb27-4be1-b67d-febd0802a8e8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:33.435681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6d7c204c-a1ff-4e31-bb88-16d1ba92108d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:33.442471 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-54e247bb-bb27-4be1-b67d-febd0802a8e8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:33.442921 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-54e247bb-bb27-4be1-b67d-febd0802a8e8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:33.443730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-54e247bb-bb27-4be1-b67d-febd0802a8e8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:33.444173 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-54e247bb-bb27-4be1-b67d-febd0802a8e8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:33.631602 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6d7c204c-a1ff-4e31-bb88-16d1ba92108d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:33.634578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-54e247bb-bb27-4be1-b67d-febd0802a8e8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:33.639601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6d7c204c-a1ff-4e31-bb88-16d1ba92108d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.216823 Jul 21 22:23:33.640178 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 888/1653] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:33 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:33.643365 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-54e247bb-bb27-4be1-b67d-febd0802a8e8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.212278 Jul 21 22:23:33.643943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 766/1654] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:33 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:33.645487 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-673bca3f-6801-4967-b0d8-a937d3a141db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:33.646095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-673bca3f-6801-4967-b0d8-a937d3a141db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:33.652150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-673bca3f-6801-4967-b0d8-a937d3a141db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:33.652600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-673bca3f-6801-4967-b0d8-a937d3a141db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:33.653367 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-673bca3f-6801-4967-b0d8-a937d3a141db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:33.653801 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-673bca3f-6801-4967-b0d8-a937d3a141db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:33.714285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-673bca3f-6801-4967-b0d8-a937d3a141db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:33.722375 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-673bca3f-6801-4967-b0d8-a937d3a141db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081262 Jul 21 22:23:33.722932 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 889/1655] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:33 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:34.657888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d9f33819-f4db-4d6b-bbc2-ded0f4466159 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:34.658503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d9f33819-f4db-4d6b-bbc2-ded0f4466159 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:34.660492 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6599d2bb-a788-4b70-8c35-e77d88d4197b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:34.661106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6599d2bb-a788-4b70-8c35-e77d88d4197b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:34.665147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9f33819-f4db-4d6b-bbc2-ded0f4466159 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:34.665606 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9f33819-f4db-4d6b-bbc2-ded0f4466159 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:34.666383 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9f33819-f4db-4d6b-bbc2-ded0f4466159 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:34.666823 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9f33819-f4db-4d6b-bbc2-ded0f4466159 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:34.667819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6599d2bb-a788-4b70-8c35-e77d88d4197b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:34.668275 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6599d2bb-a788-4b70-8c35-e77d88d4197b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:34.669054 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6599d2bb-a788-4b70-8c35-e77d88d4197b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:34.669494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6599d2bb-a788-4b70-8c35-e77d88d4197b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:34.857727 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d9f33819-f4db-4d6b-bbc2-ded0f4466159 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:34.862366 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6599d2bb-a788-4b70-8c35-e77d88d4197b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:34.866371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d9f33819-f4db-4d6b-bbc2-ded0f4466159 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.212965 Jul 21 22:23:34.866958 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 767/1656] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:34 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:34.870447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6599d2bb-a788-4b70-8c35-e77d88d4197b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.214372 Jul 21 22:23:34.871465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 890/1657] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:34 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:34.871585 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a476fc29-a779-4f57-aaff-52c589072d88 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:34.872222 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a476fc29-a779-4f57-aaff-52c589072d88 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:34.878327 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a476fc29-a779-4f57-aaff-52c589072d88 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:34.878781 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a476fc29-a779-4f57-aaff-52c589072d88 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:34.879580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a476fc29-a779-4f57-aaff-52c589072d88 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:34.880020 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a476fc29-a779-4f57-aaff-52c589072d88 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:34.940347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a476fc29-a779-4f57-aaff-52c589072d88 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:34.948239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a476fc29-a779-4f57-aaff-52c589072d88 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080303 Jul 21 22:23:34.948816 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 768/1658] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:34 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:35.883474 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c171741e-8baf-457b-b278-a3d63c87eaf5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:35.884092 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c171741e-8baf-457b-b278-a3d63c87eaf5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:35.887427 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-82c14cfb-e6dd-46c7-8cd7-c1b5b73ee2a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:35.888117 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-82c14cfb-e6dd-46c7-8cd7-c1b5b73ee2a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:35.890571 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c171741e-8baf-457b-b278-a3d63c87eaf5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:35.891631 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c171741e-8baf-457b-b278-a3d63c87eaf5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:35.892399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c171741e-8baf-457b-b278-a3d63c87eaf5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:35.892835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c171741e-8baf-457b-b278-a3d63c87eaf5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:35.895331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-82c14cfb-e6dd-46c7-8cd7-c1b5b73ee2a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:35.895785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-82c14cfb-e6dd-46c7-8cd7-c1b5b73ee2a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:35.896555 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-82c14cfb-e6dd-46c7-8cd7-c1b5b73ee2a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:35.896996 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-82c14cfb-e6dd-46c7-8cd7-c1b5b73ee2a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:36.086966 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c171741e-8baf-457b-b278-a3d63c87eaf5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:36.092052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-82c14cfb-e6dd-46c7-8cd7-c1b5b73ee2a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:36.095639 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c171741e-8baf-457b-b278-a3d63c87eaf5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.216008 Jul 21 22:23:36.096220 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 891/1659] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:35 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:36.100315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-82c14cfb-e6dd-46c7-8cd7-c1b5b73ee2a8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.216523 Jul 21 22:23:36.100610 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2bbff658-687e-4085-91cd-4a89d954679b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:36.101011 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 769/1660] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:35 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:36.101212 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2bbff658-687e-4085-91cd-4a89d954679b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:36.107409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2bbff658-687e-4085-91cd-4a89d954679b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:36.107861 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2bbff658-687e-4085-91cd-4a89d954679b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:36.108631 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2bbff658-687e-4085-91cd-4a89d954679b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:36.109073 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2bbff658-687e-4085-91cd-4a89d954679b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:36.181442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2bbff658-687e-4085-91cd-4a89d954679b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:36.191489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2bbff658-687e-4085-91cd-4a89d954679b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.094281 Jul 21 22:23:36.192189 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 892/1661] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:36 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:37.112290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-47673463-1d3e-499c-b0dd-e7f75c97a26d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:37.112935 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-47673463-1d3e-499c-b0dd-e7f75c97a26d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:37.117697 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cd6e1e76-27fe-4c82-bd16-ebc362c2556a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:37.118427 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cd6e1e76-27fe-4c82-bd16-ebc362c2556a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:37.119572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47673463-1d3e-499c-b0dd-e7f75c97a26d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:37.120059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47673463-1d3e-499c-b0dd-e7f75c97a26d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:37.120842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47673463-1d3e-499c-b0dd-e7f75c97a26d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:37.121280 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47673463-1d3e-499c-b0dd-e7f75c97a26d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:37.125385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd6e1e76-27fe-4c82-bd16-ebc362c2556a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:37.125849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd6e1e76-27fe-4c82-bd16-ebc362c2556a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:37.126620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd6e1e76-27fe-4c82-bd16-ebc362c2556a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:37.127079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cd6e1e76-27fe-4c82-bd16-ebc362c2556a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:37.314093 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-47673463-1d3e-499c-b0dd-e7f75c97a26d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:37.317310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-cd6e1e76-27fe-4c82-bd16-ebc362c2556a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:37.322255 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-47673463-1d3e-499c-b0dd-e7f75c97a26d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.213795 Jul 21 22:23:37.322867 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 770/1662] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:37 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:37.325210 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cd6e1e76-27fe-4c82-bd16-ebc362c2556a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.211592 Jul 21 22:23:37.326095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 893/1663] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:37 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:37.327395 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-70061147-22e4-4bd7-b055-efc58ecf4b95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:37.328023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-70061147-22e4-4bd7-b055-efc58ecf4b95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:37.334358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-70061147-22e4-4bd7-b055-efc58ecf4b95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:37.334808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-70061147-22e4-4bd7-b055-efc58ecf4b95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:37.335607 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-70061147-22e4-4bd7-b055-efc58ecf4b95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:37.336051 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-70061147-22e4-4bd7-b055-efc58ecf4b95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:37.396221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-70061147-22e4-4bd7-b055-efc58ecf4b95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:37.399577 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:37.404754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-70061147-22e4-4bd7-b055-efc58ecf4b95 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080941 Jul 21 22:23:37.405327 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 771/1664] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:37 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:38.339641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7af1ad9f-b41c-4197-8429-9b162410cedf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:38.340246 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7af1ad9f-b41c-4197-8429-9b162410cedf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:38.342054 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-70b83476-952d-4705-99fb-396e85b3ac3b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:38.342664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-70b83476-952d-4705-99fb-396e85b3ac3b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:38.347614 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7af1ad9f-b41c-4197-8429-9b162410cedf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:38.348064 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7af1ad9f-b41c-4197-8429-9b162410cedf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:38.348835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7af1ad9f-b41c-4197-8429-9b162410cedf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:38.349269 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7af1ad9f-b41c-4197-8429-9b162410cedf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:38.350116 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-70b83476-952d-4705-99fb-396e85b3ac3b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:38.350564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-70b83476-952d-4705-99fb-396e85b3ac3b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:38.351358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-70b83476-952d-4705-99fb-396e85b3ac3b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:38.351793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-70b83476-952d-4705-99fb-396e85b3ac3b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:38.353226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:38.542590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7af1ad9f-b41c-4197-8429-9b162410cedf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:38.546588 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-70b83476-952d-4705-99fb-396e85b3ac3b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:38.550582 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7af1ad9f-b41c-4197-8429-9b162410cedf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.214943 Jul 21 22:23:38.551174 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 894/1665] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:38 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:38.554490 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-70b83476-952d-4705-99fb-396e85b3ac3b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.216272 Jul 21 22:23:38.555243 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 772/1666] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:38 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:38.555496 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fafd2363-48c6-4483-9857-563488117447 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:38.556094 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fafd2363-48c6-4483-9857-563488117447 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:38.561833 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fafd2363-48c6-4483-9857-563488117447 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:38.562284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fafd2363-48c6-4483-9857-563488117447 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:38.563625 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fafd2363-48c6-4483-9857-563488117447 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:38.564057 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fafd2363-48c6-4483-9857-563488117447 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:38.629288 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fafd2363-48c6-4483-9857-563488117447 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:38.637129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fafd2363-48c6-4483-9857-563488117447 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085015 Jul 21 22:23:38.637688 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 895/1667] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:38 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:39.568091 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-30158bbb-c251-4e6b-822d-d6123027fa31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:39.568710 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-30158bbb-c251-4e6b-822d-d6123027fa31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:39.571824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-96308a69-5eca-4511-bff3-18ad54719a20 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:39.572602 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-96308a69-5eca-4511-bff3-18ad54719a20 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:39.575186 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30158bbb-c251-4e6b-822d-d6123027fa31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:39.575670 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30158bbb-c251-4e6b-822d-d6123027fa31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:39.576408 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30158bbb-c251-4e6b-822d-d6123027fa31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:39.576842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30158bbb-c251-4e6b-822d-d6123027fa31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:39.578666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-96308a69-5eca-4511-bff3-18ad54719a20 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:39.579149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-96308a69-5eca-4511-bff3-18ad54719a20 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:39.579916 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-96308a69-5eca-4511-bff3-18ad54719a20 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:39.580352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-96308a69-5eca-4511-bff3-18ad54719a20 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:39.763820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-30158bbb-c251-4e6b-822d-d6123027fa31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:39.768461 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-96308a69-5eca-4511-bff3-18ad54719a20 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:39.772536 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-30158bbb-c251-4e6b-822d-d6123027fa31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.208232 Jul 21 22:23:39.773116 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 773/1668] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:39 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:39.776804 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-96308a69-5eca-4511-bff3-18ad54719a20 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.208634 Jul 21 22:23:39.777508 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 896/1669] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:39 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:39.777633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-36b27838-0ac6-426f-8380-ee251978d6e3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:39.778065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-36b27838-0ac6-426f-8380-ee251978d6e3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:39.784495 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36b27838-0ac6-426f-8380-ee251978d6e3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:39.784947 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36b27838-0ac6-426f-8380-ee251978d6e3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:39.785717 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36b27838-0ac6-426f-8380-ee251978d6e3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:39.786175 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36b27838-0ac6-426f-8380-ee251978d6e3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:39.849950 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-36b27838-0ac6-426f-8380-ee251978d6e3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:39.858490 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-36b27838-0ac6-426f-8380-ee251978d6e3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084443 Jul 21 22:23:39.859093 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 774/1670] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:39 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:40.789573 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b23e36ad-04fd-44df-ba68-fd859ac048ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:40.790180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b23e36ad-04fd-44df-ba68-fd859ac048ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:40.793359 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f571a7d9-c0a5-4572-97bd-faf5b9a6bc74 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:40.793983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f571a7d9-c0a5-4572-97bd-faf5b9a6bc74 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:40.797432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b23e36ad-04fd-44df-ba68-fd859ac048ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:40.797895 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b23e36ad-04fd-44df-ba68-fd859ac048ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:40.798664 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b23e36ad-04fd-44df-ba68-fd859ac048ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:40.799128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b23e36ad-04fd-44df-ba68-fd859ac048ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:40.801146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f571a7d9-c0a5-4572-97bd-faf5b9a6bc74 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:40.801607 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f571a7d9-c0a5-4572-97bd-faf5b9a6bc74 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:40.802378 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f571a7d9-c0a5-4572-97bd-faf5b9a6bc74 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:40.802830 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f571a7d9-c0a5-4572-97bd-faf5b9a6bc74 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:40.989516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b23e36ad-04fd-44df-ba68-fd859ac048ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:40.996246 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f571a7d9-c0a5-4572-97bd-faf5b9a6bc74 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:40.997387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b23e36ad-04fd-44df-ba68-fd859ac048ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.211632 Jul 21 22:23:40.998183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 897/1671] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:40 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:41.002301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a72f8eaa-2074-4b16-b52d-abff8a1dd7f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:41.002897 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a72f8eaa-2074-4b16-b52d-abff8a1dd7f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:41.008507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a72f8eaa-2074-4b16-b52d-abff8a1dd7f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:41.008946 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f571a7d9-c0a5-4572-97bd-faf5b9a6bc74 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.219133 Jul 21 22:23:41.009095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a72f8eaa-2074-4b16-b52d-abff8a1dd7f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:41.010220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 775/1672] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:40 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:41.010383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a72f8eaa-2074-4b16-b52d-abff8a1dd7f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:41.010383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a72f8eaa-2074-4b16-b52d-abff8a1dd7f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:41.070660 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a72f8eaa-2074-4b16-b52d-abff8a1dd7f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:41.078559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a72f8eaa-2074-4b16-b52d-abff8a1dd7f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079678 Jul 21 22:23:41.079141 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 898/1673] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:40 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:42.013649 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0074739e-7602-4916-b177-41efa100d5b4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:42.014264 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0074739e-7602-4916-b177-41efa100d5b4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:42.021549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0074739e-7602-4916-b177-41efa100d5b4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:42.022000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0074739e-7602-4916-b177-41efa100d5b4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:42.022776 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0074739e-7602-4916-b177-41efa100d5b4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:42.023256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0074739e-7602-4916-b177-41efa100d5b4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:42.025465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3366d242-036d-4181-a771-92d847e1027a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:42.026076 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3366d242-036d-4181-a771-92d847e1027a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:42.033268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3366d242-036d-4181-a771-92d847e1027a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:42.033716 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3366d242-036d-4181-a771-92d847e1027a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:42.034504 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3366d242-036d-4181-a771-92d847e1027a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:42.034934 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3366d242-036d-4181-a771-92d847e1027a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:42.205922 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0074739e-7602-4916-b177-41efa100d5b4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:42.214080 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0074739e-7602-4916-b177-41efa100d5b4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.204285 Jul 21 22:23:42.214947 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 776/1674] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:42 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:42.220275 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2eb542ec-c409-4755-847e-41bb37268b07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:42.220820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2eb542ec-c409-4755-847e-41bb37268b07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:42.226765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2eb542ec-c409-4755-847e-41bb37268b07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:42.227255 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2eb542ec-c409-4755-847e-41bb37268b07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:42.228039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2eb542ec-c409-4755-847e-41bb37268b07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:42.228480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2eb542ec-c409-4755-847e-41bb37268b07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:42.231241 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3366d242-036d-4181-a771-92d847e1027a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:42.239228 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3366d242-036d-4181-a771-92d847e1027a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.217494 Jul 21 22:23:42.239803 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 899/1675] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:42 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:42.295696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2eb542ec-c409-4755-847e-41bb37268b07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:42.303650 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2eb542ec-c409-4755-847e-41bb37268b07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.087851 Jul 21 22:23:42.304224 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 777/1676] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:42 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:43.232059 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5634c176-7551-4b84-8dd2-bb67145ee17e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:43.232657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5634c176-7551-4b84-8dd2-bb67145ee17e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:43.239767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5634c176-7551-4b84-8dd2-bb67145ee17e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:43.240217 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5634c176-7551-4b84-8dd2-bb67145ee17e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:43.240969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5634c176-7551-4b84-8dd2-bb67145ee17e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:43.241402 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5634c176-7551-4b84-8dd2-bb67145ee17e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:43.256762 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-73651bf2-a0dd-4587-99fa-cdacafd73795 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:43.257380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-73651bf2-a0dd-4587-99fa-cdacafd73795 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:43.263764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73651bf2-a0dd-4587-99fa-cdacafd73795 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:43.264219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73651bf2-a0dd-4587-99fa-cdacafd73795 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:43.264996 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73651bf2-a0dd-4587-99fa-cdacafd73795 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:43.265468 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73651bf2-a0dd-4587-99fa-cdacafd73795 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:43.435144 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5634c176-7551-4b84-8dd2-bb67145ee17e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:43.443128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5634c176-7551-4b84-8dd2-bb67145ee17e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.214854 Jul 21 22:23:43.443705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 900/1677] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:43 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:43.446033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-73651bf2-a0dd-4587-99fa-cdacafd73795 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:43.448128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-581f639d-654f-4962-8a43-c3a287ecde91 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:43.448734 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-581f639d-654f-4962-8a43-c3a287ecde91 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:43.454989 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-581f639d-654f-4962-8a43-c3a287ecde91 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:43.455162 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-73651bf2-a0dd-4587-99fa-cdacafd73795 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.202029 Jul 21 22:23:43.455466 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-581f639d-654f-4962-8a43-c3a287ecde91 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:43.455594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 778/1678] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:43 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:43.456241 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-581f639d-654f-4962-8a43-c3a287ecde91 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:43.456678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-581f639d-654f-4962-8a43-c3a287ecde91 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:43.521606 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-581f639d-654f-4962-8a43-c3a287ecde91 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:43.529612 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-581f639d-654f-4962-8a43-c3a287ecde91 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084958 Jul 21 22:23:43.530185 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 901/1679] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:43 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:44.459951 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1acc7fcb-58bb-47ad-81b6-63b3f44667d2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:44.460557 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1acc7fcb-58bb-47ad-81b6-63b3f44667d2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:44.467400 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1acc7fcb-58bb-47ad-81b6-63b3f44667d2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:44.467847 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1acc7fcb-58bb-47ad-81b6-63b3f44667d2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:44.469276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1acc7fcb-58bb-47ad-81b6-63b3f44667d2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:44.469966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1acc7fcb-58bb-47ad-81b6-63b3f44667d2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:44.472999 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c1c52493-d17a-4eec-ad9f-ea3b19d00876 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:44.473611 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c1c52493-d17a-4eec-ad9f-ea3b19d00876 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:44.480150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1c52493-d17a-4eec-ad9f-ea3b19d00876 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:44.480604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1c52493-d17a-4eec-ad9f-ea3b19d00876 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:44.481641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1c52493-d17a-4eec-ad9f-ea3b19d00876 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:44.482085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1c52493-d17a-4eec-ad9f-ea3b19d00876 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:44.671947 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1acc7fcb-58bb-47ad-81b6-63b3f44667d2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:44.678957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c1c52493-d17a-4eec-ad9f-ea3b19d00876 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:44.679908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1acc7fcb-58bb-47ad-81b6-63b3f44667d2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.223748 Jul 21 22:23:44.680496 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 779/1680] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:44 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:44.684847 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ecf6cdc8-cf30-4569-af02-e3dd73346597 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:44.685455 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ecf6cdc8-cf30-4569-af02-e3dd73346597 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:44.686944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c1c52493-d17a-4eec-ad9f-ea3b19d00876 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.218859 Jul 21 22:23:44.688162 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 902/1681] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:44 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:44.691864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ecf6cdc8-cf30-4569-af02-e3dd73346597 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:44.692325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ecf6cdc8-cf30-4569-af02-e3dd73346597 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:44.693104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ecf6cdc8-cf30-4569-af02-e3dd73346597 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:44.693550 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ecf6cdc8-cf30-4569-af02-e3dd73346597 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:44.753325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ecf6cdc8-cf30-4569-af02-e3dd73346597 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:44.761270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ecf6cdc8-cf30-4569-af02-e3dd73346597 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079821 Jul 21 22:23:44.761870 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 780/1682] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:44 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:45.697682 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ea207b15-315b-4eb3-b708-b9bc2ef726ef tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:45.698368 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ea207b15-315b-4eb3-b708-b9bc2ef726ef tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:45.703934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3dcb58d2-d8cc-474f-ad6f-41302eac6fca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:45.704544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3dcb58d2-d8cc-474f-ad6f-41302eac6fca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:45.705336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea207b15-315b-4eb3-b708-b9bc2ef726ef tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:45.705787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea207b15-315b-4eb3-b708-b9bc2ef726ef tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:45.706552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea207b15-315b-4eb3-b708-b9bc2ef726ef tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:45.706980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea207b15-315b-4eb3-b708-b9bc2ef726ef tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:45.710872 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3dcb58d2-d8cc-474f-ad6f-41302eac6fca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:45.711359 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3dcb58d2-d8cc-474f-ad6f-41302eac6fca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:45.712119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3dcb58d2-d8cc-474f-ad6f-41302eac6fca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:45.712553 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3dcb58d2-d8cc-474f-ad6f-41302eac6fca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:45.898477 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ea207b15-315b-4eb3-b708-b9bc2ef726ef tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:45.902392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3dcb58d2-d8cc-474f-ad6f-41302eac6fca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:45.907170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ea207b15-315b-4eb3-b708-b9bc2ef726ef tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.213247 Jul 21 22:23:45.907765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 903/1683] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:45 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:45.910839 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3dcb58d2-d8cc-474f-ad6f-41302eac6fca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.211245 Jul 21 22:23:45.911591 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 781/1684] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:45 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:45.912343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0ab2349b-a6d8-484c-bd47-9640d32f523d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:45.912952 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0ab2349b-a6d8-484c-bd47-9640d32f523d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:45.918787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0ab2349b-a6d8-484c-bd47-9640d32f523d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:45.919267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0ab2349b-a6d8-484c-bd47-9640d32f523d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:45.920026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0ab2349b-a6d8-484c-bd47-9640d32f523d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:45.920458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0ab2349b-a6d8-484c-bd47-9640d32f523d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:45.981320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0ab2349b-a6d8-484c-bd47-9640d32f523d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:45.989417 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0ab2349b-a6d8-484c-bd47-9640d32f523d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080720 Jul 21 22:23:45.989969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 904/1685] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:45 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:46.924073 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e59409fb-46b8-4e44-aa69-51a319e4b50d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:46.924697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e59409fb-46b8-4e44-aa69-51a319e4b50d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:46.928234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-106b35d7-2ac8-4e3a-a29b-4aa7e5b4055d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:46.928878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-106b35d7-2ac8-4e3a-a29b-4aa7e5b4055d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:46.931220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e59409fb-46b8-4e44-aa69-51a319e4b50d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:46.931710 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e59409fb-46b8-4e44-aa69-51a319e4b50d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:46.932492 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e59409fb-46b8-4e44-aa69-51a319e4b50d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:46.932937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e59409fb-46b8-4e44-aa69-51a319e4b50d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:46.935224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-106b35d7-2ac8-4e3a-a29b-4aa7e5b4055d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:46.935683 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-106b35d7-2ac8-4e3a-a29b-4aa7e5b4055d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:46.936454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-106b35d7-2ac8-4e3a-a29b-4aa7e5b4055d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:46.936891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-106b35d7-2ac8-4e3a-a29b-4aa7e5b4055d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:47.126422 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e59409fb-46b8-4e44-aa69-51a319e4b50d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:47.128903 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-106b35d7-2ac8-4e3a-a29b-4aa7e5b4055d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:47.134560 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e59409fb-46b8-4e44-aa69-51a319e4b50d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.214878 Jul 21 22:23:47.135173 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 782/1686] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:46 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:47.136819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-106b35d7-2ac8-4e3a-a29b-4aa7e5b4055d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.212494 Jul 21 22:23:47.143615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 905/1687] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:46 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:47.143770 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e9192a2b-90fb-4e22-8e49-4945f54b26c4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:47.143770 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e9192a2b-90fb-4e22-8e49-4945f54b26c4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:47.146608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9192a2b-90fb-4e22-8e49-4945f54b26c4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:47.147081 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9192a2b-90fb-4e22-8e49-4945f54b26c4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:47.147845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9192a2b-90fb-4e22-8e49-4945f54b26c4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:47.148284 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9192a2b-90fb-4e22-8e49-4945f54b26c4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:47.217144 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9192a2b-90fb-4e22-8e49-4945f54b26c4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:47.225868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e9192a2b-90fb-4e22-8e49-4945f54b26c4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.089771 Jul 21 22:23:47.226438 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 783/1688] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:47 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:48.151453 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d05fb89b-0123-4ef9-8a5a-2cefb9afe750 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:48.152064 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d05fb89b-0123-4ef9-8a5a-2cefb9afe750 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:48.153268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d2b16543-d998-4a43-b98a-75cec76161fa tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:48.153887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d2b16543-d998-4a43-b98a-75cec76161fa tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:48.158679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d05fb89b-0123-4ef9-8a5a-2cefb9afe750 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:48.159207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d05fb89b-0123-4ef9-8a5a-2cefb9afe750 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:48.159983 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d05fb89b-0123-4ef9-8a5a-2cefb9afe750 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:48.160341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d2b16543-d998-4a43-b98a-75cec76161fa tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:48.160458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d05fb89b-0123-4ef9-8a5a-2cefb9afe750 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:48.160798 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d2b16543-d998-4a43-b98a-75cec76161fa tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:48.161566 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d2b16543-d998-4a43-b98a-75cec76161fa tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:48.162008 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d2b16543-d998-4a43-b98a-75cec76161fa tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:48.580102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d05fb89b-0123-4ef9-8a5a-2cefb9afe750 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:48.583227 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d2b16543-d998-4a43-b98a-75cec76161fa tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:48.588929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d05fb89b-0123-4ef9-8a5a-2cefb9afe750 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.441290 Jul 21 22:23:48.589606 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 906/1689] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:48 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:48.591101 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d2b16543-d998-4a43-b98a-75cec76161fa tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.441527 Jul 21 22:23:48.591833 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 784/1690] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:48 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:48.595199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cfd91d2f-010a-428d-a63b-2f1fc56ff5f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:48.595869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cfd91d2f-010a-428d-a63b-2f1fc56ff5f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:48.602091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cfd91d2f-010a-428d-a63b-2f1fc56ff5f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:48.602540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cfd91d2f-010a-428d-a63b-2f1fc56ff5f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:48.603338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cfd91d2f-010a-428d-a63b-2f1fc56ff5f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:48.603773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cfd91d2f-010a-428d-a63b-2f1fc56ff5f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:48.666953 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-cfd91d2f-010a-428d-a63b-2f1fc56ff5f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:48.674840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cfd91d2f-010a-428d-a63b-2f1fc56ff5f8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084249 Jul 21 22:23:48.675463 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 907/1691] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:48 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:49.242384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:23:49.243147 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:23:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:23:49.607663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8e95e596-bdd0-4d74-8813-a69af67db191 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:49.608189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8e95e596-bdd0-4d74-8813-a69af67db191 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:49.608528 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fa4b5cfd-ff0a-46ed-936e-3549156a67ef tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:49.609624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fa4b5cfd-ff0a-46ed-936e-3549156a67ef tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:49.615148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e95e596-bdd0-4d74-8813-a69af67db191 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:49.615597 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e95e596-bdd0-4d74-8813-a69af67db191 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:49.615996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa4b5cfd-ff0a-46ed-936e-3549156a67ef tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:49.616361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e95e596-bdd0-4d74-8813-a69af67db191 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:49.616466 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa4b5cfd-ff0a-46ed-936e-3549156a67ef tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:49.616796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e95e596-bdd0-4d74-8813-a69af67db191 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:49.617251 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa4b5cfd-ff0a-46ed-936e-3549156a67ef tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:49.617689 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fa4b5cfd-ff0a-46ed-936e-3549156a67ef tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:49.805618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fa4b5cfd-ff0a-46ed-936e-3549156a67ef tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:49.809719 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8e95e596-bdd0-4d74-8813-a69af67db191 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:49.813662 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fa4b5cfd-ff0a-46ed-936e-3549156a67ef tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.208862 Jul 21 22:23:49.814230 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 908/1692] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:49 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:49.817765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8e95e596-bdd0-4d74-8813-a69af67db191 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.214296 Jul 21 22:23:49.818490 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 785/1693] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:49 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:49.818609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9a0c2c03-d87f-425a-8d83-7b03ce890735 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:49.819351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9a0c2c03-d87f-425a-8d83-7b03ce890735 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:49.825106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a0c2c03-d87f-425a-8d83-7b03ce890735 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:49.825559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a0c2c03-d87f-425a-8d83-7b03ce890735 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:49.826361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a0c2c03-d87f-425a-8d83-7b03ce890735 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:49.826803 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a0c2c03-d87f-425a-8d83-7b03ce890735 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:49.894363 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9a0c2c03-d87f-425a-8d83-7b03ce890735 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:49.902213 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9a0c2c03-d87f-425a-8d83-7b03ce890735 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.087069 Jul 21 22:23:49.902768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 909/1694] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:49 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:50.830353 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a4841080-130f-43a9-ac26-15d12d1e23d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:50.830968 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a4841080-130f-43a9-ac26-15d12d1e23d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:50.833731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bc159d9f-370a-4bed-8e58-0653d565b5b3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:50.834285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bc159d9f-370a-4bed-8e58-0653d565b5b3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:50.837564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4841080-130f-43a9-ac26-15d12d1e23d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:50.838038 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4841080-130f-43a9-ac26-15d12d1e23d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:50.838831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4841080-130f-43a9-ac26-15d12d1e23d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:50.839297 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4841080-130f-43a9-ac26-15d12d1e23d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:50.840809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bc159d9f-370a-4bed-8e58-0653d565b5b3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:50.841260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bc159d9f-370a-4bed-8e58-0653d565b5b3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:50.842030 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bc159d9f-370a-4bed-8e58-0653d565b5b3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:50.842465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bc159d9f-370a-4bed-8e58-0653d565b5b3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:51.034736 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a4841080-130f-43a9-ac26-15d12d1e23d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:51.038749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bc159d9f-370a-4bed-8e58-0653d565b5b3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:51.042185 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:51.042788 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a4841080-130f-43a9-ac26-15d12d1e23d9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.216257 Jul 21 22:23:51.043719 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 786/1695] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:50 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:51.047363 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bc159d9f-370a-4bed-8e58-0653d565b5b3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.217547 Jul 21 22:23:51.048098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 910/1696] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:50 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:51.048273 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8f4abb00-2d97-4d01-ba58-dd08ff22fa21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:51.048939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8f4abb00-2d97-4d01-ba58-dd08ff22fa21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:51.054787 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f4abb00-2d97-4d01-ba58-dd08ff22fa21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:51.055269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f4abb00-2d97-4d01-ba58-dd08ff22fa21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:51.056042 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f4abb00-2d97-4d01-ba58-dd08ff22fa21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:51.056513 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f4abb00-2d97-4d01-ba58-dd08ff22fa21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:51.117046 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8f4abb00-2d97-4d01-ba58-dd08ff22fa21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:51.124962 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8f4abb00-2d97-4d01-ba58-dd08ff22fa21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080327 Jul 21 22:23:51.125533 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 787/1697] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:51 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:52.060589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ffcaf791-beb1-454d-8ae2-c8abddfbc3ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:52.061197 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ffcaf791-beb1-454d-8ae2-c8abddfbc3ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:52.064049 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ac975e5d-f0d1-4489-b01f-80b714a3f834 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:52.064663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ac975e5d-f0d1-4489-b01f-80b714a3f834 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:52.068499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ffcaf791-beb1-454d-8ae2-c8abddfbc3ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:52.068951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ffcaf791-beb1-454d-8ae2-c8abddfbc3ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:52.069732 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ffcaf791-beb1-454d-8ae2-c8abddfbc3ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:52.070171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ffcaf791-beb1-454d-8ae2-c8abddfbc3ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:52.071383 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac975e5d-f0d1-4489-b01f-80b714a3f834 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:52.071845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac975e5d-f0d1-4489-b01f-80b714a3f834 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:52.072633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac975e5d-f0d1-4489-b01f-80b714a3f834 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:52.073065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac975e5d-f0d1-4489-b01f-80b714a3f834 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:52.090943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:52.267421 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ac975e5d-f0d1-4489-b01f-80b714a3f834 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:52.271502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ffcaf791-beb1-454d-8ae2-c8abddfbc3ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:52.275796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ac975e5d-f0d1-4489-b01f-80b714a3f834 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.215568 Jul 21 22:23:52.276381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 788/1698] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:52 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:52.279745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ffcaf791-beb1-454d-8ae2-c8abddfbc3ae tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.223049 Jul 21 22:23:52.281050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 911/1699] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:52 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:52.281313 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8f6cf87a-f6e7-43bd-841d-9db1390d1abd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:52.281916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8f6cf87a-f6e7-43bd-841d-9db1390d1abd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:52.287680 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f6cf87a-f6e7-43bd-841d-9db1390d1abd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:52.288135 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f6cf87a-f6e7-43bd-841d-9db1390d1abd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:52.288903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f6cf87a-f6e7-43bd-841d-9db1390d1abd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:52.289377 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f6cf87a-f6e7-43bd-841d-9db1390d1abd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:52.350229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8f6cf87a-f6e7-43bd-841d-9db1390d1abd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:52.358349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8f6cf87a-f6e7-43bd-841d-9db1390d1abd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081032 Jul 21 22:23:52.359678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 789/1700] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:52 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:53.293673 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4bed5042-7e1a-4494-b795-60eea6ac580d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:53.294200 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4bed5042-7e1a-4494-b795-60eea6ac580d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:53.297236 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-41b79e7f-fa06-46c6-885d-b59144b49508 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:53.297841 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-41b79e7f-fa06-46c6-885d-b59144b49508 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:53.301179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bed5042-7e1a-4494-b795-60eea6ac580d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:53.301629 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bed5042-7e1a-4494-b795-60eea6ac580d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:53.302401 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bed5042-7e1a-4494-b795-60eea6ac580d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:53.302830 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4bed5042-7e1a-4494-b795-60eea6ac580d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:53.304512 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41b79e7f-fa06-46c6-885d-b59144b49508 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:53.304963 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41b79e7f-fa06-46c6-885d-b59144b49508 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:53.305721 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41b79e7f-fa06-46c6-885d-b59144b49508 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:53.306152 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-41b79e7f-fa06-46c6-885d-b59144b49508 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:53.497295 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4bed5042-7e1a-4494-b795-60eea6ac580d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:53.504367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-41b79e7f-fa06-46c6-885d-b59144b49508 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:53.506347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4bed5042-7e1a-4494-b795-60eea6ac580d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.216732 Jul 21 22:23:53.506932 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 912/1701] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:53 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:53.511752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-72bddeeb-5316-48f7-ac72-e352a69ed9b0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:53.512303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-41b79e7f-fa06-46c6-885d-b59144b49508 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.219306 Jul 21 22:23:53.512451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-72bddeeb-5316-48f7-ac72-e352a69ed9b0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:53.516721 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 790/1702] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:53 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:53.518124 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72bddeeb-5316-48f7-ac72-e352a69ed9b0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:53.518583 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72bddeeb-5316-48f7-ac72-e352a69ed9b0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:53.519429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72bddeeb-5316-48f7-ac72-e352a69ed9b0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:53.519872 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72bddeeb-5316-48f7-ac72-e352a69ed9b0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:53.580737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-72bddeeb-5316-48f7-ac72-e352a69ed9b0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:53.588543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-72bddeeb-5316-48f7-ac72-e352a69ed9b0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080656 Jul 21 22:23:53.589114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 913/1703] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:53 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:54.523220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3fdfefa8-e19d-41d4-97c3-7da2322535d7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:54.523768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3fdfefa8-e19d-41d4-97c3-7da2322535d7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:54.529188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a3bed373-40fb-4940-853e-572ba1135109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:54.529801 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a3bed373-40fb-4940-853e-572ba1135109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:54.530309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3fdfefa8-e19d-41d4-97c3-7da2322535d7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:54.530755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3fdfefa8-e19d-41d4-97c3-7da2322535d7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:54.531564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3fdfefa8-e19d-41d4-97c3-7da2322535d7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:54.531998 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3fdfefa8-e19d-41d4-97c3-7da2322535d7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:54.536061 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3bed373-40fb-4940-853e-572ba1135109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:54.536518 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3bed373-40fb-4940-853e-572ba1135109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:54.537292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3bed373-40fb-4940-853e-572ba1135109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:54.537729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a3bed373-40fb-4940-853e-572ba1135109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:54.729238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3fdfefa8-e19d-41d4-97c3-7da2322535d7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:54.732442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a3bed373-40fb-4940-853e-572ba1135109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:54.738107 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3fdfefa8-e19d-41d4-97c3-7da2322535d7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.218863 Jul 21 22:23:54.738691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 791/1704] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:54 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:54.740930 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a3bed373-40fb-4940-853e-572ba1135109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.215489 Jul 21 22:23:54.741646 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 914/1705] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:54 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:54.743165 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-18fa1e48-57a3-45d0-aa6a-caf694b91a26 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:54.743717 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-18fa1e48-57a3-45d0-aa6a-caf694b91a26 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:54.750052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18fa1e48-57a3-45d0-aa6a-caf694b91a26 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:54.750503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18fa1e48-57a3-45d0-aa6a-caf694b91a26 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:54.751304 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18fa1e48-57a3-45d0-aa6a-caf694b91a26 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:54.751744 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18fa1e48-57a3-45d0-aa6a-caf694b91a26 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:54.812609 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-18fa1e48-57a3-45d0-aa6a-caf694b91a26 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:54.820440 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-18fa1e48-57a3-45d0-aa6a-caf694b91a26 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080786 Jul 21 22:23:54.821009 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 792/1706] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:54 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:55.755908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-54decc01-7e5d-4012-b5ed-4f99c3329eec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:55.756446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-54decc01-7e5d-4012-b5ed-4f99c3329eec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:55.758006 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e5cfd290-00ce-4393-a491-3199fbbddd5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:55.758623 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e5cfd290-00ce-4393-a491-3199fbbddd5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:55.763090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-54decc01-7e5d-4012-b5ed-4f99c3329eec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:55.763544 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-54decc01-7e5d-4012-b5ed-4f99c3329eec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:55.764323 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-54decc01-7e5d-4012-b5ed-4f99c3329eec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:55.765418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-54decc01-7e5d-4012-b5ed-4f99c3329eec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:55.765608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e5cfd290-00ce-4393-a491-3199fbbddd5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:55.766036 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e5cfd290-00ce-4393-a491-3199fbbddd5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:55.766808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e5cfd290-00ce-4393-a491-3199fbbddd5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:55.767281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e5cfd290-00ce-4393-a491-3199fbbddd5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:55.960789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-54decc01-7e5d-4012-b5ed-4f99c3329eec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:55.964867 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e5cfd290-00ce-4393-a491-3199fbbddd5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:55.968733 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-54decc01-7e5d-4012-b5ed-4f99c3329eec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.216692 Jul 21 22:23:55.969309 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 915/1707] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:55 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:55.973345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e5cfd290-00ce-4393-a491-3199fbbddd5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.219071 Jul 21 22:23:55.974157 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 793/1708] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:55 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:55.974274 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-79356419-ef3e-4aa2-b565-c4d83f075641 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:55.974790 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-79356419-ef3e-4aa2-b565-c4d83f075641 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:55.980661 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79356419-ef3e-4aa2-b565-c4d83f075641 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:55.981115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79356419-ef3e-4aa2-b565-c4d83f075641 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:55.981880 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79356419-ef3e-4aa2-b565-c4d83f075641 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:55.982313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79356419-ef3e-4aa2-b565-c4d83f075641 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:56.042961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-79356419-ef3e-4aa2-b565-c4d83f075641 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:56.050903 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-79356419-ef3e-4aa2-b565-c4d83f075641 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080379 Jul 21 22:23:56.051499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 916/1709] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:55 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:56.985878 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b63c235f-bd7d-49ae-bae5-4e99b83658a2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:56.986472 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b63c235f-bd7d-49ae-bae5-4e99b83658a2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:56.989303 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d73b8db3-da9f-4726-8593-a04fb04a047f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:56.989914 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d73b8db3-da9f-4726-8593-a04fb04a047f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:56.992608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b63c235f-bd7d-49ae-bae5-4e99b83658a2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:56.993061 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b63c235f-bd7d-49ae-bae5-4e99b83658a2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:56.993839 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b63c235f-bd7d-49ae-bae5-4e99b83658a2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:56.994282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b63c235f-bd7d-49ae-bae5-4e99b83658a2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:56.996165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d73b8db3-da9f-4726-8593-a04fb04a047f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:56.996618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d73b8db3-da9f-4726-8593-a04fb04a047f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:56.997380 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d73b8db3-da9f-4726-8593-a04fb04a047f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:56.997812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d73b8db3-da9f-4726-8593-a04fb04a047f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:57.188373 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b63c235f-bd7d-49ae-bae5-4e99b83658a2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:57.192328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d73b8db3-da9f-4726-8593-a04fb04a047f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:57.196315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b63c235f-bd7d-49ae-bae5-4e99b83658a2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.214494 Jul 21 22:23:57.196896 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 794/1710] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:56 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:57.200728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d73b8db3-da9f-4726-8593-a04fb04a047f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.215131 Jul 21 22:23:57.201189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c90f39d8-c933-4d1a-8251-8ade5763a0d4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:57.206433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 917/1711] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:56 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:57.206583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c90f39d8-c933-4d1a-8251-8ade5763a0d4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:57.208196 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c90f39d8-c933-4d1a-8251-8ade5763a0d4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:57.208649 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c90f39d8-c933-4d1a-8251-8ade5763a0d4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:57.209410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c90f39d8-c933-4d1a-8251-8ade5763a0d4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:57.209847 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c90f39d8-c933-4d1a-8251-8ade5763a0d4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:57.277743 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c90f39d8-c933-4d1a-8251-8ade5763a0d4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:57.286893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c90f39d8-c933-4d1a-8251-8ade5763a0d4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.089058 Jul 21 22:23:57.287501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 795/1712] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:57 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:58.213690 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c99ea4b4-cc67-4a62-8bfd-ced3a2474279 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:58.214398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c99ea4b4-cc67-4a62-8bfd-ced3a2474279 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:58.217480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2acd7d5c-568c-416c-8475-dcbd05bebaf5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:58.218100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2acd7d5c-568c-416c-8475-dcbd05bebaf5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:58.222116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c99ea4b4-cc67-4a62-8bfd-ced3a2474279 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:58.222568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c99ea4b4-cc67-4a62-8bfd-ced3a2474279 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:58.223373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c99ea4b4-cc67-4a62-8bfd-ced3a2474279 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:58.223812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c99ea4b4-cc67-4a62-8bfd-ced3a2474279 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:58.226000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2acd7d5c-568c-416c-8475-dcbd05bebaf5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:58.226644 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2acd7d5c-568c-416c-8475-dcbd05bebaf5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:58.227764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2acd7d5c-568c-416c-8475-dcbd05bebaf5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:58.228586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2acd7d5c-568c-416c-8475-dcbd05bebaf5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:58.423054 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c99ea4b4-cc67-4a62-8bfd-ced3a2474279 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:58.430073 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2acd7d5c-568c-416c-8475-dcbd05bebaf5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:58.431162 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c99ea4b4-cc67-4a62-8bfd-ced3a2474279 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.221234 Jul 21 22:23:58.431649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 918/1713] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:58 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:58.436036 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6e376347-669e-4d8c-880f-0b98c5ca6aac tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:58.436635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6e376347-669e-4d8c-880f-0b98c5ca6aac tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:58.438808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2acd7d5c-568c-416c-8475-dcbd05bebaf5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.225239 Jul 21 22:23:58.443056 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 796/1714] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:58 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:58.443243 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e376347-669e-4d8c-880f-0b98c5ca6aac tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:58.443243 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e376347-669e-4d8c-880f-0b98c5ca6aac tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:58.443708 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e376347-669e-4d8c-880f-0b98c5ca6aac tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:58.444137 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e376347-669e-4d8c-880f-0b98c5ca6aac tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:58.510506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6e376347-669e-4d8c-880f-0b98c5ca6aac tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:58.519102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6e376347-669e-4d8c-880f-0b98c5ca6aac tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.086496 Jul 21 22:23:58.519661 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 919/1715] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:58 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:59.447997 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b08873a0-6810-40fa-ae9f-24bc1399d92d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:59.448607 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b08873a0-6810-40fa-ae9f-24bc1399d92d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:59.450892 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=76 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:59.456256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b08873a0-6810-40fa-ae9f-24bc1399d92d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:59.456437 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e29bbd32-ed9e-49c7-8a27-899eaf5dd7de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:59.456864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b08873a0-6810-40fa-ae9f-24bc1399d92d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:59.456971 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e29bbd32-ed9e-49c7-8a27-899eaf5dd7de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:59.457473 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b08873a0-6810-40fa-ae9f-24bc1399d92d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:59.457912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b08873a0-6810-40fa-ae9f-24bc1399d92d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:59.459237 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=74 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:23:59.464920 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e29bbd32-ed9e-49c7-8a27-899eaf5dd7de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:59.465369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e29bbd32-ed9e-49c7-8a27-899eaf5dd7de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:59.466141 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e29bbd32-ed9e-49c7-8a27-899eaf5dd7de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:59.466572 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e29bbd32-ed9e-49c7-8a27-899eaf5dd7de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:59.653187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b08873a0-6810-40fa-ae9f-24bc1399d92d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:59.657015 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e29bbd32-ed9e-49c7-8a27-899eaf5dd7de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:59.661954 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b08873a0-6810-40fa-ae9f-24bc1399d92d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.217839 Jul 21 22:23:59.662544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 797/1716] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:59 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:23:59.665301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e29bbd32-ed9e-49c7-8a27-899eaf5dd7de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.213316 Jul 21 22:23:59.666135 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 920/1717] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:59 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:23:59.666920 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-36819a2c-96f0-43b6-a272-a0afff9be04b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:23:59.667554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-36819a2c-96f0-43b6-a272-a0afff9be04b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:23:59.673930 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36819a2c-96f0-43b6-a272-a0afff9be04b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:59.674386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36819a2c-96f0-43b6-a272-a0afff9be04b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:59.675198 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36819a2c-96f0-43b6-a272-a0afff9be04b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:23:59.675644 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36819a2c-96f0-43b6-a272-a0afff9be04b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:23:59.736928 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-36819a2c-96f0-43b6-a272-a0afff9be04b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:23:59.744925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-36819a2c-96f0-43b6-a272-a0afff9be04b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081394 Jul 21 22:23:59.745502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 798/1718] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:23:59 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:00.679730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f105384b-fb06-4788-8c85-6cefc76d8d97 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:00.680347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f105384b-fb06-4788-8c85-6cefc76d8d97 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:00.682542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c2a7c3b8-0766-4ca6-a035-1be7577481ff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:00.683181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c2a7c3b8-0766-4ca6-a035-1be7577481ff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:00.687035 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f105384b-fb06-4788-8c85-6cefc76d8d97 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:00.687491 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f105384b-fb06-4788-8c85-6cefc76d8d97 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:00.688266 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f105384b-fb06-4788-8c85-6cefc76d8d97 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:00.689256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f105384b-fb06-4788-8c85-6cefc76d8d97 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:00.690390 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c2a7c3b8-0766-4ca6-a035-1be7577481ff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:00.690840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c2a7c3b8-0766-4ca6-a035-1be7577481ff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:00.691633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c2a7c3b8-0766-4ca6-a035-1be7577481ff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:00.692059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c2a7c3b8-0766-4ca6-a035-1be7577481ff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:00.881407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f105384b-fb06-4788-8c85-6cefc76d8d97 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:00.888133 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c2a7c3b8-0766-4ca6-a035-1be7577481ff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:00.889546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f105384b-fb06-4788-8c85-6cefc76d8d97 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.213641 Jul 21 22:24:00.890126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 921/1719] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:00 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:00.894647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c0f61df1-5d79-4d13-ad14-4d6caeca6507 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:00.895364 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c0f61df1-5d79-4d13-ad14-4d6caeca6507 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:00.896810 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c2a7c3b8-0766-4ca6-a035-1be7577481ff tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.217905 Jul 21 22:24:00.897841 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 799/1720] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:00 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:00.901232 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c0f61df1-5d79-4d13-ad14-4d6caeca6507 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:00.901693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c0f61df1-5d79-4d13-ad14-4d6caeca6507 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:00.902474 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c0f61df1-5d79-4d13-ad14-4d6caeca6507 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:00.902923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c0f61df1-5d79-4d13-ad14-4d6caeca6507 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:00.963088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c0f61df1-5d79-4d13-ad14-4d6caeca6507 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:00.971596 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c0f61df1-5d79-4d13-ad14-4d6caeca6507 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080545 Jul 21 22:24:00.972162 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 922/1721] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:00 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:01.905611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9c7812af-da49-4569-996a-26fd34bd3807 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:01.906231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9c7812af-da49-4569-996a-26fd34bd3807 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:01.913832 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a502cc9c-1ec0-42dc-90de-d161e00d2ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:01.914593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a502cc9c-1ec0-42dc-90de-d161e00d2ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:01.915113 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9c7812af-da49-4569-996a-26fd34bd3807 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:01.915578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9c7812af-da49-4569-996a-26fd34bd3807 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:01.916365 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9c7812af-da49-4569-996a-26fd34bd3807 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:01.916807 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9c7812af-da49-4569-996a-26fd34bd3807 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:01.920948 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a502cc9c-1ec0-42dc-90de-d161e00d2ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:01.921397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a502cc9c-1ec0-42dc-90de-d161e00d2ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:01.922349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a502cc9c-1ec0-42dc-90de-d161e00d2ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:01.922780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a502cc9c-1ec0-42dc-90de-d161e00d2ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:02.111835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9c7812af-da49-4569-996a-26fd34bd3807 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:02.114792 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a502cc9c-1ec0-42dc-90de-d161e00d2ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:02.120055 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9c7812af-da49-4569-996a-26fd34bd3807 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.218287 Jul 21 22:24:02.120635 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 800/1722] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:01 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:02.122657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a502cc9c-1ec0-42dc-90de-d161e00d2ed4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.212720 Jul 21 22:24:02.123420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 923/1723] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:01 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:02.125127 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-580f709d-dfaa-4dfa-97fc-879ce21ba39d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:02.125761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-580f709d-dfaa-4dfa-97fc-879ce21ba39d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:02.132126 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-580f709d-dfaa-4dfa-97fc-879ce21ba39d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:02.132580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-580f709d-dfaa-4dfa-97fc-879ce21ba39d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:02.133350 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-580f709d-dfaa-4dfa-97fc-879ce21ba39d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:02.133790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-580f709d-dfaa-4dfa-97fc-879ce21ba39d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:02.195446 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-580f709d-dfaa-4dfa-97fc-879ce21ba39d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:02.203370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-580f709d-dfaa-4dfa-97fc-879ce21ba39d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081695 Jul 21 22:24:02.203941 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 801/1724] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:02 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:03.137750 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5d08adf5-d99f-42c1-ad8b-0b9a81d3a98b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:03.138358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5d08adf5-d99f-42c1-ad8b-0b9a81d3a98b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:03.139893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-82605ed6-0984-4b9f-b00c-ac18e7efd4a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:03.140509 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-82605ed6-0984-4b9f-b00c-ac18e7efd4a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:03.145424 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d08adf5-d99f-42c1-ad8b-0b9a81d3a98b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:03.145881 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d08adf5-d99f-42c1-ad8b-0b9a81d3a98b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:03.146672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d08adf5-d99f-42c1-ad8b-0b9a81d3a98b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:03.147138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5d08adf5-d99f-42c1-ad8b-0b9a81d3a98b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:03.147363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-82605ed6-0984-4b9f-b00c-ac18e7efd4a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:03.147815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-82605ed6-0984-4b9f-b00c-ac18e7efd4a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:03.148620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-82605ed6-0984-4b9f-b00c-ac18e7efd4a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:03.149063 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-82605ed6-0984-4b9f-b00c-ac18e7efd4a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:03.342294 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-82605ed6-0984-4b9f-b00c-ac18e7efd4a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:03.350835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-82605ed6-0984-4b9f-b00c-ac18e7efd4a9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.214495 Jul 21 22:24:03.351331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 802/1725] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:03 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:03.353323 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5d08adf5-d99f-42c1-ad8b-0b9a81d3a98b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:03.355781 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-07e49845-f130-42bd-afe9-406966cb058f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:03.356362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-07e49845-f130-42bd-afe9-406966cb058f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:03.362149 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07e49845-f130-42bd-afe9-406966cb058f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:03.362321 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5d08adf5-d99f-42c1-ad8b-0b9a81d3a98b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.228069 Jul 21 22:24:03.362597 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07e49845-f130-42bd-afe9-406966cb058f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:03.362715 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 924/1726] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:03 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:03.363412 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07e49845-f130-42bd-afe9-406966cb058f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:03.363864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07e49845-f130-42bd-afe9-406966cb058f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:03.425815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-07e49845-f130-42bd-afe9-406966cb058f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:03.433729 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-07e49845-f130-42bd-afe9-406966cb058f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081460 Jul 21 22:24:03.434308 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 803/1727] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:03 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:04.368143 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0f3725bc-c1e5-4030-a910-e61a5e54537a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:04.368730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0f3725bc-c1e5-4030-a910-e61a5e54537a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:04.375437 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0f3725bc-c1e5-4030-a910-e61a5e54537a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:04.375885 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0f3725bc-c1e5-4030-a910-e61a5e54537a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:04.376648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0f3725bc-c1e5-4030-a910-e61a5e54537a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:04.377080 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0f3725bc-c1e5-4030-a910-e61a5e54537a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:04.379039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5079216f-f0ba-4082-a44f-7e000eb6a0ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:04.379652 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5079216f-f0ba-4082-a44f-7e000eb6a0ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:04.386090 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5079216f-f0ba-4082-a44f-7e000eb6a0ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:04.386543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5079216f-f0ba-4082-a44f-7e000eb6a0ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:04.387415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5079216f-f0ba-4082-a44f-7e000eb6a0ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:04.387857 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5079216f-f0ba-4082-a44f-7e000eb6a0ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:04.575335 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0f3725bc-c1e5-4030-a910-e61a5e54537a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:04.578421 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5079216f-f0ba-4082-a44f-7e000eb6a0ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:04.583861 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0f3725bc-c1e5-4030-a910-e61a5e54537a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.219917 Jul 21 22:24:04.584511 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 925/1728] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:04 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:04.587297 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5079216f-f0ba-4082-a44f-7e000eb6a0ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.212042 Jul 21 22:24:04.588002 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 804/1729] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:04 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:04.588853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3973f33e-3df1-4dc8-a0f5-0898e6c79660 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:04.589450 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3973f33e-3df1-4dc8-a0f5-0898e6c79660 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:04.596014 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3973f33e-3df1-4dc8-a0f5-0898e6c79660 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:04.596457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3973f33e-3df1-4dc8-a0f5-0898e6c79660 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:04.597218 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3973f33e-3df1-4dc8-a0f5-0898e6c79660 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:04.597647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3973f33e-3df1-4dc8-a0f5-0898e6c79660 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:04.658023 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3973f33e-3df1-4dc8-a0f5-0898e6c79660 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:04.665841 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3973f33e-3df1-4dc8-a0f5-0898e6c79660 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080409 Jul 21 22:24:04.666398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 926/1730] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:04 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:05.601229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f124eb0b-f787-4195-95b5-d9e9e7692a17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:05.601845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f124eb0b-f787-4195-95b5-d9e9e7692a17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:05.605252 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6c75324d-3ad9-4803-9867-f02ad3e79e8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:05.605895 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6c75324d-3ad9-4803-9867-f02ad3e79e8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:05.608400 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f124eb0b-f787-4195-95b5-d9e9e7692a17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:05.608856 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f124eb0b-f787-4195-95b5-d9e9e7692a17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:05.609632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f124eb0b-f787-4195-95b5-d9e9e7692a17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:05.610073 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f124eb0b-f787-4195-95b5-d9e9e7692a17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:05.612018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c75324d-3ad9-4803-9867-f02ad3e79e8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:05.612473 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c75324d-3ad9-4803-9867-f02ad3e79e8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:05.613235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c75324d-3ad9-4803-9867-f02ad3e79e8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:05.613675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6c75324d-3ad9-4803-9867-f02ad3e79e8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:05.614031 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:05.631966 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:05.801125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f124eb0b-f787-4195-95b5-d9e9e7692a17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:05.807824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6c75324d-3ad9-4803-9867-f02ad3e79e8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:05.809157 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f124eb0b-f787-4195-95b5-d9e9e7692a17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.211739 Jul 21 22:24:05.809745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 805/1731] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:05 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:05.815105 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3edef5cb-c4c9-4d98-83c3-1cecaec7959d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:05.815788 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3edef5cb-c4c9-4d98-83c3-1cecaec7959d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:05.816640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6c75324d-3ad9-4803-9867-f02ad3e79e8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.215088 Jul 21 22:24:05.817354 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 927/1732] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:05 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:05.822621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3edef5cb-c4c9-4d98-83c3-1cecaec7959d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:05.823181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3edef5cb-c4c9-4d98-83c3-1cecaec7959d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:05.823954 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3edef5cb-c4c9-4d98-83c3-1cecaec7959d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:05.824393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3edef5cb-c4c9-4d98-83c3-1cecaec7959d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:05.888420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3edef5cb-c4c9-4d98-83c3-1cecaec7959d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:05.897732 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3edef5cb-c4c9-4d98-83c3-1cecaec7959d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.086863 Jul 21 22:24:05.898321 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 806/1733] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:05 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:06.826818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1f7e9bce-e543-42d1-be90-4f92a0d6c437 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:06.827523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1f7e9bce-e543-42d1-be90-4f92a0d6c437 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:06.833215 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4994377c-334f-4c5e-90d1-ddb7e67434ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:06.833833 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4994377c-334f-4c5e-90d1-ddb7e67434ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:06.834479 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f7e9bce-e543-42d1-be90-4f92a0d6c437 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:06.834932 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f7e9bce-e543-42d1-be90-4f92a0d6c437 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:06.835736 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f7e9bce-e543-42d1-be90-4f92a0d6c437 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:06.836172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1f7e9bce-e543-42d1-be90-4f92a0d6c437 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:06.840790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4994377c-334f-4c5e-90d1-ddb7e67434ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:06.841240 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4994377c-334f-4c5e-90d1-ddb7e67434ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:06.842045 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4994377c-334f-4c5e-90d1-ddb7e67434ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:06.842483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4994377c-334f-4c5e-90d1-ddb7e67434ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:07.046756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1f7e9bce-e543-42d1-be90-4f92a0d6c437 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:07.049461 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4994377c-334f-4c5e-90d1-ddb7e67434ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:07.054914 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1f7e9bce-e543-42d1-be90-4f92a0d6c437 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.231960 Jul 21 22:24:07.055520 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 928/1734] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:06 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:07.058383 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4994377c-334f-4c5e-90d1-ddb7e67434ec tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.229426 Jul 21 22:24:07.059187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 807/1735] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:06 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:07.060118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7ebe2bf6-2521-49da-a1da-dbc553a8f451 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:07.060904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7ebe2bf6-2521-49da-a1da-dbc553a8f451 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:07.067221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ebe2bf6-2521-49da-a1da-dbc553a8f451 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:07.067676 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ebe2bf6-2521-49da-a1da-dbc553a8f451 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:07.068445 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ebe2bf6-2521-49da-a1da-dbc553a8f451 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:07.068890 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ebe2bf6-2521-49da-a1da-dbc553a8f451 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:07.129028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7ebe2bf6-2521-49da-a1da-dbc553a8f451 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:07.136765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7ebe2bf6-2521-49da-a1da-dbc553a8f451 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080320 Jul 21 22:24:07.137345 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 929/1736] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:07 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:08.072360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-42afa8e2-7f09-43fc-af59-0facdd5e3576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:08.072959 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-42afa8e2-7f09-43fc-af59-0facdd5e3576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:08.075607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9b50bc3d-c6cb-42e4-b8d2-64e268d8b458 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:08.076225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9b50bc3d-c6cb-42e4-b8d2-64e268d8b458 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:08.080028 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42afa8e2-7f09-43fc-af59-0facdd5e3576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:08.080475 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42afa8e2-7f09-43fc-af59-0facdd5e3576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:08.081239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42afa8e2-7f09-43fc-af59-0facdd5e3576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:08.081675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42afa8e2-7f09-43fc-af59-0facdd5e3576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:08.083362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b50bc3d-c6cb-42e4-b8d2-64e268d8b458 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:08.083817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b50bc3d-c6cb-42e4-b8d2-64e268d8b458 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:08.084627 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b50bc3d-c6cb-42e4-b8d2-64e268d8b458 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:08.085065 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b50bc3d-c6cb-42e4-b8d2-64e268d8b458 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:08.274257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-42afa8e2-7f09-43fc-af59-0facdd5e3576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:08.278329 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9b50bc3d-c6cb-42e4-b8d2-64e268d8b458 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:08.282809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-42afa8e2-7f09-43fc-af59-0facdd5e3576 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.213761 Jul 21 22:24:08.283413 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 808/1737] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:08 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:08.287115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9b50bc3d-c6cb-42e4-b8d2-64e268d8b458 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.215241 Jul 21 22:24:08.287818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 930/1738] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:08 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:08.287955 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d2136564-34fb-4078-bec7-8dcaf251f3db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:08.288347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d2136564-34fb-4078-bec7-8dcaf251f3db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:08.294061 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d2136564-34fb-4078-bec7-8dcaf251f3db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:08.294508 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d2136564-34fb-4078-bec7-8dcaf251f3db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:08.295297 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d2136564-34fb-4078-bec7-8dcaf251f3db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:08.295736 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d2136564-34fb-4078-bec7-8dcaf251f3db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:08.355803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d2136564-34fb-4078-bec7-8dcaf251f3db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:08.363563 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d2136564-34fb-4078-bec7-8dcaf251f3db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079233 Jul 21 22:24:08.364121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 809/1739] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:08 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:09.302216 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ddff3be3-a963-4dc7-bcd2-5fb322e3c5ee tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:09.302764 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ddff3be3-a963-4dc7-bcd2-5fb322e3c5ee tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:09.303865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d041874c-631b-4018-a253-3c3f13b0906b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:09.304478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d041874c-631b-4018-a253-3c3f13b0906b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:09.309312 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddff3be3-a963-4dc7-bcd2-5fb322e3c5ee tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:09.309766 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddff3be3-a963-4dc7-bcd2-5fb322e3c5ee tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:09.310532 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddff3be3-a963-4dc7-bcd2-5fb322e3c5ee tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:09.310904 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d041874c-631b-4018-a253-3c3f13b0906b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:09.311037 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddff3be3-a963-4dc7-bcd2-5fb322e3c5ee tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:09.311386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d041874c-631b-4018-a253-3c3f13b0906b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:09.312151 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d041874c-631b-4018-a253-3c3f13b0906b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:09.312581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d041874c-631b-4018-a253-3c3f13b0906b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:09.499351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ddff3be3-a963-4dc7-bcd2-5fb322e3c5ee tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:09.507547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ddff3be3-a963-4dc7-bcd2-5fb322e3c5ee tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.209141 Jul 21 22:24:09.507978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 931/1740] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:09 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:09.510223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d041874c-631b-4018-a253-3c3f13b0906b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:09.512541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a87026e4-3228-4789-a596-25b063fb8504 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:09.513140 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a87026e4-3228-4789-a596-25b063fb8504 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:09.518724 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d041874c-631b-4018-a253-3c3f13b0906b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.218669 Jul 21 22:24:09.519086 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a87026e4-3228-4789-a596-25b063fb8504 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:09.519526 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a87026e4-3228-4789-a596-25b063fb8504 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:09.520297 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a87026e4-3228-4789-a596-25b063fb8504 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:09.520565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 810/1741] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:09 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:09.520729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a87026e4-3228-4789-a596-25b063fb8504 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:09.583528 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a87026e4-3228-4789-a596-25b063fb8504 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:09.591384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a87026e4-3228-4789-a596-25b063fb8504 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082449 Jul 21 22:24:09.591943 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 932/1742] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:09 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:10.524575 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0bb78c9d-d4cb-4db9-a53e-d650621236bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:10.525115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0bb78c9d-d4cb-4db9-a53e-d650621236bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:10.531790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bb78c9d-d4cb-4db9-a53e-d650621236bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:10.532898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bb78c9d-d4cb-4db9-a53e-d650621236bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:10.533676 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bb78c9d-d4cb-4db9-a53e-d650621236bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:10.534116 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bb78c9d-d4cb-4db9-a53e-d650621236bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:10.535900 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-39043ce1-584c-40c8-a16c-5c817fb233d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:10.536520 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-39043ce1-584c-40c8-a16c-5c817fb233d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:10.542825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-39043ce1-584c-40c8-a16c-5c817fb233d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:10.543326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-39043ce1-584c-40c8-a16c-5c817fb233d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:10.544099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-39043ce1-584c-40c8-a16c-5c817fb233d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:10.544537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-39043ce1-584c-40c8-a16c-5c817fb233d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:10.727729 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0bb78c9d-d4cb-4db9-a53e-d650621236bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:10.730719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-39043ce1-584c-40c8-a16c-5c817fb233d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:10.735995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0bb78c9d-d4cb-4db9-a53e-d650621236bb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.215316 Jul 21 22:24:10.736581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 811/1743] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:10 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:10.738728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-39043ce1-584c-40c8-a16c-5c817fb233d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.207178 Jul 21 22:24:10.739452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 933/1744] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:10 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:10.741028 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-416d6e28-ba04-4ff8-a27e-81cae6172c80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:10.741637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-416d6e28-ba04-4ff8-a27e-81cae6172c80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:10.747271 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-416d6e28-ba04-4ff8-a27e-81cae6172c80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:10.747720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-416d6e28-ba04-4ff8-a27e-81cae6172c80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:10.748610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-416d6e28-ba04-4ff8-a27e-81cae6172c80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:10.749053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-416d6e28-ba04-4ff8-a27e-81cae6172c80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:10.808426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-416d6e28-ba04-4ff8-a27e-81cae6172c80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:10.816731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-416d6e28-ba04-4ff8-a27e-81cae6172c80 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079197 Jul 21 22:24:10.817302 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 812/1745] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:10 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:11.753409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4ca86e60-9c14-4ff7-b94d-73a7e8bb005b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:11.753964 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4ca86e60-9c14-4ff7-b94d-73a7e8bb005b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:11.754899 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-54620981-6d21-4a82-b8ee-d87eb2415180 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:11.755542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-54620981-6d21-4a82-b8ee-d87eb2415180 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:11.760497 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ca86e60-9c14-4ff7-b94d-73a7e8bb005b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:11.760947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ca86e60-9c14-4ff7-b94d-73a7e8bb005b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:11.761721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ca86e60-9c14-4ff7-b94d-73a7e8bb005b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:11.761952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-54620981-6d21-4a82-b8ee-d87eb2415180 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:11.762157 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ca86e60-9c14-4ff7-b94d-73a7e8bb005b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:11.762403 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-54620981-6d21-4a82-b8ee-d87eb2415180 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:11.763209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-54620981-6d21-4a82-b8ee-d87eb2415180 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:11.763651 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-54620981-6d21-4a82-b8ee-d87eb2415180 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:11.956840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4ca86e60-9c14-4ff7-b94d-73a7e8bb005b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:11.960004 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-54620981-6d21-4a82-b8ee-d87eb2415180 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:11.965521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4ca86e60-9c14-4ff7-b94d-73a7e8bb005b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.216015 Jul 21 22:24:11.966088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 934/1746] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:11 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:11.967932 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-54620981-6d21-4a82-b8ee-d87eb2415180 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.216772 Jul 21 22:24:11.968637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 813/1747] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:11 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:11.971782 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9ce17f77-d91d-4446-86fe-5afbd12e89c6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:11.972386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9ce17f77-d91d-4446-86fe-5afbd12e89c6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:11.980567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ce17f77-d91d-4446-86fe-5afbd12e89c6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:11.981028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ce17f77-d91d-4446-86fe-5afbd12e89c6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:11.984149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ce17f77-d91d-4446-86fe-5afbd12e89c6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:11.984603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ce17f77-d91d-4446-86fe-5afbd12e89c6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:12.048102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9ce17f77-d91d-4446-86fe-5afbd12e89c6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:12.055990 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9ce17f77-d91d-4446-86fe-5afbd12e89c6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.088985 Jul 21 22:24:12.056547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 935/1748] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:11 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:12.982723 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a05bea79-afbf-43ad-ac74-dac4c9edeccb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:12.983454 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a05bea79-afbf-43ad-ac74-dac4c9edeccb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:12.986208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e71c5fe8-f580-411f-b8ed-2b1305df82cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:12.986830 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e71c5fe8-f580-411f-b8ed-2b1305df82cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:12.990707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a05bea79-afbf-43ad-ac74-dac4c9edeccb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:12.991260 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a05bea79-afbf-43ad-ac74-dac4c9edeccb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:12.992031 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a05bea79-afbf-43ad-ac74-dac4c9edeccb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:12.992468 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a05bea79-afbf-43ad-ac74-dac4c9edeccb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:12.993398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e71c5fe8-f580-411f-b8ed-2b1305df82cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:12.993856 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e71c5fe8-f580-411f-b8ed-2b1305df82cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:12.994634 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e71c5fe8-f580-411f-b8ed-2b1305df82cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:12.995115 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e71c5fe8-f580-411f-b8ed-2b1305df82cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:13.193851 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a05bea79-afbf-43ad-ac74-dac4c9edeccb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:13.197729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e71c5fe8-f580-411f-b8ed-2b1305df82cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:13.202085 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a05bea79-afbf-43ad-ac74-dac4c9edeccb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.223253 Jul 21 22:24:13.202668 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 814/1749] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:12 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:13.205936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e71c5fe8-f580-411f-b8ed-2b1305df82cc tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.224052 Jul 21 22:24:13.206819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 936/1750] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:12 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:13.207203 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ffa1ad56-5263-4d63-bf34-e975dfb5445d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:13.207814 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ffa1ad56-5263-4d63-bf34-e975dfb5445d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:13.213533 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ffa1ad56-5263-4d63-bf34-e975dfb5445d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:13.213992 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ffa1ad56-5263-4d63-bf34-e975dfb5445d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:13.214750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ffa1ad56-5263-4d63-bf34-e975dfb5445d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:13.215320 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ffa1ad56-5263-4d63-bf34-e975dfb5445d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:13.280262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ffa1ad56-5263-4d63-bf34-e975dfb5445d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:13.288663 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ffa1ad56-5263-4d63-bf34-e975dfb5445d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085045 Jul 21 22:24:13.289243 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 815/1751] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:13 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:14.219912 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5f5d430f-fcc4-4b9a-9379-dc56a8cbd623 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:14.220520 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5f5d430f-fcc4-4b9a-9379-dc56a8cbd623 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:14.222691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-285aaa81-9676-4a1c-a467-f7e1cbbe4b48 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:14.223327 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-285aaa81-9676-4a1c-a467-f7e1cbbe4b48 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:14.227080 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5f5d430f-fcc4-4b9a-9379-dc56a8cbd623 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:14.227530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5f5d430f-fcc4-4b9a-9379-dc56a8cbd623 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:14.228296 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5f5d430f-fcc4-4b9a-9379-dc56a8cbd623 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:14.228728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5f5d430f-fcc4-4b9a-9379-dc56a8cbd623 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:14.229672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-285aaa81-9676-4a1c-a467-f7e1cbbe4b48 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:14.230123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-285aaa81-9676-4a1c-a467-f7e1cbbe4b48 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:14.230922 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-285aaa81-9676-4a1c-a467-f7e1cbbe4b48 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:14.231384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-285aaa81-9676-4a1c-a467-f7e1cbbe4b48 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:14.414742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5f5d430f-fcc4-4b9a-9379-dc56a8cbd623 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:14.422636 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5f5d430f-fcc4-4b9a-9379-dc56a8cbd623 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.206971 Jul 21 22:24:14.423234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 937/1752] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:14 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:14.428709 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-285aaa81-9676-4a1c-a467-f7e1cbbe4b48 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:14.430088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4d0e6a35-7db1-4487-ab23-512a600cfaad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:14.430689 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4d0e6a35-7db1-4487-ab23-512a600cfaad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:14.436578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-285aaa81-9676-4a1c-a467-f7e1cbbe4b48 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.217834 Jul 21 22:24:14.436734 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4d0e6a35-7db1-4487-ab23-512a600cfaad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:14.437309 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4d0e6a35-7db1-4487-ab23-512a600cfaad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:14.437442 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 816/1753] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:14 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:14.437833 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4d0e6a35-7db1-4487-ab23-512a600cfaad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:14.438268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4d0e6a35-7db1-4487-ab23-512a600cfaad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:14.499827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4d0e6a35-7db1-4487-ab23-512a600cfaad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:14.507799 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4d0e6a35-7db1-4487-ab23-512a600cfaad tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083637 Jul 21 22:24:14.508357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 938/1754] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:14 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:15.440892 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7666733c-bd4d-4186-ad27-0cc7cb29cdbd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:15.441504 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7666733c-bd4d-4186-ad27-0cc7cb29cdbd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:15.447938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7666733c-bd4d-4186-ad27-0cc7cb29cdbd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:15.448393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7666733c-bd4d-4186-ad27-0cc7cb29cdbd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:15.449244 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7666733c-bd4d-4186-ad27-0cc7cb29cdbd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:15.449683 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7666733c-bd4d-4186-ad27-0cc7cb29cdbd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:15.453206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a8b0b974-5dd8-4766-aa73-3eda67697073 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:15.453816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a8b0b974-5dd8-4766-aa73-3eda67697073 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:15.460826 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a8b0b974-5dd8-4766-aa73-3eda67697073 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:15.461282 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a8b0b974-5dd8-4766-aa73-3eda67697073 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:15.462056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a8b0b974-5dd8-4766-aa73-3eda67697073 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:15.462490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a8b0b974-5dd8-4766-aa73-3eda67697073 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:15.644785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7666733c-bd4d-4186-ad27-0cc7cb29cdbd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:15.651915 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a8b0b974-5dd8-4766-aa73-3eda67697073 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:15.653176 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7666733c-bd4d-4186-ad27-0cc7cb29cdbd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.216499 Jul 21 22:24:15.653980 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 817/1755] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:15 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:15.658661 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ddfeaa62-00a2-4b74-ac1b-5f580ccf9578 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:15.659371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ddfeaa62-00a2-4b74-ac1b-5f580ccf9578 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:15.660989 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a8b0b974-5dd8-4766-aa73-3eda67697073 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.211488 Jul 21 22:24:15.661896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 939/1756] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:15 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:15.665606 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ddfeaa62-00a2-4b74-ac1b-5f580ccf9578 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:15.666063 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ddfeaa62-00a2-4b74-ac1b-5f580ccf9578 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:15.666852 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ddfeaa62-00a2-4b74-ac1b-5f580ccf9578 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:15.667322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ddfeaa62-00a2-4b74-ac1b-5f580ccf9578 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:15.733007 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ddfeaa62-00a2-4b74-ac1b-5f580ccf9578 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:15.741443 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ddfeaa62-00a2-4b74-ac1b-5f580ccf9578 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.086724 Jul 21 22:24:15.742023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 818/1757] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:15 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:16.670972 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3014b580-f6b1-4a04-a941-886129c109a4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:16.671613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3014b580-f6b1-4a04-a941-886129c109a4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:16.678096 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3014b580-f6b1-4a04-a941-886129c109a4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:16.678543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3014b580-f6b1-4a04-a941-886129c109a4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:16.679334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3014b580-f6b1-4a04-a941-886129c109a4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:16.679766 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3014b580-f6b1-4a04-a941-886129c109a4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:16.681125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6cbc54b0-4000-4294-a616-c6662470a5d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:16.681743 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6cbc54b0-4000-4294-a616-c6662470a5d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:16.688340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6cbc54b0-4000-4294-a616-c6662470a5d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:16.688793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6cbc54b0-4000-4294-a616-c6662470a5d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:16.690057 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6cbc54b0-4000-4294-a616-c6662470a5d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:16.690490 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6cbc54b0-4000-4294-a616-c6662470a5d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:16.874406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3014b580-f6b1-4a04-a941-886129c109a4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:16.877832 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6cbc54b0-4000-4294-a616-c6662470a5d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:16.883304 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3014b580-f6b1-4a04-a941-886129c109a4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.216137 Jul 21 22:24:16.883881 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 940/1758] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:16 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:16.885561 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6cbc54b0-4000-4294-a616-c6662470a5d3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.208360 Jul 21 22:24:16.890875 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 819/1759] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:16 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:16.891055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ca130436-7433-48e2-8409-6a704a0bc2db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:16.891055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ca130436-7433-48e2-8409-6a704a0bc2db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:16.895361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ca130436-7433-48e2-8409-6a704a0bc2db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:16.895863 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ca130436-7433-48e2-8409-6a704a0bc2db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:16.896640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ca130436-7433-48e2-8409-6a704a0bc2db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:16.897081 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ca130436-7433-48e2-8409-6a704a0bc2db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:16.958703 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ca130436-7433-48e2-8409-6a704a0bc2db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:16.966705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ca130436-7433-48e2-8409-6a704a0bc2db tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081898 Jul 21 22:24:16.967330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 941/1760] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:16 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:17.900586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6fdfb951-7f78-4c62-bbb4-beacd84d400b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:17.901234 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6fdfb951-7f78-4c62-bbb4-beacd84d400b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:17.903226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5a95157b-d887-40ac-a1a5-41ce7e1e2ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:17.903838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5a95157b-d887-40ac-a1a5-41ce7e1e2ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:17.907797 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6fdfb951-7f78-4c62-bbb4-beacd84d400b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:17.908293 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6fdfb951-7f78-4c62-bbb4-beacd84d400b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:17.909611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6fdfb951-7f78-4c62-bbb4-beacd84d400b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:17.910055 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6fdfb951-7f78-4c62-bbb4-beacd84d400b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:17.911092 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a95157b-d887-40ac-a1a5-41ce7e1e2ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:17.911539 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a95157b-d887-40ac-a1a5-41ce7e1e2ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:17.912296 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a95157b-d887-40ac-a1a5-41ce7e1e2ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:17.912727 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a95157b-d887-40ac-a1a5-41ce7e1e2ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:18.097936 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6fdfb951-7f78-4c62-bbb4-beacd84d400b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:18.105845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6fdfb951-7f78-4c62-bbb4-beacd84d400b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.209313 Jul 21 22:24:18.106417 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 820/1761] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:17 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:18.110765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-63e806d2-7cc9-4b43-9550-658870fba6a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:18.111487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-63e806d2-7cc9-4b43-9550-658870fba6a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:18.111630 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5a95157b-d887-40ac-a1a5-41ce7e1e2ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:18.117342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63e806d2-7cc9-4b43-9550-658870fba6a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:18.117791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63e806d2-7cc9-4b43-9550-658870fba6a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:18.118588 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63e806d2-7cc9-4b43-9550-658870fba6a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:18.119041 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63e806d2-7cc9-4b43-9550-658870fba6a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:18.119648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5a95157b-d887-40ac-a1a5-41ce7e1e2ae6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.220250 Jul 21 22:24:18.120214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 942/1762] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:17 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:18.179395 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-63e806d2-7cc9-4b43-9550-658870fba6a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:18.182694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:18.188029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-63e806d2-7cc9-4b43-9550-658870fba6a7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080699 Jul 21 22:24:18.188601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 821/1763] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:18 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:19.122963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a7bb5118-2f73-47a2-8f65-d919ecf8d25c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:19.123597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a7bb5118-2f73-47a2-8f65-d919ecf8d25c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:19.130561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7bb5118-2f73-47a2-8f65-d919ecf8d25c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:19.131029 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7bb5118-2f73-47a2-8f65-d919ecf8d25c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:19.131822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7bb5118-2f73-47a2-8f65-d919ecf8d25c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:19.132298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a7bb5118-2f73-47a2-8f65-d919ecf8d25c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:19.137177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-00a5d9e2-18ba-4d2c-b83b-76e8feb331fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:19.137787 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-00a5d9e2-18ba-4d2c-b83b-76e8feb331fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:19.144770 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00a5d9e2-18ba-4d2c-b83b-76e8feb331fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:19.145218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00a5d9e2-18ba-4d2c-b83b-76e8feb331fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:19.146015 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00a5d9e2-18ba-4d2c-b83b-76e8feb331fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:19.146452 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00a5d9e2-18ba-4d2c-b83b-76e8feb331fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:19.327781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a7bb5118-2f73-47a2-8f65-d919ecf8d25c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:19.331906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-00a5d9e2-18ba-4d2c-b83b-76e8feb331fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:19.335780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a7bb5118-2f73-47a2-8f65-d919ecf8d25c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.216733 Jul 21 22:24:19.336357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 943/1764] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:19 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:19.339844 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-00a5d9e2-18ba-4d2c-b83b-76e8feb331fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.206722 Jul 21 22:24:19.340592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 822/1765] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:19 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:19.340811 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-694721c5-0088-41dc-8b4a-1d6c94e59dfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:19.341389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-694721c5-0088-41dc-8b4a-1d6c94e59dfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:19.347858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-694721c5-0088-41dc-8b4a-1d6c94e59dfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:19.348311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-694721c5-0088-41dc-8b4a-1d6c94e59dfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:19.349086 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-694721c5-0088-41dc-8b4a-1d6c94e59dfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:19.349522 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-694721c5-0088-41dc-8b4a-1d6c94e59dfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:19.353550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:19.411215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-694721c5-0088-41dc-8b4a-1d6c94e59dfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:19.419069 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-694721c5-0088-41dc-8b4a-1d6c94e59dfa tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081753 Jul 21 22:24:19.419641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 944/1766] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:19 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:19.637400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:24:19.637598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:24:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:24:20.353008 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4465336b-67f3-4e1a-b484-8abdd5e391b7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:20.353630 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4465336b-67f3-4e1a-b484-8abdd5e391b7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:20.356828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-aae59d2a-228c-492e-9324-5873505bdde1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:20.357437 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-aae59d2a-228c-492e-9324-5873505bdde1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:20.359876 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4465336b-67f3-4e1a-b484-8abdd5e391b7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:20.360332 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4465336b-67f3-4e1a-b484-8abdd5e391b7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:20.361101 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4465336b-67f3-4e1a-b484-8abdd5e391b7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:20.361540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4465336b-67f3-4e1a-b484-8abdd5e391b7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:20.363866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aae59d2a-228c-492e-9324-5873505bdde1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:20.364316 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aae59d2a-228c-492e-9324-5873505bdde1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:20.365075 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aae59d2a-228c-492e-9324-5873505bdde1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:20.365510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aae59d2a-228c-492e-9324-5873505bdde1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:20.511183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-aae59d2a-228c-492e-9324-5873505bdde1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:20.519953 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-aae59d2a-228c-492e-9324-5873505bdde1 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.166814 Jul 21 22:24:20.520502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 945/1767] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:20 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:20.525005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-92abb0b5-488a-4f11-9078-ca5daba2a820 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:20.525618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-92abb0b5-488a-4f11-9078-ca5daba2a820 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:20.531515 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92abb0b5-488a-4f11-9078-ca5daba2a820 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:20.531972 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92abb0b5-488a-4f11-9078-ca5daba2a820 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:20.532748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92abb0b5-488a-4f11-9078-ca5daba2a820 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:20.533184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92abb0b5-488a-4f11-9078-ca5daba2a820 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:20.609362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-92abb0b5-488a-4f11-9078-ca5daba2a820 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:20.617304 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-92abb0b5-488a-4f11-9078-ca5daba2a820 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.095862 Jul 21 22:24:20.617876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 946/1768] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:20 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:20.668325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4465336b-67f3-4e1a-b484-8abdd5e391b7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:20.676225 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4465336b-67f3-4e1a-b484-8abdd5e391b7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.327110 Jul 21 22:24:20.676792 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 823/1769] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:20 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:21.537767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3e5e61a0-b625-4bf1-935e-ec96ddb87696 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:21.538384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3e5e61a0-b625-4bf1-935e-ec96ddb87696 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:21.544891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3e5e61a0-b625-4bf1-935e-ec96ddb87696 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:21.545382 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3e5e61a0-b625-4bf1-935e-ec96ddb87696 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:21.546156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3e5e61a0-b625-4bf1-935e-ec96ddb87696 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:21.546598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3e5e61a0-b625-4bf1-935e-ec96ddb87696 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:21.633570 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-87c349a0-0cc5-4ca7-bbe9-92f117c6f153 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:21.634179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-87c349a0-0cc5-4ca7-bbe9-92f117c6f153 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:21.640691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-87c349a0-0cc5-4ca7-bbe9-92f117c6f153 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:21.641143 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-87c349a0-0cc5-4ca7-bbe9-92f117c6f153 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:21.641913 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-87c349a0-0cc5-4ca7-bbe9-92f117c6f153 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:21.642352 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-87c349a0-0cc5-4ca7-bbe9-92f117c6f153 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:21.678787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3e5e61a0-b625-4bf1-935e-ec96ddb87696 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:21.686951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3e5e61a0-b625-4bf1-935e-ec96ddb87696 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.153763 Jul 21 22:24:21.687745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 947/1770] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:21 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:21.693250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3c34f766-5c71-4851-a4f7-424ec6673ea5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:21.693858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3c34f766-5c71-4851-a4f7-424ec6673ea5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:21.699932 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3c34f766-5c71-4851-a4f7-424ec6673ea5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:21.700384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3c34f766-5c71-4851-a4f7-424ec6673ea5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:21.701150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3c34f766-5c71-4851-a4f7-424ec6673ea5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:21.701590 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3c34f766-5c71-4851-a4f7-424ec6673ea5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:21.707204 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-87c349a0-0cc5-4ca7-bbe9-92f117c6f153 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:21.715076 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-87c349a0-0cc5-4ca7-bbe9-92f117c6f153 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085316 Jul 21 22:24:21.715638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 824/1771] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:21 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:21.831704 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3c34f766-5c71-4851-a4f7-424ec6673ea5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:21.839742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3c34f766-5c71-4851-a4f7-424ec6673ea5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150180 Jul 21 22:24:21.840319 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 948/1772] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:21 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:22.704028 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-25688b0c-6b29-4ad7-8339-53b1d7fbfed2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:22.704673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-25688b0c-6b29-4ad7-8339-53b1d7fbfed2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:22.712006 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25688b0c-6b29-4ad7-8339-53b1d7fbfed2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:22.712459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25688b0c-6b29-4ad7-8339-53b1d7fbfed2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:22.713236 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25688b0c-6b29-4ad7-8339-53b1d7fbfed2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:22.713672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25688b0c-6b29-4ad7-8339-53b1d7fbfed2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:22.732137 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c7e36a76-f8a8-44dc-8316-97e1f90aca99 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:22.732757 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c7e36a76-f8a8-44dc-8316-97e1f90aca99 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:22.739379 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c7e36a76-f8a8-44dc-8316-97e1f90aca99 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:22.739827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c7e36a76-f8a8-44dc-8316-97e1f90aca99 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:22.740601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c7e36a76-f8a8-44dc-8316-97e1f90aca99 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:22.741037 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c7e36a76-f8a8-44dc-8316-97e1f90aca99 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:22.808732 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c7e36a76-f8a8-44dc-8316-97e1f90aca99 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:22.817169 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c7e36a76-f8a8-44dc-8316-97e1f90aca99 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.088861 Jul 21 22:24:22.817960 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 949/1773] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:22 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:22.857648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4b1a5230-1068-4204-ad3a-dd8fcdbb849b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:22.858278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4b1a5230-1068-4204-ad3a-dd8fcdbb849b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:22.864285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b1a5230-1068-4204-ad3a-dd8fcdbb849b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:22.864733 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b1a5230-1068-4204-ad3a-dd8fcdbb849b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:22.865529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b1a5230-1068-4204-ad3a-dd8fcdbb849b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:22.865750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-25688b0c-6b29-4ad7-8339-53b1d7fbfed2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:22.865943 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4b1a5230-1068-4204-ad3a-dd8fcdbb849b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:22.873907 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-25688b0c-6b29-4ad7-8339-53b1d7fbfed2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.173700 Jul 21 22:24:22.874614 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 825/1774] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:22 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:22.992759 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4b1a5230-1068-4204-ad3a-dd8fcdbb849b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:23.000496 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4b1a5230-1068-4204-ad3a-dd8fcdbb849b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146674 Jul 21 22:24:23.001064 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 950/1775] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:22 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:23.834319 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-00a8cb0e-1233-4529-a41e-da16180a463c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:23.834897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-00a8cb0e-1233-4529-a41e-da16180a463c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:23.841558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00a8cb0e-1233-4529-a41e-da16180a463c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:23.842010 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00a8cb0e-1233-4529-a41e-da16180a463c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:23.842787 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00a8cb0e-1233-4529-a41e-da16180a463c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:23.843260 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00a8cb0e-1233-4529-a41e-da16180a463c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:23.891415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-30bc1444-a644-4b02-8081-561e90b923c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:23.892032 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-30bc1444-a644-4b02-8081-561e90b923c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:23.898973 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-30bc1444-a644-4b02-8081-561e90b923c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:23.899463 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-30bc1444-a644-4b02-8081-561e90b923c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:23.900240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-30bc1444-a644-4b02-8081-561e90b923c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:23.900678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-30bc1444-a644-4b02-8081-561e90b923c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:23.904231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-00a8cb0e-1233-4529-a41e-da16180a463c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:23.912726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-00a8cb0e-1233-4529-a41e-da16180a463c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082793 Jul 21 22:24:23.913288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 826/1776] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:23 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:24.019524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7d828dfd-c47a-41e4-b00b-304355a1cddd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:24.020133 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7d828dfd-c47a-41e4-b00b-304355a1cddd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:24.026380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7d828dfd-c47a-41e4-b00b-304355a1cddd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:24.026838 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7d828dfd-c47a-41e4-b00b-304355a1cddd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:24.027703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7d828dfd-c47a-41e4-b00b-304355a1cddd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:24.028150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7d828dfd-c47a-41e4-b00b-304355a1cddd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:24.034748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-30bc1444-a644-4b02-8081-561e90b923c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:24.042798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-30bc1444-a644-4b02-8081-561e90b923c3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.155151 Jul 21 22:24:24.043404 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 951/1777] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:23 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:24.386023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7d828dfd-c47a-41e4-b00b-304355a1cddd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:24.394541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7d828dfd-c47a-41e4-b00b-304355a1cddd tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.379377 Jul 21 22:24:24.395125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 827/1778] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:24 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:24.930202 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f1f1bf48-aa52-4858-9d49-dcc97541ce79 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:24.930818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f1f1bf48-aa52-4858-9d49-dcc97541ce79 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:24.937322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1f1bf48-aa52-4858-9d49-dcc97541ce79 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:24.937784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1f1bf48-aa52-4858-9d49-dcc97541ce79 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:24.938548 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1f1bf48-aa52-4858-9d49-dcc97541ce79 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:24.938986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1f1bf48-aa52-4858-9d49-dcc97541ce79 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:24.998724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f1f1bf48-aa52-4858-9d49-dcc97541ce79 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:25.006620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f1f1bf48-aa52-4858-9d49-dcc97541ce79 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080297 Jul 21 22:24:25.007203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 952/1779] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:24 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:25.062363 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-30d9b1a5-06c3-46d1-bb74-734b26943b31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:25.062983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-30d9b1a5-06c3-46d1-bb74-734b26943b31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:25.069407 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30d9b1a5-06c3-46d1-bb74-734b26943b31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:25.069869 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30d9b1a5-06c3-46d1-bb74-734b26943b31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:25.070638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30d9b1a5-06c3-46d1-bb74-734b26943b31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:25.071109 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30d9b1a5-06c3-46d1-bb74-734b26943b31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:25.197549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-30d9b1a5-06c3-46d1-bb74-734b26943b31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:25.205383 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-30d9b1a5-06c3-46d1-bb74-734b26943b31 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146935 Jul 21 22:24:25.205943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 828/1780] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:25 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:25.412178 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8b551cbe-a0d9-429f-b795-f4a44ee966df tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:25.412788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8b551cbe-a0d9-429f-b795-f4a44ee966df tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:25.418843 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8b551cbe-a0d9-429f-b795-f4a44ee966df tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:25.419326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8b551cbe-a0d9-429f-b795-f4a44ee966df tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:25.420090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8b551cbe-a0d9-429f-b795-f4a44ee966df tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:25.420527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8b551cbe-a0d9-429f-b795-f4a44ee966df tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:25.549308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8b551cbe-a0d9-429f-b795-f4a44ee966df tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:25.557353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8b551cbe-a0d9-429f-b795-f4a44ee966df tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149655 Jul 21 22:24:25.557923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 953/1781] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:25 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:26.023994 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-38504bb1-bff2-4279-a7ab-69da80aad439 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:26.024607 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-38504bb1-bff2-4279-a7ab-69da80aad439 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:26.030583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-38504bb1-bff2-4279-a7ab-69da80aad439 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:26.031063 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-38504bb1-bff2-4279-a7ab-69da80aad439 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:26.031838 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-38504bb1-bff2-4279-a7ab-69da80aad439 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:26.032283 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-38504bb1-bff2-4279-a7ab-69da80aad439 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:26.091480 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-38504bb1-bff2-4279-a7ab-69da80aad439 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:26.099639 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-38504bb1-bff2-4279-a7ab-69da80aad439 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079532 Jul 21 22:24:26.100203 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 829/1782] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:26 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:26.222446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a5396436-d880-4e74-a550-98f21caeb7a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:26.223074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a5396436-d880-4e74-a550-98f21caeb7a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:26.229508 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a5396436-d880-4e74-a550-98f21caeb7a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:26.229956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a5396436-d880-4e74-a550-98f21caeb7a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:26.230708 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a5396436-d880-4e74-a550-98f21caeb7a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:26.231164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a5396436-d880-4e74-a550-98f21caeb7a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:26.357131 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a5396436-d880-4e74-a550-98f21caeb7a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:26.365746 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a5396436-d880-4e74-a550-98f21caeb7a8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147209 Jul 21 22:24:26.366317 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 954/1783] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:26 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:26.573792 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2c097877-b8ae-4174-943a-6a950649c419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:26.574338 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2c097877-b8ae-4174-943a-6a950649c419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:26.580298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2c097877-b8ae-4174-943a-6a950649c419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:26.580749 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2c097877-b8ae-4174-943a-6a950649c419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:26.581519 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2c097877-b8ae-4174-943a-6a950649c419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:26.581956 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2c097877-b8ae-4174-943a-6a950649c419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:26.709771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2c097877-b8ae-4174-943a-6a950649c419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:26.717583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2c097877-b8ae-4174-943a-6a950649c419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147897 Jul 21 22:24:26.718154 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 830/1784] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:26 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:27.116588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5dbf2d44-b7b5-434e-b49c-54835d5eea75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:27.117202 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5dbf2d44-b7b5-434e-b49c-54835d5eea75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:27.123347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5dbf2d44-b7b5-434e-b49c-54835d5eea75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:27.123799 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5dbf2d44-b7b5-434e-b49c-54835d5eea75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:27.124567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5dbf2d44-b7b5-434e-b49c-54835d5eea75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:27.125008 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5dbf2d44-b7b5-434e-b49c-54835d5eea75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:27.186174 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5dbf2d44-b7b5-434e-b49c-54835d5eea75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:27.194498 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5dbf2d44-b7b5-434e-b49c-54835d5eea75 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081950 Jul 21 22:24:27.195077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 955/1785] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:27 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:27.393309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-def839d2-226d-4751-9456-55b5f83e3306 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:27.393927 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-def839d2-226d-4751-9456-55b5f83e3306 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:27.400488 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-def839d2-226d-4751-9456-55b5f83e3306 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:27.401021 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-def839d2-226d-4751-9456-55b5f83e3306 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:27.401843 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-def839d2-226d-4751-9456-55b5f83e3306 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:27.402286 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-def839d2-226d-4751-9456-55b5f83e3306 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:27.531705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-def839d2-226d-4751-9456-55b5f83e3306 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:27.539523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-def839d2-226d-4751-9456-55b5f83e3306 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.159932 Jul 21 22:24:27.540091 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 831/1786] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:27 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:27.735668 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9aea4a92-dbc8-4cd1-bae0-9a1751566507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:27.736207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9aea4a92-dbc8-4cd1-bae0-9a1751566507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:27.744326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9aea4a92-dbc8-4cd1-bae0-9a1751566507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:27.744774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9aea4a92-dbc8-4cd1-bae0-9a1751566507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:27.745542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9aea4a92-dbc8-4cd1-bae0-9a1751566507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:27.745972 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9aea4a92-dbc8-4cd1-bae0-9a1751566507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:27.878525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9aea4a92-dbc8-4cd1-bae0-9a1751566507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:27.886289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9aea4a92-dbc8-4cd1-bae0-9a1751566507 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.154652 Jul 21 22:24:27.886847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 956/1787] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:27 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:28.211608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7c939862-ddb3-4535-b399-66ce139f858e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:28.212215 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7c939862-ddb3-4535-b399-66ce139f858e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:28.218709 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c939862-ddb3-4535-b399-66ce139f858e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:28.219438 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c939862-ddb3-4535-b399-66ce139f858e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:28.220218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c939862-ddb3-4535-b399-66ce139f858e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:28.220656 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c939862-ddb3-4535-b399-66ce139f858e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:28.281193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7c939862-ddb3-4535-b399-66ce139f858e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:28.289729 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7c939862-ddb3-4535-b399-66ce139f858e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081981 Jul 21 22:24:28.290312 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 832/1788] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:28 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:28.556406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d03ddddc-2eec-49c7-9e15-e48da11d87cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:28.557255 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d03ddddc-2eec-49c7-9e15-e48da11d87cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:28.563844 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d03ddddc-2eec-49c7-9e15-e48da11d87cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:28.564301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d03ddddc-2eec-49c7-9e15-e48da11d87cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:28.565076 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d03ddddc-2eec-49c7-9e15-e48da11d87cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:28.565516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d03ddddc-2eec-49c7-9e15-e48da11d87cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:28.694901 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d03ddddc-2eec-49c7-9e15-e48da11d87cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:28.702873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d03ddddc-2eec-49c7-9e15-e48da11d87cb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.150411 Jul 21 22:24:28.703467 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 957/1789] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:28 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:28.903257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5fe85858-4691-4103-b98c-37c4167a60c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:28.903905 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5fe85858-4691-4103-b98c-37c4167a60c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:28.909994 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5fe85858-4691-4103-b98c-37c4167a60c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:28.910442 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5fe85858-4691-4103-b98c-37c4167a60c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:28.911231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5fe85858-4691-4103-b98c-37c4167a60c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:28.911669 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5fe85858-4691-4103-b98c-37c4167a60c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:29.036127 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5fe85858-4691-4103-b98c-37c4167a60c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:29.044135 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5fe85858-4691-4103-b98c-37c4167a60c4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.144777 Jul 21 22:24:29.044701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 833/1790] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:28 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:29.306580 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-49e5e81d-872a-4781-9652-ac90fdc31bee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:29.307170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-49e5e81d-872a-4781-9652-ac90fdc31bee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:29.313179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49e5e81d-872a-4781-9652-ac90fdc31bee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:29.313625 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49e5e81d-872a-4781-9652-ac90fdc31bee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:29.314381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49e5e81d-872a-4781-9652-ac90fdc31bee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:29.315533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49e5e81d-872a-4781-9652-ac90fdc31bee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:29.374543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-49e5e81d-872a-4781-9652-ac90fdc31bee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:29.383128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-49e5e81d-872a-4781-9652-ac90fdc31bee tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080457 Jul 21 22:24:29.383714 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 958/1791] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:29 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:29.721202 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5bd08480-b322-4f44-9aeb-949d4e5e3869 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:29.721820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5bd08480-b322-4f44-9aeb-949d4e5e3869 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:29.724178 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=74 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:29.729509 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5bd08480-b322-4f44-9aeb-949d4e5e3869 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:29.729961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5bd08480-b322-4f44-9aeb-949d4e5e3869 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:29.730753 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5bd08480-b322-4f44-9aeb-949d4e5e3869 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:29.731229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5bd08480-b322-4f44-9aeb-949d4e5e3869 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:29.863484 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5bd08480-b322-4f44-9aeb-949d4e5e3869 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:29.871414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5bd08480-b322-4f44-9aeb-949d4e5e3869 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.154778 Jul 21 22:24:29.872216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 834/1792] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:29 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:30.061478 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-eaa17c5b-f818-4056-8dbd-b66af4d08799 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:30.062128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-eaa17c5b-f818-4056-8dbd-b66af4d08799 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:30.064402 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=78 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:30.069656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eaa17c5b-f818-4056-8dbd-b66af4d08799 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:30.070117 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eaa17c5b-f818-4056-8dbd-b66af4d08799 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:30.070888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eaa17c5b-f818-4056-8dbd-b66af4d08799 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:30.071350 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eaa17c5b-f818-4056-8dbd-b66af4d08799 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:30.202855 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-eaa17c5b-f818-4056-8dbd-b66af4d08799 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:30.212021 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-eaa17c5b-f818-4056-8dbd-b66af4d08799 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.154333 Jul 21 22:24:30.212677 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 959/1793] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:30 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:30.228835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-eb566313-c0ac-4cba-b46b-4a6970f9b42d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:30.229441 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-eb566313-c0ac-4cba-b46b-4a6970f9b42d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:30.235768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eb566313-c0ac-4cba-b46b-4a6970f9b42d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:30.236217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eb566313-c0ac-4cba-b46b-4a6970f9b42d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:30.236984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eb566313-c0ac-4cba-b46b-4a6970f9b42d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:30.237415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eb566313-c0ac-4cba-b46b-4a6970f9b42d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:30.262366 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-eb566313-c0ac-4cba-b46b-4a6970f9b42d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:24:30.337135 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-eb566313-c0ac-4cba-b46b-4a6970f9b42d tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "DELETE /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 204 len: 0 microversion: 2.1 time: 0.111789 Jul 21 22:24:30.338041 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 835/1794] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:24:30 2022] DELETE /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 21 22:24:30.346836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ea7ee885-e3b5-4ce6-b153-afd372ef9016 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:30.347504 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ea7ee885-e3b5-4ce6-b153-afd372ef9016 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:30.353529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea7ee885-e3b5-4ce6-b153-afd372ef9016 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:30.353977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea7ee885-e3b5-4ce6-b153-afd372ef9016 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:30.354735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea7ee885-e3b5-4ce6-b153-afd372ef9016 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:30.355210 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ea7ee885-e3b5-4ce6-b153-afd372ef9016 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:30.400898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1ff00583-9a96-4144-9293-61163f54dab2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:30.401757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1ff00583-9a96-4144-9293-61163f54dab2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:30.407853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ff00583-9a96-4144-9293-61163f54dab2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:30.408415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ff00583-9a96-4144-9293-61163f54dab2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:30.409273 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ff00583-9a96-4144-9293-61163f54dab2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:30.409783 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ff00583-9a96-4144-9293-61163f54dab2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:30.490855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1ff00583-9a96-4144-9293-61163f54dab2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:30.494378 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:30.499976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1ff00583-9a96-4144-9293-61163f54dab2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.103726 Jul 21 22:24:30.500562 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 836/1795] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:30 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:30.512111 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ea7ee885-e3b5-4ce6-b153-afd372ef9016 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:30.515599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:30.521075 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ea7ee885-e3b5-4ce6-b153-afd372ef9016 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1508 microversion: 2.1 time: 0.178409 Jul 21 22:24:30.521638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 960/1796] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:30 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:30.889114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a1699cb2-e2f2-4030-ae18-3d8be9def27d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:30.889812 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a1699cb2-e2f2-4030-ae18-3d8be9def27d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:30.896883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a1699cb2-e2f2-4030-ae18-3d8be9def27d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:30.897326 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a1699cb2-e2f2-4030-ae18-3d8be9def27d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:30.898123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a1699cb2-e2f2-4030-ae18-3d8be9def27d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:30.898557 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a1699cb2-e2f2-4030-ae18-3d8be9def27d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:31.025347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a1699cb2-e2f2-4030-ae18-3d8be9def27d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:31.033727 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a1699cb2-e2f2-4030-ae18-3d8be9def27d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148581 Jul 21 22:24:31.034299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 837/1797] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:30 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:31.229283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ba925775-785e-4564-8508-8c6aede3d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:31.229839 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ba925775-785e-4564-8508-8c6aede3d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:31.237205 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba925775-785e-4564-8508-8c6aede3d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:31.237652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba925775-785e-4564-8508-8c6aede3d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:31.238695 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba925775-785e-4564-8508-8c6aede3d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:31.239166 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ba925775-785e-4564-8508-8c6aede3d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:31.370749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ba925775-785e-4564-8508-8c6aede3d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:31.378704 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ba925775-785e-4564-8508-8c6aede3d68a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.153331 Jul 21 22:24:31.379285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 961/1798] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:31 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:31.517115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-71d2a5de-26ea-457c-bf95-67ae23ff50d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:31.518210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-71d2a5de-26ea-457c-bf95-67ae23ff50d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:31.524135 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-71d2a5de-26ea-457c-bf95-67ae23ff50d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:31.524581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-71d2a5de-26ea-457c-bf95-67ae23ff50d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:31.525362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-71d2a5de-26ea-457c-bf95-67ae23ff50d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:31.525802 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-71d2a5de-26ea-457c-bf95-67ae23ff50d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:31.538259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-66294301-c03c-4e25-b0cf-2de8f2224c87 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:31.539102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-66294301-c03c-4e25-b0cf-2de8f2224c87 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:31.545091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66294301-c03c-4e25-b0cf-2de8f2224c87 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:31.545549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66294301-c03c-4e25-b0cf-2de8f2224c87 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:31.546328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66294301-c03c-4e25-b0cf-2de8f2224c87 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:31.546773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66294301-c03c-4e25-b0cf-2de8f2224c87 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:31.589973 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-71d2a5de-26ea-457c-bf95-67ae23ff50d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:31.599209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-71d2a5de-26ea-457c-bf95-67ae23ff50d3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085829 Jul 21 22:24:31.599986 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 838/1799] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:31 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:31.682370 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-66294301-c03c-4e25-b0cf-2de8f2224c87 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:31.690659 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-66294301-c03c-4e25-b0cf-2de8f2224c87 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 200 len: 1508 microversion: 2.1 time: 0.156254 Jul 21 22:24:31.691259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 962/1800] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:31 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:31.900139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-f0196971-7401-411c-8948-bc93633f2271 req-530f334a-6893-463a-81c6-3f23dfa0413c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "996ecad7-3e17-4fda-ba01-cc79e9573422", "name": "network-vif-deleted", "tag": "04c59949-5420-433b-87b4-a24c499eb2ef"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:24:31.909437 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f0196971-7401-411c-8948-bc93633f2271 req-530f334a-6893-463a-81c6-3f23dfa0413c service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:31.909890 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f0196971-7401-411c-8948-bc93633f2271 req-530f334a-6893-463a-81c6-3f23dfa0413c service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:31.921129 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-f0196971-7401-411c-8948-bc93633f2271 req-530f334a-6893-463a-81c6-3f23dfa0413c service nova] Creating event network-vif-deleted:04c59949-5420-433b-87b4-a24c499eb2ef for instance 996ecad7-3e17-4fda-ba01-cc79e9573422 on hv-cinder-82002 Jul 21 22:24:31.926030 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-f0196971-7401-411c-8948-bc93633f2271 req-530f334a-6893-463a-81c6-3f23dfa0413c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029513 Jul 21 22:24:31.929564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 839/1801] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:24:32.051591 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3b2d87b9-71a1-4a32-8484-082be87a4717 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:32.052119 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3b2d87b9-71a1-4a32-8484-082be87a4717 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:32.058985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3b2d87b9-71a1-4a32-8484-082be87a4717 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:32.060101 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3b2d87b9-71a1-4a32-8484-082be87a4717 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:32.060885 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3b2d87b9-71a1-4a32-8484-082be87a4717 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:32.061318 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3b2d87b9-71a1-4a32-8484-082be87a4717 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:32.194630 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3b2d87b9-71a1-4a32-8484-082be87a4717 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:32.202724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3b2d87b9-71a1-4a32-8484-082be87a4717 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.155514 Jul 21 22:24:32.203344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 963/1802] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:32 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:32.396255 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6264878e-e432-4a01-8b6b-3ec0281f8d3f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:32.396980 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6264878e-e432-4a01-8b6b-3ec0281f8d3f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:32.403304 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6264878e-e432-4a01-8b6b-3ec0281f8d3f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:32.403754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6264878e-e432-4a01-8b6b-3ec0281f8d3f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:32.404512 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6264878e-e432-4a01-8b6b-3ec0281f8d3f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:32.404946 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6264878e-e432-4a01-8b6b-3ec0281f8d3f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:32.536096 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6264878e-e432-4a01-8b6b-3ec0281f8d3f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:32.544262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6264878e-e432-4a01-8b6b-3ec0281f8d3f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.152198 Jul 21 22:24:32.544842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 840/1803] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:32 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:32.616158 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8865a9ce-4a9e-42a0-b87e-093635529972 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:32.616682 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8865a9ce-4a9e-42a0-b87e-093635529972 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:32.623295 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8865a9ce-4a9e-42a0-b87e-093635529972 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:32.623811 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8865a9ce-4a9e-42a0-b87e-093635529972 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:32.624558 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8865a9ce-4a9e-42a0-b87e-093635529972 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:32.625017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8865a9ce-4a9e-42a0-b87e-093635529972 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:32.687592 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8865a9ce-4a9e-42a0-b87e-093635529972 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:32.695456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8865a9ce-4a9e-42a0-b87e-093635529972 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083745 Jul 21 22:24:32.696019 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 964/1804] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:32 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:32.707253 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0446de2c-4eb4-467c-b9c5-6f00e4119ad7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:32.707844 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0446de2c-4eb4-467c-b9c5-6f00e4119ad7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: 996ecad7-3e17-4fda-ba01-cc79e9573422] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:32.713742 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0446de2c-4eb4-467c-b9c5-6f00e4119ad7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:32.714190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0446de2c-4eb4-467c-b9c5-6f00e4119ad7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:32.714948 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0446de2c-4eb4-467c-b9c5-6f00e4119ad7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:32.715402 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0446de2c-4eb4-467c-b9c5-6f00e4119ad7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:32.728785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-0446de2c-4eb4-467c-b9c5-6f00e4119ad7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] HTTP exception thrown: Instance 996ecad7-3e17-4fda-ba01-cc79e9573422 could not be found. Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0446de2c-4eb4-467c-b9c5-6f00e4119ad7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Request method failure captured: Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 HTTP/1.1 Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwVKH3x76CuLrQiil_QeqLJlRAYmSLUZHyhOwQk8sbRI-otzlDmTsC_Kctl2BV_e4qPytbOqhX6MbzWcOccb260GCFJXJWi9_H7Q1wUqQIfe0FZjyO5tA1W0EjbS6iilwzkwC6l8IrYXJGCWbBByR_yHau1s1AOt2UBKhdQaZNk9xo Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 3f8010f68f0c4fd4ac77cb9221777078 Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:24:32.730389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:24:32.732123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f8010f68f0c4fd4ac77cb9221777078", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:24:32.732123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:24:32.732123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 3f8010f68f0c4fd4ac77cb9221777078 Jul 21 22:24:32.732123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:24:32.732123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-ServerRescueNegativeTestJSON-900258742-project Jul 21 22:24:32.732123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:24:32.732123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:24:32.732123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 40f128f6095f425eb5b2f7bcce092e5a Jul 21 22:24:32.732123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-ServerRescueNegativeTestJSON-900258742-project Jul 21 22:24:32.732123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:24:32.732123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance 996ecad7-3e17-4fda-ba01-cc79e9573422 could not be found. Jul 21 22:24:32.732123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': '996ecad7-3e17-4fda-ba01-cc79e9573422'} Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 996ecad7-3e17-4fda-ba01-cc79e9573422 could not be found. Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:24:32.732976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 996ecad7-3e17-4fda-ba01-cc79e9573422 could not be found. Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 996ecad7-3e17-4fda-ba01-cc79e9573422 could not be found. Jul 21 22:24:32.734322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:24:32.735731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0446de2c-4eb4-467c-b9c5-6f00e4119ad7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Returning 404 to user: Instance 996ecad7-3e17-4fda-ba01-cc79e9573422 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:24:32.735731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0446de2c-4eb4-467c-b9c5-6f00e4119ad7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422" status: 404 len: 111 microversion: 2.1 time: 0.028511 Jul 21 22:24:32.735731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 841/1805] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:32 2022] GET /compute/v2.1/servers/996ecad7-3e17-4fda-ba01-cc79e9573422 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:24:32.740466 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bcb3414e-5040-494a-ae31-a09747cab589 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:32.740955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bcb3414e-5040-494a-ae31-a09747cab589 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:32.746872 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bcb3414e-5040-494a-ae31-a09747cab589 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:32.747354 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bcb3414e-5040-494a-ae31-a09747cab589 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:32.748113 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bcb3414e-5040-494a-ae31-a09747cab589 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:32.748545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bcb3414e-5040-494a-ae31-a09747cab589 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:32.773345 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bcb3414e-5040-494a-ae31-a09747cab589 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Going to try to terminate instance {{(pid=117979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:24:32.846856 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bcb3414e-5040-494a-ae31-a09747cab589 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "DELETE /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 204 len: 0 microversion: 2.1 time: 0.109737 Jul 21 22:24:32.847506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 965/1806] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:24:32 2022] DELETE /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:24:32.855844 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-45e2eec3-f52b-4abd-83b6-92ca62cd8a4e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:32.856463 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-45e2eec3-f52b-4abd-83b6-92ca62cd8a4e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:32.862763 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-45e2eec3-f52b-4abd-83b6-92ca62cd8a4e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:32.863319 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-45e2eec3-f52b-4abd-83b6-92ca62cd8a4e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:32.864087 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-45e2eec3-f52b-4abd-83b6-92ca62cd8a4e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:32.864528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-45e2eec3-f52b-4abd-83b6-92ca62cd8a4e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:32.994249 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-45e2eec3-f52b-4abd-83b6-92ca62cd8a4e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:33.001884 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-45e2eec3-f52b-4abd-83b6-92ca62cd8a4e tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.150103 Jul 21 22:24:33.002455 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 842/1807] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:32 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:33.220633 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-037377d4-c92c-41e9-96e7-26d0ddc13f5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:33.221274 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-037377d4-c92c-41e9-96e7-26d0ddc13f5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:33.227583 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-037377d4-c92c-41e9-96e7-26d0ddc13f5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:33.228040 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-037377d4-c92c-41e9-96e7-26d0ddc13f5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:33.228820 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-037377d4-c92c-41e9-96e7-26d0ddc13f5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:33.229260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-037377d4-c92c-41e9-96e7-26d0ddc13f5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:33.355722 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-037377d4-c92c-41e9-96e7-26d0ddc13f5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:33.363552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-037377d4-c92c-41e9-96e7-26d0ddc13f5e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147423 Jul 21 22:24:33.364122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 966/1808] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:33 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:33.561791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-93268301-5eb6-452a-a182-b606297cc22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:33.562402 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-93268301-5eb6-452a-a182-b606297cc22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:33.569197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93268301-5eb6-452a-a182-b606297cc22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:33.569648 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93268301-5eb6-452a-a182-b606297cc22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:33.570414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93268301-5eb6-452a-a182-b606297cc22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:33.570854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93268301-5eb6-452a-a182-b606297cc22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:33.698845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-93268301-5eb6-452a-a182-b606297cc22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:33.706752 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-93268301-5eb6-452a-a182-b606297cc22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148932 Jul 21 22:24:33.707344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 843/1809] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:33 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:33.713150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ec7c670b-9ac2-4054-9879-603eb1828517 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:33.713878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ec7c670b-9ac2-4054-9879-603eb1828517 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:33.720897 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec7c670b-9ac2-4054-9879-603eb1828517 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:33.721338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec7c670b-9ac2-4054-9879-603eb1828517 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:33.722099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec7c670b-9ac2-4054-9879-603eb1828517 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:33.722529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ec7c670b-9ac2-4054-9879-603eb1828517 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:33.784697 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ec7c670b-9ac2-4054-9879-603eb1828517 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:33.794636 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ec7c670b-9ac2-4054-9879-603eb1828517 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084474 Jul 21 22:24:33.795234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 967/1810] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:33 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:34.019266 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d06fcdd6-27f7-49b5-a2aa-bc1305d269a7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:34.019768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d06fcdd6-27f7-49b5-a2aa-bc1305d269a7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:34.026396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d06fcdd6-27f7-49b5-a2aa-bc1305d269a7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:34.026853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d06fcdd6-27f7-49b5-a2aa-bc1305d269a7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:34.027674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d06fcdd6-27f7-49b5-a2aa-bc1305d269a7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:34.028119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d06fcdd6-27f7-49b5-a2aa-bc1305d269a7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:34.161263 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d06fcdd6-27f7-49b5-a2aa-bc1305d269a7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40f128f6095f425eb5b2f7bcce092e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f8010f68f0c4fd4ac77cb9221777078', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:34.168817 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d06fcdd6-27f7-49b5-a2aa-bc1305d269a7 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 200 len: 1520 microversion: 2.1 time: 0.153725 Jul 21 22:24:34.169392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 844/1811] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:34 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:34.352998 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-d4060e80-633c-42dc-b15e-d4a487edaceb req-bf8d402c-27bf-436f-b0f9-fd7b26ea7697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed6c5da-065f-40bc-9f21-154eda67c27a", "name": "network-vif-deleted", "tag": "b79b076d-b273-4ae6-94d4-f7a4aad57e4f"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:24:34.361432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-d4060e80-633c-42dc-b15e-d4a487edaceb req-bf8d402c-27bf-436f-b0f9-fd7b26ea7697 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:34.361860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-d4060e80-633c-42dc-b15e-d4a487edaceb req-bf8d402c-27bf-436f-b0f9-fd7b26ea7697 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:34.372758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-d4060e80-633c-42dc-b15e-d4a487edaceb req-bf8d402c-27bf-436f-b0f9-fd7b26ea7697 service nova] Creating event network-vif-deleted:b79b076d-b273-4ae6-94d4-f7a4aad57e4f for instance bed6c5da-065f-40bc-9f21-154eda67c27a on hv-cinder-82002 Jul 21 22:24:34.377626 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-d4060e80-633c-42dc-b15e-d4a487edaceb req-bf8d402c-27bf-436f-b0f9-fd7b26ea7697 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028195 Jul 21 22:24:34.378373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 968/1812] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:24:34.381362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dbe7b264-e676-4a11-94db-0afc98d1cd6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:34.381982 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dbe7b264-e676-4a11-94db-0afc98d1cd6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:34.388826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbe7b264-e676-4a11-94db-0afc98d1cd6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:34.389285 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbe7b264-e676-4a11-94db-0afc98d1cd6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:34.390070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbe7b264-e676-4a11-94db-0afc98d1cd6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:34.390540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbe7b264-e676-4a11-94db-0afc98d1cd6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:34.528711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dbe7b264-e676-4a11-94db-0afc98d1cd6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:34.536654 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dbe7b264-e676-4a11-94db-0afc98d1cd6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.159755 Jul 21 22:24:34.537221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 845/1813] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:34 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:34.726412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2d8cf7c4-d806-492e-b6eb-2eab5df7ba0c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:34.727139 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2d8cf7c4-d806-492e-b6eb-2eab5df7ba0c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:34.733552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2d8cf7c4-d806-492e-b6eb-2eab5df7ba0c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:34.733996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2d8cf7c4-d806-492e-b6eb-2eab5df7ba0c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:34.735720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2d8cf7c4-d806-492e-b6eb-2eab5df7ba0c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:34.737164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2d8cf7c4-d806-492e-b6eb-2eab5df7ba0c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:34.814773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2e39580f-4fde-413f-b78f-5613828e8d13 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:34.815496 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2e39580f-4fde-413f-b78f-5613828e8d13 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:34.822825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e39580f-4fde-413f-b78f-5613828e8d13 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:34.823311 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e39580f-4fde-413f-b78f-5613828e8d13 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:34.824306 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e39580f-4fde-413f-b78f-5613828e8d13 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:34.824754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2e39580f-4fde-413f-b78f-5613828e8d13 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:34.899367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2e39580f-4fde-413f-b78f-5613828e8d13 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:34.902374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2d8cf7c4-d806-492e-b6eb-2eab5df7ba0c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:34.910321 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2e39580f-4fde-413f-b78f-5613828e8d13 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.099059 Jul 21 22:24:34.911336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 846/1814] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:34 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:34.911498 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2d8cf7c4-d806-492e-b6eb-2eab5df7ba0c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.189714 Jul 21 22:24:34.912314 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 969/1815] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:34 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:35.186793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4ca9b6e1-5db5-4262-ac3a-26f083e0caf0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:35.187358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4ca9b6e1-5db5-4262-ac3a-26f083e0caf0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] [instance: bed6c5da-065f-40bc-9f21-154eda67c27a] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:35.193560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ca9b6e1-5db5-4262-ac3a-26f083e0caf0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:35.194009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ca9b6e1-5db5-4262-ac3a-26f083e0caf0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:35.194777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ca9b6e1-5db5-4262-ac3a-26f083e0caf0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:35.195248 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4ca9b6e1-5db5-4262-ac3a-26f083e0caf0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:35.208902 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-4ca9b6e1-5db5-4262-ac3a-26f083e0caf0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] HTTP exception thrown: Instance bed6c5da-065f-40bc-9f21-154eda67c27a could not be found. Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4ca9b6e1-5db5-4262-ac3a-26f083e0caf0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Request method failure captured: Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a HTTP/1.1 Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwVKH3x76CuLrQiil_QeqLJlRAYmSLUZHyhOwQk8sbRI-otzlDmTsC_Kctl2BV_e4qPytbOqhX6MbzWcOccb260GCFJXJWi9_H7Q1wUqQIfe0FZjyO5tA1W0EjbS6iilwzkwC6l8IrYXJGCWbBByR_yHau1s1AOt2UBKhdQaZNk9xo Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 3f8010f68f0c4fd4ac77cb9221777078 Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:24:35.210519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:24:35.212208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3f8010f68f0c4fd4ac77cb9221777078"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3f8010f68f0c4fd4ac77cb9221777078", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:24:35.212208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:24:35.212208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 3f8010f68f0c4fd4ac77cb9221777078 Jul 21 22:24:35.212208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-900258742 Jul 21 22:24:35.212208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-ServerRescueNegativeTestJSON-900258742-project Jul 21 22:24:35.212208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:24:35.212208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:24:35.212208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 40f128f6095f425eb5b2f7bcce092e5a Jul 21 22:24:35.212208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-ServerRescueNegativeTestJSON-900258742-project Jul 21 22:24:35.212208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:24:35.212208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance bed6c5da-065f-40bc-9f21-154eda67c27a could not be found. Jul 21 22:24:35.212208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': 'bed6c5da-065f-40bc-9f21-154eda67c27a'} Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed6c5da-065f-40bc-9f21-154eda67c27a could not be found. Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:24:35.213118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed6c5da-065f-40bc-9f21-154eda67c27a could not be found. Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed6c5da-065f-40bc-9f21-154eda67c27a could not be found. Jul 21 22:24:35.214589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:24:35.215951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4ca9b6e1-5db5-4262-ac3a-26f083e0caf0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] Returning 404 to user: Instance bed6c5da-065f-40bc-9f21-154eda67c27a could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:24:35.215951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4ca9b6e1-5db5-4262-ac3a-26f083e0caf0 tempest-ServerRescueNegativeTestJSON-900258742 tempest-ServerRescueNegativeTestJSON-900258742-project] 10.222.0.44 "GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a" status: 404 len: 111 microversion: 2.1 time: 0.029083 Jul 21 22:24:35.215951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 970/1816] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:35 2022] GET /compute/v2.1/servers/bed6c5da-065f-40bc-9f21-154eda67c27a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:24:35.553586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-720258ad-da35-4ccc-93a4-23ed8f718a98 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:35.554205 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-720258ad-da35-4ccc-93a4-23ed8f718a98 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:35.560731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-720258ad-da35-4ccc-93a4-23ed8f718a98 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:35.561187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-720258ad-da35-4ccc-93a4-23ed8f718a98 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:35.561975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-720258ad-da35-4ccc-93a4-23ed8f718a98 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:35.562415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-720258ad-da35-4ccc-93a4-23ed8f718a98 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:35.807601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-720258ad-da35-4ccc-93a4-23ed8f718a98 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:35.815939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-720258ad-da35-4ccc-93a4-23ed8f718a98 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.265750 Jul 21 22:24:35.816571 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 847/1817] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:35 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:35.928114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dae843d7-ac0f-4b46-96be-fa9934c2f135 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:35.928780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dae843d7-ac0f-4b46-96be-fa9934c2f135 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:35.929196 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b453df63-8b33-4a38-90c8-f9e402316eb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:35.929815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b453df63-8b33-4a38-90c8-f9e402316eb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:35.935958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dae843d7-ac0f-4b46-96be-fa9934c2f135 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:35.936139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b453df63-8b33-4a38-90c8-f9e402316eb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:35.936423 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dae843d7-ac0f-4b46-96be-fa9934c2f135 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:35.936541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b453df63-8b33-4a38-90c8-f9e402316eb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:35.937202 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b453df63-8b33-4a38-90c8-f9e402316eb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:35.937320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dae843d7-ac0f-4b46-96be-fa9934c2f135 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:35.937642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dae843d7-ac0f-4b46-96be-fa9934c2f135 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:35.937770 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b453df63-8b33-4a38-90c8-f9e402316eb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:36.068896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dae843d7-ac0f-4b46-96be-fa9934c2f135 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:36.077102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dae843d7-ac0f-4b46-96be-fa9934c2f135 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.152806 Jul 21 22:24:36.077680 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 971/1818] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:35 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:36.170271 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b453df63-8b33-4a38-90c8-f9e402316eb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:36.178698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b453df63-8b33-4a38-90c8-f9e402316eb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.253352 Jul 21 22:24:36.179302 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 848/1819] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:35 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:36.832942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-73603271-9101-4354-a1b1-7a1d149915e8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:36.833551 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-73603271-9101-4354-a1b1-7a1d149915e8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:36.839548 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73603271-9101-4354-a1b1-7a1d149915e8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:36.839999 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73603271-9101-4354-a1b1-7a1d149915e8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:36.840768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73603271-9101-4354-a1b1-7a1d149915e8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:36.841207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73603271-9101-4354-a1b1-7a1d149915e8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:37.089118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-73603271-9101-4354-a1b1-7a1d149915e8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:37.093503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-56560f93-a42c-401b-8be3-4e42161e16ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:37.094118 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-56560f93-a42c-401b-8be3-4e42161e16ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:37.101098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-73603271-9101-4354-a1b1-7a1d149915e8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.271940 Jul 21 22:24:37.102794 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56560f93-a42c-401b-8be3-4e42161e16ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:37.103523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56560f93-a42c-401b-8be3-4e42161e16ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:37.104560 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56560f93-a42c-401b-8be3-4e42161e16ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:37.105231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56560f93-a42c-401b-8be3-4e42161e16ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:37.111344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 972/1820] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:36 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:37.196135 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-00943b5a-0eb9-4fb4-b3c0-6d67f2a6fd64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:37.197835 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-00943b5a-0eb9-4fb4-b3c0-6d67f2a6fd64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:37.204675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-00943b5a-0eb9-4fb4-b3c0-6d67f2a6fd64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:37.205141 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-00943b5a-0eb9-4fb4-b3c0-6d67f2a6fd64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:37.206456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-00943b5a-0eb9-4fb4-b3c0-6d67f2a6fd64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:37.206917 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-00943b5a-0eb9-4fb4-b3c0-6d67f2a6fd64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:37.410251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-56560f93-a42c-401b-8be3-4e42161e16ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:37.419575 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-56560f93-a42c-401b-8be3-4e42161e16ed tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.329188 Jul 21 22:24:37.420167 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 849/1821] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:37 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:37.523358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-00943b5a-0eb9-4fb4-b3c0-6d67f2a6fd64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:37.532783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-00943b5a-0eb9-4fb4-b3c0-6d67f2a6fd64 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.340650 Jul 21 22:24:37.533683 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 973/1822] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:37 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:38.118324 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c861ab37-7df8-45ba-a3c1-373707e5acf9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:38.119029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c861ab37-7df8-45ba-a3c1-373707e5acf9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:38.125945 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c861ab37-7df8-45ba-a3c1-373707e5acf9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:38.126411 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c861ab37-7df8-45ba-a3c1-373707e5acf9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:38.127315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c861ab37-7df8-45ba-a3c1-373707e5acf9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:38.128298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c861ab37-7df8-45ba-a3c1-373707e5acf9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:38.309215 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c861ab37-7df8-45ba-a3c1-373707e5acf9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:38.324698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c861ab37-7df8-45ba-a3c1-373707e5acf9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.210127 Jul 21 22:24:38.325304 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 850/1823] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:38 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:38.436892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8c016acc-967e-4522-ac40-f62491f0e428 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:38.437513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8c016acc-967e-4522-ac40-f62491f0e428 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:38.445284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c016acc-967e-4522-ac40-f62491f0e428 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:38.445738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c016acc-967e-4522-ac40-f62491f0e428 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:38.447169 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c016acc-967e-4522-ac40-f62491f0e428 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:38.447713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c016acc-967e-4522-ac40-f62491f0e428 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:38.537280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8c016acc-967e-4522-ac40-f62491f0e428 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:38.545300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8c016acc-967e-4522-ac40-f62491f0e428 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.112539 Jul 21 22:24:38.546170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 974/1824] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:38 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:38.550198 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f87fa88c-cb9e-4b56-8b7a-f2d7b5472482 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:38.550812 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f87fa88c-cb9e-4b56-8b7a-f2d7b5472482 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:38.559489 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f87fa88c-cb9e-4b56-8b7a-f2d7b5472482 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:38.559934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f87fa88c-cb9e-4b56-8b7a-f2d7b5472482 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:38.560702 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f87fa88c-cb9e-4b56-8b7a-f2d7b5472482 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:38.561135 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f87fa88c-cb9e-4b56-8b7a-f2d7b5472482 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:38.743678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f87fa88c-cb9e-4b56-8b7a-f2d7b5472482 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:38.755388 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f87fa88c-cb9e-4b56-8b7a-f2d7b5472482 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.209150 Jul 21 22:24:38.764000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 851/1825] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:38 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:39.342362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-40382a8b-66f9-4342-b74c-d060b338d866 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:39.342972 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-40382a8b-66f9-4342-b74c-d060b338d866 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:39.350905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40382a8b-66f9-4342-b74c-d060b338d866 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:39.351396 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40382a8b-66f9-4342-b74c-d060b338d866 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:39.352172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40382a8b-66f9-4342-b74c-d060b338d866 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:39.352608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40382a8b-66f9-4342-b74c-d060b338d866 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:39.492678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-40382a8b-66f9-4342-b74c-d060b338d866 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:39.501531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-40382a8b-66f9-4342-b74c-d060b338d866 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.163009 Jul 21 22:24:39.502190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 975/1826] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:39 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:39.562654 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5daddf70-99c4-4656-92c3-c4297aadbadb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:39.563421 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5daddf70-99c4-4656-92c3-c4297aadbadb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:39.570705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5daddf70-99c4-4656-92c3-c4297aadbadb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:39.571194 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5daddf70-99c4-4656-92c3-c4297aadbadb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:39.571990 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5daddf70-99c4-4656-92c3-c4297aadbadb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:39.572432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5daddf70-99c4-4656-92c3-c4297aadbadb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:39.636974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5daddf70-99c4-4656-92c3-c4297aadbadb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:39.645521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5daddf70-99c4-4656-92c3-c4297aadbadb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.086694 Jul 21 22:24:39.646096 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 852/1827] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:39 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:39.772446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a0a6d784-0ba1-41d6-9a1e-8723b51f7340 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:39.773061 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a0a6d784-0ba1-41d6-9a1e-8723b51f7340 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:39.779072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a0a6d784-0ba1-41d6-9a1e-8723b51f7340 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:39.779633 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a0a6d784-0ba1-41d6-9a1e-8723b51f7340 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:39.780415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a0a6d784-0ba1-41d6-9a1e-8723b51f7340 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:39.780856 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a0a6d784-0ba1-41d6-9a1e-8723b51f7340 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:39.922203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a0a6d784-0ba1-41d6-9a1e-8723b51f7340 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:39.930664 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a0a6d784-0ba1-41d6-9a1e-8723b51f7340 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.162575 Jul 21 22:24:39.931274 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 976/1828] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:39 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:40.519348 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-098370d7-303d-4d1f-8032-302607637333 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:40.519957 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-098370d7-303d-4d1f-8032-302607637333 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:40.526300 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-098370d7-303d-4d1f-8032-302607637333 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:40.526746 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-098370d7-303d-4d1f-8032-302607637333 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:40.527540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-098370d7-303d-4d1f-8032-302607637333 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:40.527980 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-098370d7-303d-4d1f-8032-302607637333 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:40.653251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-098370d7-303d-4d1f-8032-302607637333 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:40.661983 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8bdbfb0f-1a61-4885-890e-c689ca8ed7e5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:40.662475 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-098370d7-303d-4d1f-8032-302607637333 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146441 Jul 21 22:24:40.662583 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8bdbfb0f-1a61-4885-890e-c689ca8ed7e5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:40.662870 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 853/1829] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:40 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:40.669985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8bdbfb0f-1a61-4885-890e-c689ca8ed7e5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:40.670440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8bdbfb0f-1a61-4885-890e-c689ca8ed7e5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:40.671236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8bdbfb0f-1a61-4885-890e-c689ca8ed7e5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:40.671669 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8bdbfb0f-1a61-4885-890e-c689ca8ed7e5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:40.675863 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:40.735718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8bdbfb0f-1a61-4885-890e-c689ca8ed7e5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:40.743563 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8bdbfb0f-1a61-4885-890e-c689ca8ed7e5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085936 Jul 21 22:24:40.744133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 977/1830] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:40 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:40.948416 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8277a1eb-8b4d-42f1-8127-96114c21522b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:40.949032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8277a1eb-8b4d-42f1-8127-96114c21522b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:40.955101 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8277a1eb-8b4d-42f1-8127-96114c21522b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:40.955561 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8277a1eb-8b4d-42f1-8127-96114c21522b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:40.956831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8277a1eb-8b4d-42f1-8127-96114c21522b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:40.957333 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8277a1eb-8b4d-42f1-8127-96114c21522b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:41.088083 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8277a1eb-8b4d-42f1-8127-96114c21522b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:41.091643 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:41.097104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8277a1eb-8b4d-42f1-8127-96114c21522b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.152544 Jul 21 22:24:41.097676 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 854/1831] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:40 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:41.678750 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3607e8ef-bdd1-44da-a611-3a551f93aad2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:41.679382 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3607e8ef-bdd1-44da-a611-3a551f93aad2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:41.685880 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3607e8ef-bdd1-44da-a611-3a551f93aad2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:41.686331 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3607e8ef-bdd1-44da-a611-3a551f93aad2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:41.687117 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3607e8ef-bdd1-44da-a611-3a551f93aad2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:41.687557 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3607e8ef-bdd1-44da-a611-3a551f93aad2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:41.760835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-67de6ccd-60db-4e67-bf57-c4d532cb895f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:41.761371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-67de6ccd-60db-4e67-bf57-c4d532cb895f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:41.767789 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67de6ccd-60db-4e67-bf57-c4d532cb895f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:41.768962 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67de6ccd-60db-4e67-bf57-c4d532cb895f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:41.769828 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67de6ccd-60db-4e67-bf57-c4d532cb895f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:41.770273 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67de6ccd-60db-4e67-bf57-c4d532cb895f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:41.838600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-67de6ccd-60db-4e67-bf57-c4d532cb895f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:41.841981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3607e8ef-bdd1-44da-a611-3a551f93aad2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:41.846834 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-67de6ccd-60db-4e67-bf57-c4d532cb895f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.090261 Jul 21 22:24:41.847441 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 855/1832] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:41 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:41.850471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3607e8ef-bdd1-44da-a611-3a551f93aad2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.175575 Jul 21 22:24:41.851069 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 978/1833] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:41 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:42.113685 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-142d09c3-eca2-4522-8a91-1d238bdc3082 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:42.114216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-142d09c3-eca2-4522-8a91-1d238bdc3082 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:42.120282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-142d09c3-eca2-4522-8a91-1d238bdc3082 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:42.120730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-142d09c3-eca2-4522-8a91-1d238bdc3082 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:42.121487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-142d09c3-eca2-4522-8a91-1d238bdc3082 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:42.121920 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-142d09c3-eca2-4522-8a91-1d238bdc3082 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:42.249434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-142d09c3-eca2-4522-8a91-1d238bdc3082 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:42.257748 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-142d09c3-eca2-4522-8a91-1d238bdc3082 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147995 Jul 21 22:24:42.258317 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 856/1834] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:42 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:42.863706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4f956c6a-509e-4326-ae17-cfc119fba073 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:42.864266 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4f956c6a-509e-4326-ae17-cfc119fba073 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:42.866935 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1e42d424-cac6-4a74-9917-2752fdb5b789 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:42.867593 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1e42d424-cac6-4a74-9917-2752fdb5b789 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:42.870857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4f956c6a-509e-4326-ae17-cfc119fba073 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:42.871351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4f956c6a-509e-4326-ae17-cfc119fba073 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:42.872126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4f956c6a-509e-4326-ae17-cfc119fba073 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:42.872567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4f956c6a-509e-4326-ae17-cfc119fba073 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:42.874086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e42d424-cac6-4a74-9917-2752fdb5b789 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:42.874547 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e42d424-cac6-4a74-9917-2752fdb5b789 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:42.875370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e42d424-cac6-4a74-9917-2752fdb5b789 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:42.875815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e42d424-cac6-4a74-9917-2752fdb5b789 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:42.958920 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4f956c6a-509e-4326-ae17-cfc119fba073 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:42.966972 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4f956c6a-509e-4326-ae17-cfc119fba073 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.107207 Jul 21 22:24:42.967577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 979/1835] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:42 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:43.029855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1e42d424-cac6-4a74-9917-2752fdb5b789 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:43.037990 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1e42d424-cac6-4a74-9917-2752fdb5b789 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.174829 Jul 21 22:24:43.038559 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 857/1836] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:42 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:43.274731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ded62663-748f-4844-abd2-6d557dfbc984 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:43.275362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ded62663-748f-4844-abd2-6d557dfbc984 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:43.281760 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ded62663-748f-4844-abd2-6d557dfbc984 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:43.282209 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ded62663-748f-4844-abd2-6d557dfbc984 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:43.282970 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ded62663-748f-4844-abd2-6d557dfbc984 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:43.283427 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ded62663-748f-4844-abd2-6d557dfbc984 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:43.414414 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ded62663-748f-4844-abd2-6d557dfbc984 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:43.422210 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ded62663-748f-4844-abd2-6d557dfbc984 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.151297 Jul 21 22:24:43.422775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 980/1837] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:43 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:43.984098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5b2eef20-49e2-4692-a458-5446de62b71b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:43.984711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5b2eef20-49e2-4692-a458-5446de62b71b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:43.991796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5b2eef20-49e2-4692-a458-5446de62b71b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:43.992250 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5b2eef20-49e2-4692-a458-5446de62b71b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:43.993025 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5b2eef20-49e2-4692-a458-5446de62b71b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:43.993474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5b2eef20-49e2-4692-a458-5446de62b71b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:44.055561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-db15ec16-9c12-4cab-949a-485e9d60a56c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:44.056183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-db15ec16-9c12-4cab-949a-485e9d60a56c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:44.056921 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5b2eef20-49e2-4692-a458-5446de62b71b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:44.062936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db15ec16-9c12-4cab-949a-485e9d60a56c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:44.063415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db15ec16-9c12-4cab-949a-485e9d60a56c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:44.064194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db15ec16-9c12-4cab-949a-485e9d60a56c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:44.064628 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db15ec16-9c12-4cab-949a-485e9d60a56c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:44.064817 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5b2eef20-49e2-4692-a458-5446de62b71b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084578 Jul 21 22:24:44.065400 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 858/1838] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:43 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:44.192462 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-db15ec16-9c12-4cab-949a-485e9d60a56c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:44.200573 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-db15ec16-9c12-4cab-949a-485e9d60a56c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148914 Jul 21 22:24:44.201142 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 981/1839] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:44 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:44.439499 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a4e46e5a-aece-44ae-8339-65b0507909f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:44.440223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a4e46e5a-aece-44ae-8339-65b0507909f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:44.446194 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4e46e5a-aece-44ae-8339-65b0507909f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:44.446652 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4e46e5a-aece-44ae-8339-65b0507909f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:44.447453 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4e46e5a-aece-44ae-8339-65b0507909f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:44.447896 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4e46e5a-aece-44ae-8339-65b0507909f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:44.576584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a4e46e5a-aece-44ae-8339-65b0507909f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:44.584981 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a4e46e5a-aece-44ae-8339-65b0507909f7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149360 Jul 21 22:24:44.585551 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 859/1840] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:44 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:45.081657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2d2ca6fa-491c-4e98-9f93-7425d2ad7f1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:45.082261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2d2ca6fa-491c-4e98-9f93-7425d2ad7f1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:45.088965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2d2ca6fa-491c-4e98-9f93-7425d2ad7f1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:45.089420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2d2ca6fa-491c-4e98-9f93-7425d2ad7f1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:45.090196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2d2ca6fa-491c-4e98-9f93-7425d2ad7f1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:45.090627 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2d2ca6fa-491c-4e98-9f93-7425d2ad7f1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:45.151384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2d2ca6fa-491c-4e98-9f93-7425d2ad7f1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:45.159882 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2d2ca6fa-491c-4e98-9f93-7425d2ad7f1c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082063 Jul 21 22:24:45.160446 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 982/1841] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:45 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:45.217303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-512833a7-e56a-431f-aaef-c339ff82febf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:45.217915 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-512833a7-e56a-431f-aaef-c339ff82febf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:45.225303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-512833a7-e56a-431f-aaef-c339ff82febf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:45.225755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-512833a7-e56a-431f-aaef-c339ff82febf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:45.226524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-512833a7-e56a-431f-aaef-c339ff82febf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:45.226964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-512833a7-e56a-431f-aaef-c339ff82febf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:45.358266 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-512833a7-e56a-431f-aaef-c339ff82febf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:45.366405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-512833a7-e56a-431f-aaef-c339ff82febf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152872 Jul 21 22:24:45.367024 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 860/1842] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:45 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:45.602308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-316154a0-fa78-4ee2-a095-9755178bebe4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:45.602946 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-316154a0-fa78-4ee2-a095-9755178bebe4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:45.608902 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-316154a0-fa78-4ee2-a095-9755178bebe4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:45.609347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-316154a0-fa78-4ee2-a095-9755178bebe4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:45.610101 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-316154a0-fa78-4ee2-a095-9755178bebe4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:45.610536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-316154a0-fa78-4ee2-a095-9755178bebe4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:45.735852 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-316154a0-fa78-4ee2-a095-9755178bebe4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:45.743607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-316154a0-fa78-4ee2-a095-9755178bebe4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.145178 Jul 21 22:24:45.744197 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 983/1843] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:45 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:46.177631 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3a057845-9421-41cb-8c15-5347e2bbda5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:46.178236 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3a057845-9421-41cb-8c15-5347e2bbda5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:46.184393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a057845-9421-41cb-8c15-5347e2bbda5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:46.184850 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a057845-9421-41cb-8c15-5347e2bbda5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:46.185624 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a057845-9421-41cb-8c15-5347e2bbda5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:46.186062 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a057845-9421-41cb-8c15-5347e2bbda5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:46.245920 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3a057845-9421-41cb-8c15-5347e2bbda5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:46.254446 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3a057845-9421-41cb-8c15-5347e2bbda5f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081228 Jul 21 22:24:46.255024 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 861/1844] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:46 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:46.384016 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c35397a7-65a1-49b5-aae9-54efef47ccc8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:46.384631 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c35397a7-65a1-49b5-aae9-54efef47ccc8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:46.391130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c35397a7-65a1-49b5-aae9-54efef47ccc8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:46.391587 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c35397a7-65a1-49b5-aae9-54efef47ccc8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:46.392356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c35397a7-65a1-49b5-aae9-54efef47ccc8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:46.392792 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c35397a7-65a1-49b5-aae9-54efef47ccc8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:46.524737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c35397a7-65a1-49b5-aae9-54efef47ccc8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:46.535084 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c35397a7-65a1-49b5-aae9-54efef47ccc8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.154884 Jul 21 22:24:46.535657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 984/1845] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:46 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:46.761881 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-72bde44e-2b6c-4969-ad0a-fbebd8d4db9d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:46.762541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-72bde44e-2b6c-4969-ad0a-fbebd8d4db9d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:46.769096 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72bde44e-2b6c-4969-ad0a-fbebd8d4db9d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:46.769588 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72bde44e-2b6c-4969-ad0a-fbebd8d4db9d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:46.770388 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72bde44e-2b6c-4969-ad0a-fbebd8d4db9d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:46.770829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72bde44e-2b6c-4969-ad0a-fbebd8d4db9d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:46.898573 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-72bde44e-2b6c-4969-ad0a-fbebd8d4db9d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:46.906514 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-72bde44e-2b6c-4969-ad0a-fbebd8d4db9d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148969 Jul 21 22:24:46.907103 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 862/1846] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:46 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:47.272186 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-eabc1743-8bfd-4f23-b6f2-7f49db2d9883 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:47.272800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-eabc1743-8bfd-4f23-b6f2-7f49db2d9883 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:47.278882 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eabc1743-8bfd-4f23-b6f2-7f49db2d9883 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:47.279364 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eabc1743-8bfd-4f23-b6f2-7f49db2d9883 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:47.280130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eabc1743-8bfd-4f23-b6f2-7f49db2d9883 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:47.280567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eabc1743-8bfd-4f23-b6f2-7f49db2d9883 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:47.340307 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-eabc1743-8bfd-4f23-b6f2-7f49db2d9883 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:47.348391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-eabc1743-8bfd-4f23-b6f2-7f49db2d9883 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080668 Jul 21 22:24:47.348953 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 985/1847] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:47 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:47.552500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8b54c0f3-4f5c-42a4-a85a-a1626b59460b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:47.553052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8b54c0f3-4f5c-42a4-a85a-a1626b59460b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:47.559565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b54c0f3-4f5c-42a4-a85a-a1626b59460b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:47.560019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b54c0f3-4f5c-42a4-a85a-a1626b59460b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:47.560785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b54c0f3-4f5c-42a4-a85a-a1626b59460b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:47.561224 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b54c0f3-4f5c-42a4-a85a-a1626b59460b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:47.689380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8b54c0f3-4f5c-42a4-a85a-a1626b59460b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:47.697732 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8b54c0f3-4f5c-42a4-a85a-a1626b59460b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149684 Jul 21 22:24:47.698308 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 863/1848] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:47 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:47.923516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c3497460-c8c5-4cb0-b5f4-d1ec152bc471 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:47.924172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c3497460-c8c5-4cb0-b5f4-d1ec152bc471 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:47.930639 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3497460-c8c5-4cb0-b5f4-d1ec152bc471 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:47.931128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3497460-c8c5-4cb0-b5f4-d1ec152bc471 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:47.931912 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3497460-c8c5-4cb0-b5f4-d1ec152bc471 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:47.932353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c3497460-c8c5-4cb0-b5f4-d1ec152bc471 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:48.071879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c3497460-c8c5-4cb0-b5f4-d1ec152bc471 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:48.080955 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c3497460-c8c5-4cb0-b5f4-d1ec152bc471 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.160694 Jul 21 22:24:48.081521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 986/1849] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:47 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:48.365501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-53f2385c-3449-43b8-bf7b-d06ad4ca8b6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:48.366112 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-53f2385c-3449-43b8-bf7b-d06ad4ca8b6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:48.372400 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53f2385c-3449-43b8-bf7b-d06ad4ca8b6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:48.372896 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53f2385c-3449-43b8-bf7b-d06ad4ca8b6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:48.373761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53f2385c-3449-43b8-bf7b-d06ad4ca8b6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:48.374273 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53f2385c-3449-43b8-bf7b-d06ad4ca8b6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:48.434454 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-53f2385c-3449-43b8-bf7b-d06ad4ca8b6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:48.443060 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-53f2385c-3449-43b8-bf7b-d06ad4ca8b6b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081760 Jul 21 22:24:48.443705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 864/1850] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:48 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:48.713557 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2cc8b768-f8d2-4b63-ae73-25030244cce4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:48.714168 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2cc8b768-f8d2-4b63-ae73-25030244cce4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:48.720436 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2cc8b768-f8d2-4b63-ae73-25030244cce4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:48.721374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2cc8b768-f8d2-4b63-ae73-25030244cce4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:48.722133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2cc8b768-f8d2-4b63-ae73-25030244cce4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:48.722567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2cc8b768-f8d2-4b63-ae73-25030244cce4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:48.860276 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2cc8b768-f8d2-4b63-ae73-25030244cce4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:48.870291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2cc8b768-f8d2-4b63-ae73-25030244cce4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.160582 Jul 21 22:24:48.870867 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 987/1851] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:48 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:49.097435 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-36e12bc7-135f-4257-9c98-a12de3993894 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:49.098154 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-36e12bc7-135f-4257-9c98-a12de3993894 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:49.107347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36e12bc7-135f-4257-9c98-a12de3993894 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:49.107805 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36e12bc7-135f-4257-9c98-a12de3993894 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:49.108596 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36e12bc7-135f-4257-9c98-a12de3993894 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:49.109035 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-36e12bc7-135f-4257-9c98-a12de3993894 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:49.244907 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-36e12bc7-135f-4257-9c98-a12de3993894 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:49.253156 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-36e12bc7-135f-4257-9c98-a12de3993894 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.159877 Jul 21 22:24:49.253726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 865/1852] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:49 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:49.460718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-42215384-d4f9-4a41-8a29-7bd315ee0ed9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:49.461351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-42215384-d4f9-4a41-8a29-7bd315ee0ed9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:49.467929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-42215384-d4f9-4a41-8a29-7bd315ee0ed9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:49.468377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-42215384-d4f9-4a41-8a29-7bd315ee0ed9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:49.469432 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-42215384-d4f9-4a41-8a29-7bd315ee0ed9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:49.469864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-42215384-d4f9-4a41-8a29-7bd315ee0ed9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:49.530866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-42215384-d4f9-4a41-8a29-7bd315ee0ed9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:49.539652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-42215384-d4f9-4a41-8a29-7bd315ee0ed9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082807 Jul 21 22:24:49.540216 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 988/1853] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:49 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:49.886895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4b8f197f-f7a2-422a-a27b-601cfbf87194 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:49.887573 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4b8f197f-f7a2-422a-a27b-601cfbf87194 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:49.893588 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b8f197f-f7a2-422a-a27b-601cfbf87194 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:49.894037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b8f197f-f7a2-422a-a27b-601cfbf87194 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:49.894801 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b8f197f-f7a2-422a-a27b-601cfbf87194 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:49.895266 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b8f197f-f7a2-422a-a27b-601cfbf87194 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:50.024405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4b8f197f-f7a2-422a-a27b-601cfbf87194 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:50.032262 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4b8f197f-f7a2-422a-a27b-601cfbf87194 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149181 Jul 21 22:24:50.032829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 866/1854] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:49 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:50.269718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7803a848-0abb-4f5c-bcbb-fa7c01fcf95d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:50.270267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7803a848-0abb-4f5c-bcbb-fa7c01fcf95d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:50.276963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7803a848-0abb-4f5c-bcbb-fa7c01fcf95d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:50.277409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7803a848-0abb-4f5c-bcbb-fa7c01fcf95d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:50.278165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7803a848-0abb-4f5c-bcbb-fa7c01fcf95d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:50.278597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7803a848-0abb-4f5c-bcbb-fa7c01fcf95d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:50.405218 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7803a848-0abb-4f5c-bcbb-fa7c01fcf95d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:50.413090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7803a848-0abb-4f5c-bcbb-fa7c01fcf95d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147315 Jul 21 22:24:50.413661 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 989/1855] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:50 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:50.555935 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7c4a848a-e828-4a23-aff6-ac4b5a3fb829 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:50.556485 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7c4a848a-e828-4a23-aff6-ac4b5a3fb829 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:50.562919 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c4a848a-e828-4a23-aff6-ac4b5a3fb829 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:50.563404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c4a848a-e828-4a23-aff6-ac4b5a3fb829 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:50.564172 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c4a848a-e828-4a23-aff6-ac4b5a3fb829 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:50.564679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c4a848a-e828-4a23-aff6-ac4b5a3fb829 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:50.638516 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7c4a848a-e828-4a23-aff6-ac4b5a3fb829 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:50.646895 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7c4a848a-e828-4a23-aff6-ac4b5a3fb829 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.094856 Jul 21 22:24:50.647485 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 867/1856] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:50 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:51.049736 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-71bafde1-98e4-4f4e-ac9f-30b8861def06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:51.050992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-71bafde1-98e4-4f4e-ac9f-30b8861def06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:51.057560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71bafde1-98e4-4f4e-ac9f-30b8861def06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:51.058014 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71bafde1-98e4-4f4e-ac9f-30b8861def06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:51.058787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71bafde1-98e4-4f4e-ac9f-30b8861def06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:51.059258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-71bafde1-98e4-4f4e-ac9f-30b8861def06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:51.189169 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-71bafde1-98e4-4f4e-ac9f-30b8861def06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:51.197132 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-71bafde1-98e4-4f4e-ac9f-30b8861def06 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.151237 Jul 21 22:24:51.197698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 990/1857] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:51 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:51.429160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c4be10cc-ee47-48b5-b830-e7e8b4121ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:51.429777 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c4be10cc-ee47-48b5-b830-e7e8b4121ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:51.435816 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4be10cc-ee47-48b5-b830-e7e8b4121ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:51.436270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4be10cc-ee47-48b5-b830-e7e8b4121ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:51.437035 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4be10cc-ee47-48b5-b830-e7e8b4121ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:51.437475 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4be10cc-ee47-48b5-b830-e7e8b4121ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:51.564049 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c4be10cc-ee47-48b5-b830-e7e8b4121ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:51.572428 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c4be10cc-ee47-48b5-b830-e7e8b4121ae9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147135 Jul 21 22:24:51.572996 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 868/1858] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:51 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:51.664210 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0a2982eb-39d1-4d8d-8e08-5e69fca794d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:51.664822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0a2982eb-39d1-4d8d-8e08-5e69fca794d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:51.670813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0a2982eb-39d1-4d8d-8e08-5e69fca794d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:51.671298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0a2982eb-39d1-4d8d-8e08-5e69fca794d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:51.672068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0a2982eb-39d1-4d8d-8e08-5e69fca794d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:51.672504 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0a2982eb-39d1-4d8d-8e08-5e69fca794d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:51.735598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0a2982eb-39d1-4d8d-8e08-5e69fca794d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:51.744085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0a2982eb-39d1-4d8d-8e08-5e69fca794d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083706 Jul 21 22:24:51.744667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 991/1859] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:51 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:52.214672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e38a2919-5d93-43a5-a185-8777b447824d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:52.215309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e38a2919-5d93-43a5-a185-8777b447824d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:52.221743 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e38a2919-5d93-43a5-a185-8777b447824d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:52.222264 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e38a2919-5d93-43a5-a185-8777b447824d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:52.226458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e38a2919-5d93-43a5-a185-8777b447824d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:52.226938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e38a2919-5d93-43a5-a185-8777b447824d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:52.356097 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e38a2919-5d93-43a5-a185-8777b447824d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:52.364332 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e38a2919-5d93-43a5-a185-8777b447824d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.153533 Jul 21 22:24:52.364904 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 869/1860] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:52 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:52.590471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c1f37555-4ccf-4c90-a3b9-24d53305087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:52.591110 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c1f37555-4ccf-4c90-a3b9-24d53305087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:52.597840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1f37555-4ccf-4c90-a3b9-24d53305087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:52.598290 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1f37555-4ccf-4c90-a3b9-24d53305087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:52.599087 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1f37555-4ccf-4c90-a3b9-24d53305087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:52.599526 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1f37555-4ccf-4c90-a3b9-24d53305087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:52.723348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c1f37555-4ccf-4c90-a3b9-24d53305087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:52.731193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c1f37555-4ccf-4c90-a3b9-24d53305087a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.144557 Jul 21 22:24:52.731760 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 992/1861] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:52 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:52.760854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-91b10565-3bd8-48b2-830c-d6d672a8ee4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:52.761537 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-91b10565-3bd8-48b2-830c-d6d672a8ee4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:52.768725 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-91b10565-3bd8-48b2-830c-d6d672a8ee4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:52.769179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-91b10565-3bd8-48b2-830c-d6d672a8ee4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:52.769952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-91b10565-3bd8-48b2-830c-d6d672a8ee4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:52.770395 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-91b10565-3bd8-48b2-830c-d6d672a8ee4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:52.833305 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-91b10565-3bd8-48b2-830c-d6d672a8ee4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:52.841206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-91b10565-3bd8-48b2-830c-d6d672a8ee4b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084261 Jul 21 22:24:52.841782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 870/1862] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:52 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:53.382262 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3ca0d8d0-ace3-4784-84d5-9fe405af04a0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:53.382865 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3ca0d8d0-ace3-4784-84d5-9fe405af04a0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:53.389063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ca0d8d0-ace3-4784-84d5-9fe405af04a0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:53.389552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ca0d8d0-ace3-4784-84d5-9fe405af04a0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:53.390315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ca0d8d0-ace3-4784-84d5-9fe405af04a0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:53.390746 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ca0d8d0-ace3-4784-84d5-9fe405af04a0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:53.519448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3ca0d8d0-ace3-4784-84d5-9fe405af04a0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:53.522829 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:53.528191 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3ca0d8d0-ace3-4784-84d5-9fe405af04a0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149873 Jul 21 22:24:53.528755 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 993/1863] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:53 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:53.748619 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9fb222ae-391f-438c-bf00-5f224d311132 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:53.749148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9fb222ae-391f-438c-bf00-5f224d311132 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:53.755283 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fb222ae-391f-438c-bf00-5f224d311132 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:53.755737 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fb222ae-391f-438c-bf00-5f224d311132 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:53.756501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fb222ae-391f-438c-bf00-5f224d311132 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:53.756942 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fb222ae-391f-438c-bf00-5f224d311132 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:53.774795 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:24:53.858916 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cdac7991-474c-49bc-9119-00e07094b918 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:53.859561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cdac7991-474c-49bc-9119-00e07094b918 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:53.866751 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cdac7991-474c-49bc-9119-00e07094b918 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:53.867240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cdac7991-474c-49bc-9119-00e07094b918 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:53.868059 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cdac7991-474c-49bc-9119-00e07094b918 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:53.868455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cdac7991-474c-49bc-9119-00e07094b918 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:53.885026 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9fb222ae-391f-438c-bf00-5f224d311132 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:53.893228 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9fb222ae-391f-438c-bf00-5f224d311132 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148527 Jul 21 22:24:53.893822 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 871/1864] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:53 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:53.940214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-cdac7991-474c-49bc-9119-00e07094b918 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:53.948151 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cdac7991-474c-49bc-9119-00e07094b918 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.093165 Jul 21 22:24:53.948713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 994/1865] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:53 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:54.545593 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-270de812-6fbd-48aa-912f-4eefc5fbf3da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:54.546152 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-270de812-6fbd-48aa-912f-4eefc5fbf3da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:54.552967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-270de812-6fbd-48aa-912f-4eefc5fbf3da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:54.553426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-270de812-6fbd-48aa-912f-4eefc5fbf3da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:54.554203 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-270de812-6fbd-48aa-912f-4eefc5fbf3da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:54.554646 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-270de812-6fbd-48aa-912f-4eefc5fbf3da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:54.680115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-270de812-6fbd-48aa-912f-4eefc5fbf3da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:54.687967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-270de812-6fbd-48aa-912f-4eefc5fbf3da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146312 Jul 21 22:24:54.688538 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 872/1866] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:54 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:54.910319 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6374b659-aa60-48af-9893-6de51b668a72 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:54.910930 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6374b659-aa60-48af-9893-6de51b668a72 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:54.917377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6374b659-aa60-48af-9893-6de51b668a72 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:54.917827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6374b659-aa60-48af-9893-6de51b668a72 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:54.918591 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6374b659-aa60-48af-9893-6de51b668a72 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:54.919060 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6374b659-aa60-48af-9893-6de51b668a72 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:54.964712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-71e05635-eac1-4147-9813-0894575a7545 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:54.965413 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-71e05635-eac1-4147-9813-0894575a7545 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:54.972421 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-71e05635-eac1-4147-9813-0894575a7545 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:54.972882 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-71e05635-eac1-4147-9813-0894575a7545 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:54.973660 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-71e05635-eac1-4147-9813-0894575a7545 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:54.974105 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-71e05635-eac1-4147-9813-0894575a7545 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:55.047394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-71e05635-eac1-4147-9813-0894575a7545 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:55.055764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-71e05635-eac1-4147-9813-0894575a7545 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.094922 Jul 21 22:24:55.056338 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 873/1867] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:54 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:55.076848 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6374b659-aa60-48af-9893-6de51b668a72 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:55.084759 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6374b659-aa60-48af-9893-6de51b668a72 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.178277 Jul 21 22:24:55.085325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 995/1868] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:54 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:24:55.704902 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-092a54dc-d42f-4cc2-a106-a5383fcbdcc7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:55.706009 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-092a54dc-d42f-4cc2-a106-a5383fcbdcc7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:55.712011 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-092a54dc-d42f-4cc2-a106-a5383fcbdcc7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:55.712462 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-092a54dc-d42f-4cc2-a106-a5383fcbdcc7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:55.713223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-092a54dc-d42f-4cc2-a106-a5383fcbdcc7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:55.713667 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-092a54dc-d42f-4cc2-a106-a5383fcbdcc7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:55.838606 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-092a54dc-d42f-4cc2-a106-a5383fcbdcc7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:55.847210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-092a54dc-d42f-4cc2-a106-a5383fcbdcc7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146133 Jul 21 22:24:55.847775 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 874/1869] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:55 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:56.073133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e01bb3d1-5ccd-4c65-bfba-b22d872fa01b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:56.073679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e01bb3d1-5ccd-4c65-bfba-b22d872fa01b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:56.080820 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e01bb3d1-5ccd-4c65-bfba-b22d872fa01b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:56.081276 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e01bb3d1-5ccd-4c65-bfba-b22d872fa01b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:56.082062 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e01bb3d1-5ccd-4c65-bfba-b22d872fa01b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:56.082507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e01bb3d1-5ccd-4c65-bfba-b22d872fa01b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:56.103945 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4742f998-e94a-4771-bbe5-af296e5a5a50 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:56.104572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4742f998-e94a-4771-bbe5-af296e5a5a50 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:56.111507 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4742f998-e94a-4771-bbe5-af296e5a5a50 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:56.111965 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4742f998-e94a-4771-bbe5-af296e5a5a50 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:56.112752 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4742f998-e94a-4771-bbe5-af296e5a5a50 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:56.113198 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4742f998-e94a-4771-bbe5-af296e5a5a50 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:56.145552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e01bb3d1-5ccd-4c65-bfba-b22d872fa01b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:56.153554 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e01bb3d1-5ccd-4c65-bfba-b22d872fa01b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084344 Jul 21 22:24:56.154128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 996/1870] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:56 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:56.247215 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4742f998-e94a-4771-bbe5-af296e5a5a50 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:56.255679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4742f998-e94a-4771-bbe5-af296e5a5a50 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.157125 Jul 21 22:24:56.256251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 875/1871] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:56 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:56.864757 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-52f05248-2aaa-4c5d-951e-2b97681011db tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:56.865289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-52f05248-2aaa-4c5d-951e-2b97681011db tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:56.871511 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-52f05248-2aaa-4c5d-951e-2b97681011db tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:56.871969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-52f05248-2aaa-4c5d-951e-2b97681011db tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:56.872741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-52f05248-2aaa-4c5d-951e-2b97681011db tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:56.873198 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-52f05248-2aaa-4c5d-951e-2b97681011db tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:56.998529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-52f05248-2aaa-4c5d-951e-2b97681011db tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:57.006879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-52f05248-2aaa-4c5d-951e-2b97681011db tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146112 Jul 21 22:24:57.007481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 997/1872] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:56 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:57.169676 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fcdea129-aefa-4587-8dac-72ff6425035d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:57.170288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fcdea129-aefa-4587-8dac-72ff6425035d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:57.176748 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fcdea129-aefa-4587-8dac-72ff6425035d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:57.177194 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fcdea129-aefa-4587-8dac-72ff6425035d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:57.177952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fcdea129-aefa-4587-8dac-72ff6425035d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:57.178381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fcdea129-aefa-4587-8dac-72ff6425035d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:57.239798 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fcdea129-aefa-4587-8dac-72ff6425035d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:57.247502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fcdea129-aefa-4587-8dac-72ff6425035d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081859 Jul 21 22:24:57.248067 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 876/1873] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:57 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:57.272894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9bb0bcfc-20ce-4d88-bd1c-98f100b13b55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:57.273504 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9bb0bcfc-20ce-4d88-bd1c-98f100b13b55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:57.279525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9bb0bcfc-20ce-4d88-bd1c-98f100b13b55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:57.279980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9bb0bcfc-20ce-4d88-bd1c-98f100b13b55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:57.280748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9bb0bcfc-20ce-4d88-bd1c-98f100b13b55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:57.281190 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9bb0bcfc-20ce-4d88-bd1c-98f100b13b55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:57.410279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9bb0bcfc-20ce-4d88-bd1c-98f100b13b55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:57.418141 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9bb0bcfc-20ce-4d88-bd1c-98f100b13b55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149024 Jul 21 22:24:57.418711 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 998/1874] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:57 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:58.024409 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7f3ae5b0-7370-4d5c-90f8-5ec05b30b53d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:58.025016 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7f3ae5b0-7370-4d5c-90f8-5ec05b30b53d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:58.031018 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f3ae5b0-7370-4d5c-90f8-5ec05b30b53d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:58.031482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f3ae5b0-7370-4d5c-90f8-5ec05b30b53d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:58.032239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f3ae5b0-7370-4d5c-90f8-5ec05b30b53d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:58.032673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f3ae5b0-7370-4d5c-90f8-5ec05b30b53d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:58.162377 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7f3ae5b0-7370-4d5c-90f8-5ec05b30b53d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:58.170785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7f3ae5b0-7370-4d5c-90f8-5ec05b30b53d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.150242 Jul 21 22:24:58.171408 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 877/1875] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:58 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:58.264952 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6dbd535a-956d-496f-af3e-1ffd5efee16d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:58.265566 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6dbd535a-956d-496f-af3e-1ffd5efee16d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:58.274130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6dbd535a-956d-496f-af3e-1ffd5efee16d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:58.274809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6dbd535a-956d-496f-af3e-1ffd5efee16d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:58.275393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6dbd535a-956d-496f-af3e-1ffd5efee16d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:58.275852 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6dbd535a-956d-496f-af3e-1ffd5efee16d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:58.337728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6dbd535a-956d-496f-af3e-1ffd5efee16d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:58.345943 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6dbd535a-956d-496f-af3e-1ffd5efee16d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084918 Jul 21 22:24:58.346512 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 999/1876] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:58 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:58.434839 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a457775d-ccca-488e-8080-f71eb3116c55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:58.435604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a457775d-ccca-488e-8080-f71eb3116c55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:58.442078 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a457775d-ccca-488e-8080-f71eb3116c55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:58.442529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a457775d-ccca-488e-8080-f71eb3116c55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:58.443329 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a457775d-ccca-488e-8080-f71eb3116c55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:58.443767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a457775d-ccca-488e-8080-f71eb3116c55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:58.574156 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a457775d-ccca-488e-8080-f71eb3116c55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:58.582638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a457775d-ccca-488e-8080-f71eb3116c55 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.151585 Jul 21 22:24:58.583242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 878/1877] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:58 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:59.187985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-02952214-4eb4-4afc-b413-92e5d63f8ae4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:59.188599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-02952214-4eb4-4afc-b413-92e5d63f8ae4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:59.195034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02952214-4eb4-4afc-b413-92e5d63f8ae4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:59.195857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02952214-4eb4-4afc-b413-92e5d63f8ae4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:59.196932 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02952214-4eb4-4afc-b413-92e5d63f8ae4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:59.197379 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02952214-4eb4-4afc-b413-92e5d63f8ae4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:59.324127 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-02952214-4eb4-4afc-b413-92e5d63f8ae4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:59.332528 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-02952214-4eb4-4afc-b413-92e5d63f8ae4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148517 Jul 21 22:24:59.333099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1000/1878] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:59 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:59.363229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9af46b9c-a4d4-420a-b507-a85ac7672d2a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:59.363843 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9af46b9c-a4d4-420a-b507-a85ac7672d2a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:59.370233 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9af46b9c-a4d4-420a-b507-a85ac7672d2a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:59.370686 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9af46b9c-a4d4-420a-b507-a85ac7672d2a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:59.371484 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9af46b9c-a4d4-420a-b507-a85ac7672d2a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:59.371936 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9af46b9c-a4d4-420a-b507-a85ac7672d2a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:59.435604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9af46b9c-a4d4-420a-b507-a85ac7672d2a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:59.443622 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9af46b9c-a4d4-420a-b507-a85ac7672d2a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084758 Jul 21 22:24:59.444134 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 879/1879] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:59 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:24:59.600560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c2829360-19c3-4293-9f9a-997a0af4268b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:24:59.601171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c2829360-19c3-4293-9f9a-997a0af4268b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:24:59.607353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2829360-19c3-4293-9f9a-997a0af4268b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:59.607810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2829360-19c3-4293-9f9a-997a0af4268b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:59.608570 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2829360-19c3-4293-9f9a-997a0af4268b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:24:59.609005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2829360-19c3-4293-9f9a-997a0af4268b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:24:59.736688 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c2829360-19c3-4293-9f9a-997a0af4268b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:24:59.744730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c2829360-19c3-4293-9f9a-997a0af4268b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148002 Jul 21 22:24:59.745289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1001/1880] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:24:59 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:00.350394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c48da00f-5a2a-4bad-9899-5b7d565cef55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:00.351026 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c48da00f-5a2a-4bad-9899-5b7d565cef55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:00.352910 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:00.358608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c48da00f-5a2a-4bad-9899-5b7d565cef55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:00.359097 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c48da00f-5a2a-4bad-9899-5b7d565cef55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:00.359870 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c48da00f-5a2a-4bad-9899-5b7d565cef55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:00.360311 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c48da00f-5a2a-4bad-9899-5b7d565cef55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:00.460843 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-72ca0365-1292-448a-a02d-78a044cc4126 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:00.461415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-72ca0365-1292-448a-a02d-78a044cc4126 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:00.463682 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:00.469838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72ca0365-1292-448a-a02d-78a044cc4126 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:00.470306 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72ca0365-1292-448a-a02d-78a044cc4126 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:00.471662 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72ca0365-1292-448a-a02d-78a044cc4126 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:00.472098 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72ca0365-1292-448a-a02d-78a044cc4126 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:00.488878 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c48da00f-5a2a-4bad-9899-5b7d565cef55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:00.496762 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c48da00f-5a2a-4bad-9899-5b7d565cef55 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.150209 Jul 21 22:25:00.497323 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 880/1881] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:00 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:00.539939 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-72ca0365-1292-448a-a02d-78a044cc4126 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:00.548291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-72ca0365-1292-448a-a02d-78a044cc4126 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.091409 Jul 21 22:25:00.548887 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1002/1882] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:00 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:00.761072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-961a177a-94e6-4533-ba96-889cffb14f86 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:00.761652 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-961a177a-94e6-4533-ba96-889cffb14f86 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:00.768549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-961a177a-94e6-4533-ba96-889cffb14f86 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:00.769005 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-961a177a-94e6-4533-ba96-889cffb14f86 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:00.769784 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-961a177a-94e6-4533-ba96-889cffb14f86 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:00.770225 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-961a177a-94e6-4533-ba96-889cffb14f86 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:00.895614 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-961a177a-94e6-4533-ba96-889cffb14f86 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:00.903538 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-961a177a-94e6-4533-ba96-889cffb14f86 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146367 Jul 21 22:25:00.904106 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 881/1883] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:00 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:01.513578 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d9e06582-89c8-40d2-8e53-4ed02fb4aaad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:01.514184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d9e06582-89c8-40d2-8e53-4ed02fb4aaad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:01.521433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d9e06582-89c8-40d2-8e53-4ed02fb4aaad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:01.521885 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d9e06582-89c8-40d2-8e53-4ed02fb4aaad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:01.522647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d9e06582-89c8-40d2-8e53-4ed02fb4aaad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:01.523105 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d9e06582-89c8-40d2-8e53-4ed02fb4aaad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:01.565533 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d50c7c24-29ca-4b4f-8237-4de9108a0453 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:01.566150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d50c7c24-29ca-4b4f-8237-4de9108a0453 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:01.573546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d50c7c24-29ca-4b4f-8237-4de9108a0453 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:01.574002 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d50c7c24-29ca-4b4f-8237-4de9108a0453 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:01.574800 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d50c7c24-29ca-4b4f-8237-4de9108a0453 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:01.575278 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d50c7c24-29ca-4b4f-8237-4de9108a0453 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:01.657333 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d50c7c24-29ca-4b4f-8237-4de9108a0453 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:01.666042 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d50c7c24-29ca-4b4f-8237-4de9108a0453 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.105186 Jul 21 22:25:01.666615 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 882/1884] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:01 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:01.684565 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d9e06582-89c8-40d2-8e53-4ed02fb4aaad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:01.693205 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d9e06582-89c8-40d2-8e53-4ed02fb4aaad tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.183467 Jul 21 22:25:01.693776 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1003/1885] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:01 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:01.921049 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ebd39677-adec-4393-9fc8-205937c10499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:01.921658 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ebd39677-adec-4393-9fc8-205937c10499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:01.928005 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ebd39677-adec-4393-9fc8-205937c10499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:01.928456 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ebd39677-adec-4393-9fc8-205937c10499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:01.929219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ebd39677-adec-4393-9fc8-205937c10499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:01.929655 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ebd39677-adec-4393-9fc8-205937c10499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:02.063302 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ebd39677-adec-4393-9fc8-205937c10499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:02.071658 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ebd39677-adec-4393-9fc8-205937c10499 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.154413 Jul 21 22:25:02.072264 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 883/1886] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:01 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:02.683438 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8edcc495-568c-41d1-b296-729f18fed929 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:02.684056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8edcc495-568c-41d1-b296-729f18fed929 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:02.691248 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8edcc495-568c-41d1-b296-729f18fed929 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:02.691703 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8edcc495-568c-41d1-b296-729f18fed929 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:02.692470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8edcc495-568c-41d1-b296-729f18fed929 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:02.692910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8edcc495-568c-41d1-b296-729f18fed929 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:02.709688 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-13e525c5-b6f5-4ddd-8954-fe9a81963374 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:02.710420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-13e525c5-b6f5-4ddd-8954-fe9a81963374 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:02.716905 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13e525c5-b6f5-4ddd-8954-fe9a81963374 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:02.717361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13e525c5-b6f5-4ddd-8954-fe9a81963374 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:02.718138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13e525c5-b6f5-4ddd-8954-fe9a81963374 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:02.718578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13e525c5-b6f5-4ddd-8954-fe9a81963374 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:02.755912 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8edcc495-568c-41d1-b296-729f18fed929 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:02.763896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8edcc495-568c-41d1-b296-729f18fed929 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084497 Jul 21 22:25:02.764477 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1004/1887] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:02 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:02.851342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-13e525c5-b6f5-4ddd-8954-fe9a81963374 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:02.859159 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-13e525c5-b6f5-4ddd-8954-fe9a81963374 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.153267 Jul 21 22:25:02.859730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 884/1888] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:02 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:03.088649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-555e8464-6df9-4d2e-831e-60e6544cd920 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:03.089218 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-555e8464-6df9-4d2e-831e-60e6544cd920 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:03.096178 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-555e8464-6df9-4d2e-831e-60e6544cd920 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:03.096626 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-555e8464-6df9-4d2e-831e-60e6544cd920 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:03.097420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-555e8464-6df9-4d2e-831e-60e6544cd920 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:03.097851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-555e8464-6df9-4d2e-831e-60e6544cd920 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:03.223837 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-555e8464-6df9-4d2e-831e-60e6544cd920 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:03.231638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-555e8464-6df9-4d2e-831e-60e6544cd920 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146945 Jul 21 22:25:03.232206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1005/1889] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:03 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:03.780456 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fd305ad9-b0db-47f0-91f2-5acfc0cec44d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:03.781011 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fd305ad9-b0db-47f0-91f2-5acfc0cec44d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:03.788059 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fd305ad9-b0db-47f0-91f2-5acfc0cec44d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:03.788514 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fd305ad9-b0db-47f0-91f2-5acfc0cec44d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:03.789289 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fd305ad9-b0db-47f0-91f2-5acfc0cec44d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:03.789730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fd305ad9-b0db-47f0-91f2-5acfc0cec44d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:03.849939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fd305ad9-b0db-47f0-91f2-5acfc0cec44d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:03.857818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fd305ad9-b0db-47f0-91f2-5acfc0cec44d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081313 Jul 21 22:25:03.858386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 885/1890] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:03 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:03.876306 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-37be2d7c-0a3f-49dd-b7a1-022838178e3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:03.876920 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-37be2d7c-0a3f-49dd-b7a1-022838178e3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:03.883581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37be2d7c-0a3f-49dd-b7a1-022838178e3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:03.884029 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37be2d7c-0a3f-49dd-b7a1-022838178e3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:03.884795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37be2d7c-0a3f-49dd-b7a1-022838178e3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:03.885232 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37be2d7c-0a3f-49dd-b7a1-022838178e3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:04.016666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-37be2d7c-0a3f-49dd-b7a1-022838178e3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:04.024997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-37be2d7c-0a3f-49dd-b7a1-022838178e3f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152596 Jul 21 22:25:04.025557 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1006/1891] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:03 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:04.248403 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3ed7a464-a7ae-42e4-b984-aefc11983017 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:04.249042 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3ed7a464-a7ae-42e4-b984-aefc11983017 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:04.258635 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3ed7a464-a7ae-42e4-b984-aefc11983017 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:04.259127 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3ed7a464-a7ae-42e4-b984-aefc11983017 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:04.259998 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3ed7a464-a7ae-42e4-b984-aefc11983017 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:04.260434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3ed7a464-a7ae-42e4-b984-aefc11983017 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:04.388860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3ed7a464-a7ae-42e4-b984-aefc11983017 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:04.397592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3ed7a464-a7ae-42e4-b984-aefc11983017 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.153059 Jul 21 22:25:04.398174 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 886/1892] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:04 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:04.875293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1178d624-b7e3-4689-866b-7c2285e828af tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:04.875900 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1178d624-b7e3-4689-866b-7c2285e828af tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:04.883171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1178d624-b7e3-4689-866b-7c2285e828af tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:04.883766 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1178d624-b7e3-4689-866b-7c2285e828af tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:04.884367 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1178d624-b7e3-4689-866b-7c2285e828af tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:04.884795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1178d624-b7e3-4689-866b-7c2285e828af tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:04.956396 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1178d624-b7e3-4689-866b-7c2285e828af tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:04.964477 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1178d624-b7e3-4689-866b-7c2285e828af tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.093113 Jul 21 22:25:04.965057 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1007/1893] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:04 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:05.041789 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8e143f94-672f-4959-8ddd-180f61796d54 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:05.042530 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8e143f94-672f-4959-8ddd-180f61796d54 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:05.049803 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e143f94-672f-4959-8ddd-180f61796d54 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:05.050257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e143f94-672f-4959-8ddd-180f61796d54 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:05.051043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e143f94-672f-4959-8ddd-180f61796d54 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:05.051487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e143f94-672f-4959-8ddd-180f61796d54 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:05.179152 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8e143f94-672f-4959-8ddd-180f61796d54 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:05.187084 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8e143f94-672f-4959-8ddd-180f61796d54 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149317 Jul 21 22:25:05.187664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 887/1894] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:05 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:05.414598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-14cf9398-419d-4188-ad88-bfdccb92a09d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:05.415264 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-14cf9398-419d-4188-ad88-bfdccb92a09d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:05.421386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-14cf9398-419d-4188-ad88-bfdccb92a09d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:05.421851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-14cf9398-419d-4188-ad88-bfdccb92a09d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:05.422628 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-14cf9398-419d-4188-ad88-bfdccb92a09d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:05.423095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-14cf9398-419d-4188-ad88-bfdccb92a09d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:05.553036 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-14cf9398-419d-4188-ad88-bfdccb92a09d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:05.560928 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-14cf9398-419d-4188-ad88-bfdccb92a09d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150230 Jul 21 22:25:05.561491 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1008/1895] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:05 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:05.981646 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-83f82375-9253-4151-8247-b164c6c5c3ff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:05.982285 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-83f82375-9253-4151-8247-b164c6c5c3ff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:05.989590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83f82375-9253-4151-8247-b164c6c5c3ff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:05.990042 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83f82375-9253-4151-8247-b164c6c5c3ff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:05.990808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83f82375-9253-4151-8247-b164c6c5c3ff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:05.991269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83f82375-9253-4151-8247-b164c6c5c3ff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:05.995520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:06.055400 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-83f82375-9253-4151-8247-b164c6c5c3ff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:06.063205 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-83f82375-9253-4151-8247-b164c6c5c3ff tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085342 Jul 21 22:25:06.063776 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 888/1896] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:05 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:06.204001 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d5cb0316-0d6d-4393-a78b-073629279480 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:06.205120 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d5cb0316-0d6d-4393-a78b-073629279480 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:06.212774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d5cb0316-0d6d-4393-a78b-073629279480 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:06.213229 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d5cb0316-0d6d-4393-a78b-073629279480 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:06.213998 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d5cb0316-0d6d-4393-a78b-073629279480 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:06.214439 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d5cb0316-0d6d-4393-a78b-073629279480 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:06.350400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d5cb0316-0d6d-4393-a78b-073629279480 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:06.358348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d5cb0316-0d6d-4393-a78b-073629279480 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.158237 Jul 21 22:25:06.358923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1009/1897] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:06 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:06.578552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e9fa58da-50e1-4701-aed0-11d8419e7fe1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:06.579109 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e9fa58da-50e1-4701-aed0-11d8419e7fe1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:06.585741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9fa58da-50e1-4701-aed0-11d8419e7fe1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:06.586190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9fa58da-50e1-4701-aed0-11d8419e7fe1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:06.586944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9fa58da-50e1-4701-aed0-11d8419e7fe1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:06.587405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9fa58da-50e1-4701-aed0-11d8419e7fe1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:06.711864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9fa58da-50e1-4701-aed0-11d8419e7fe1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:06.719929 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e9fa58da-50e1-4701-aed0-11d8419e7fe1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.145243 Jul 21 22:25:06.720497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 889/1898] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:06 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:07.079901 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9d6fe9da-50b3-4d48-aa7b-c7bce1318976 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:07.081378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9d6fe9da-50b3-4d48-aa7b-c7bce1318976 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:07.086460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9d6fe9da-50b3-4d48-aa7b-c7bce1318976 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:07.086907 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9d6fe9da-50b3-4d48-aa7b-c7bce1318976 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:07.087729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9d6fe9da-50b3-4d48-aa7b-c7bce1318976 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:07.088162 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9d6fe9da-50b3-4d48-aa7b-c7bce1318976 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:07.106604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:07.152915 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9d6fe9da-50b3-4d48-aa7b-c7bce1318976 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:07.161443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9d6fe9da-50b3-4d48-aa7b-c7bce1318976 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085846 Jul 21 22:25:07.162005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1010/1899] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:07 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:07.375749 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b0d0dc2f-c931-4473-8a98-4de065686476 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:07.376832 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b0d0dc2f-c931-4473-8a98-4de065686476 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:07.383479 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0d0dc2f-c931-4473-8a98-4de065686476 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:07.383931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0d0dc2f-c931-4473-8a98-4de065686476 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:07.384707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0d0dc2f-c931-4473-8a98-4de065686476 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:07.385146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0d0dc2f-c931-4473-8a98-4de065686476 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:07.514341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b0d0dc2f-c931-4473-8a98-4de065686476 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:07.523236 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b0d0dc2f-c931-4473-8a98-4de065686476 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.151804 Jul 21 22:25:07.523820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 890/1900] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:07 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:07.737384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9ee3c9df-ca37-411c-8089-e994a34d7800 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:07.737996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9ee3c9df-ca37-411c-8089-e994a34d7800 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:07.744725 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ee3c9df-ca37-411c-8089-e994a34d7800 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:07.745178 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ee3c9df-ca37-411c-8089-e994a34d7800 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:07.745943 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ee3c9df-ca37-411c-8089-e994a34d7800 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:07.746379 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ee3c9df-ca37-411c-8089-e994a34d7800 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:07.873250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9ee3c9df-ca37-411c-8089-e994a34d7800 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:07.881545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9ee3c9df-ca37-411c-8089-e994a34d7800 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148471 Jul 21 22:25:07.882429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1011/1901] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:07 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:08.177973 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-90d7d989-9347-4736-90e9-2651e705c392 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:08.178578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-90d7d989-9347-4736-90e9-2651e705c392 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:08.184561 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-90d7d989-9347-4736-90e9-2651e705c392 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:08.185018 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-90d7d989-9347-4736-90e9-2651e705c392 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:08.185779 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-90d7d989-9347-4736-90e9-2651e705c392 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:08.186214 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-90d7d989-9347-4736-90e9-2651e705c392 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:08.248828 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-90d7d989-9347-4736-90e9-2651e705c392 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:08.257110 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-90d7d989-9347-4736-90e9-2651e705c392 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082975 Jul 21 22:25:08.257671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 891/1902] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:08 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:08.540193 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fcda5b76-d632-46cd-8855-b9df4ad3652a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:08.540800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fcda5b76-d632-46cd-8855-b9df4ad3652a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:08.546877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fcda5b76-d632-46cd-8855-b9df4ad3652a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:08.547352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fcda5b76-d632-46cd-8855-b9df4ad3652a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:08.548156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fcda5b76-d632-46cd-8855-b9df4ad3652a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:08.548592 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fcda5b76-d632-46cd-8855-b9df4ad3652a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:08.682005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fcda5b76-d632-46cd-8855-b9df4ad3652a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:08.690237 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fcda5b76-d632-46cd-8855-b9df4ad3652a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.153969 Jul 21 22:25:08.690849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1012/1903] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:08 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:08.898460 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a6c1cd9a-bcc9-450f-99d8-4e5a1d23ef17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:08.899137 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a6c1cd9a-bcc9-450f-99d8-4e5a1d23ef17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:08.905581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6c1cd9a-bcc9-450f-99d8-4e5a1d23ef17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:08.906028 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6c1cd9a-bcc9-450f-99d8-4e5a1d23ef17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:08.906790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6c1cd9a-bcc9-450f-99d8-4e5a1d23ef17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:08.907251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6c1cd9a-bcc9-450f-99d8-4e5a1d23ef17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:09.037680 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a6c1cd9a-bcc9-450f-99d8-4e5a1d23ef17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:09.045667 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a6c1cd9a-bcc9-450f-99d8-4e5a1d23ef17 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.151075 Jul 21 22:25:09.046245 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 892/1904] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:08 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:09.273973 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7ef37af7-8224-4d6d-acc1-adf4afd5c85e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:09.274517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7ef37af7-8224-4d6d-acc1-adf4afd5c85e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:09.281046 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ef37af7-8224-4d6d-acc1-adf4afd5c85e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:09.281499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ef37af7-8224-4d6d-acc1-adf4afd5c85e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:09.282265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ef37af7-8224-4d6d-acc1-adf4afd5c85e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:09.283502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ef37af7-8224-4d6d-acc1-adf4afd5c85e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:09.349378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7ef37af7-8224-4d6d-acc1-adf4afd5c85e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:09.357221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7ef37af7-8224-4d6d-acc1-adf4afd5c85e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.087263 Jul 21 22:25:09.357787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1013/1905] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:09 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:09.708122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5519b545-053f-4848-8261-02cf80c752e4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:09.708744 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5519b545-053f-4848-8261-02cf80c752e4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:09.714811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5519b545-053f-4848-8261-02cf80c752e4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:09.715309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5519b545-053f-4848-8261-02cf80c752e4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:09.716088 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5519b545-053f-4848-8261-02cf80c752e4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:09.716527 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5519b545-053f-4848-8261-02cf80c752e4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:09.842955 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5519b545-053f-4848-8261-02cf80c752e4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:09.851131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5519b545-053f-4848-8261-02cf80c752e4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147478 Jul 21 22:25:09.851711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 893/1906] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:09 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:10.064748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-cbd69998-9d74-48dd-b338-9009d1a4551e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:10.065273 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-cbd69998-9d74-48dd-b338-9009d1a4551e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:10.071286 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cbd69998-9d74-48dd-b338-9009d1a4551e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:10.071743 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cbd69998-9d74-48dd-b338-9009d1a4551e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:10.072531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cbd69998-9d74-48dd-b338-9009d1a4551e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:10.072965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-cbd69998-9d74-48dd-b338-9009d1a4551e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:10.199618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-cbd69998-9d74-48dd-b338-9009d1a4551e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:10.207944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-cbd69998-9d74-48dd-b338-9009d1a4551e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148679 Jul 21 22:25:10.208510 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1014/1907] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:10 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:10.373925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-32f357d9-9ebd-4831-98ed-c8e48a5574bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:10.374618 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-32f357d9-9ebd-4831-98ed-c8e48a5574bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:10.381600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32f357d9-9ebd-4831-98ed-c8e48a5574bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:10.382053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32f357d9-9ebd-4831-98ed-c8e48a5574bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:10.382828 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32f357d9-9ebd-4831-98ed-c8e48a5574bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:10.383298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32f357d9-9ebd-4831-98ed-c8e48a5574bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:10.446712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-32f357d9-9ebd-4831-98ed-c8e48a5574bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:10.455273 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-32f357d9-9ebd-4831-98ed-c8e48a5574bd tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084720 Jul 21 22:25:10.455844 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 894/1908] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:10 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:10.871580 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-27b17f96-4c2a-492b-ab7a-9b9021abb6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:10.872196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-27b17f96-4c2a-492b-ab7a-9b9021abb6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:10.879365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-27b17f96-4c2a-492b-ab7a-9b9021abb6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:10.879816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-27b17f96-4c2a-492b-ab7a-9b9021abb6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:10.880584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-27b17f96-4c2a-492b-ab7a-9b9021abb6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:10.881022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-27b17f96-4c2a-492b-ab7a-9b9021abb6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:11.009222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-27b17f96-4c2a-492b-ab7a-9b9021abb6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:11.017308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-27b17f96-4c2a-492b-ab7a-9b9021abb6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149508 Jul 21 22:25:11.017888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1015/1909] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:10 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:11.224713 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-77f1ad3a-eb3b-4737-aae5-160c408b6b62 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:11.225333 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-77f1ad3a-eb3b-4737-aae5-160c408b6b62 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:11.231404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77f1ad3a-eb3b-4737-aae5-160c408b6b62 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:11.231864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77f1ad3a-eb3b-4737-aae5-160c408b6b62 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:11.232636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77f1ad3a-eb3b-4737-aae5-160c408b6b62 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:11.233079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77f1ad3a-eb3b-4737-aae5-160c408b6b62 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:11.356635 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-77f1ad3a-eb3b-4737-aae5-160c408b6b62 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:11.365286 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-77f1ad3a-eb3b-4737-aae5-160c408b6b62 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.144967 Jul 21 22:25:11.365862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 895/1910] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:11 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:11.473019 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-81120320-3f71-4d82-8536-f67ce7d6822a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:11.473641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-81120320-3f71-4d82-8536-f67ce7d6822a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:11.479780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81120320-3f71-4d82-8536-f67ce7d6822a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:11.480172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81120320-3f71-4d82-8536-f67ce7d6822a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:11.480944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81120320-3f71-4d82-8536-f67ce7d6822a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:11.481381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81120320-3f71-4d82-8536-f67ce7d6822a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:11.544455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-81120320-3f71-4d82-8536-f67ce7d6822a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:11.552337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-81120320-3f71-4d82-8536-f67ce7d6822a tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084269 Jul 21 22:25:11.552896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1016/1911] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:11 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:12.034221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b2be9a8d-be32-4ce7-bdad-ddc1264a1b83 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:12.034964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b2be9a8d-be32-4ce7-bdad-ddc1264a1b83 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:12.042197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2be9a8d-be32-4ce7-bdad-ddc1264a1b83 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:12.042656 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2be9a8d-be32-4ce7-bdad-ddc1264a1b83 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:12.043457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2be9a8d-be32-4ce7-bdad-ddc1264a1b83 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:12.043905 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2be9a8d-be32-4ce7-bdad-ddc1264a1b83 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:12.382330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-52fa28d2-bfd7-43fe-99ae-0298cbb54428 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:12.382982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-52fa28d2-bfd7-43fe-99ae-0298cbb54428 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:12.389448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-52fa28d2-bfd7-43fe-99ae-0298cbb54428 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:12.389902 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-52fa28d2-bfd7-43fe-99ae-0298cbb54428 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:12.390676 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-52fa28d2-bfd7-43fe-99ae-0298cbb54428 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:12.391147 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-52fa28d2-bfd7-43fe-99ae-0298cbb54428 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:12.399119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b2be9a8d-be32-4ce7-bdad-ddc1264a1b83 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:12.408315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b2be9a8d-be32-4ce7-bdad-ddc1264a1b83 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.377924 Jul 21 22:25:12.408900 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 896/1912] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:12 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:12.520692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-52fa28d2-bfd7-43fe-99ae-0298cbb54428 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:12.528578 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-52fa28d2-bfd7-43fe-99ae-0298cbb54428 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150162 Jul 21 22:25:12.529146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1017/1913] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:12 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:12.569379 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5c21d0d2-10d7-4268-ba70-bba0e9428386 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:12.569918 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5c21d0d2-10d7-4268-ba70-bba0e9428386 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:12.575860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5c21d0d2-10d7-4268-ba70-bba0e9428386 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:12.576308 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5c21d0d2-10d7-4268-ba70-bba0e9428386 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:12.577066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5c21d0d2-10d7-4268-ba70-bba0e9428386 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:12.577501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5c21d0d2-10d7-4268-ba70-bba0e9428386 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:12.640131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5c21d0d2-10d7-4268-ba70-bba0e9428386 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:12.648619 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5c21d0d2-10d7-4268-ba70-bba0e9428386 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083061 Jul 21 22:25:12.649183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 897/1914] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:12 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:13.425500 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-38194b9c-a0e6-4fcb-a62f-9a538e79e229 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:13.426059 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-38194b9c-a0e6-4fcb-a62f-9a538e79e229 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:13.432520 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-38194b9c-a0e6-4fcb-a62f-9a538e79e229 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:13.432974 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-38194b9c-a0e6-4fcb-a62f-9a538e79e229 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:13.433747 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-38194b9c-a0e6-4fcb-a62f-9a538e79e229 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:13.434180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-38194b9c-a0e6-4fcb-a62f-9a538e79e229 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:13.545583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e24b5cee-d35d-458d-a454-1927ecf79005 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:13.546206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e24b5cee-d35d-458d-a454-1927ecf79005 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:13.553221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e24b5cee-d35d-458d-a454-1927ecf79005 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:13.553674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e24b5cee-d35d-458d-a454-1927ecf79005 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:13.554445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e24b5cee-d35d-458d-a454-1927ecf79005 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:13.554884 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e24b5cee-d35d-458d-a454-1927ecf79005 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:13.561387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-38194b9c-a0e6-4fcb-a62f-9a538e79e229 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:13.569252 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-38194b9c-a0e6-4fcb-a62f-9a538e79e229 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148331 Jul 21 22:25:13.569817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1018/1915] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:13 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:13.665413 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d02d1a80-8bf0-4d1e-a345-fd60714d89e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:13.666019 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d02d1a80-8bf0-4d1e-a345-fd60714d89e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:13.673087 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d02d1a80-8bf0-4d1e-a345-fd60714d89e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:13.673537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d02d1a80-8bf0-4d1e-a345-fd60714d89e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:13.674302 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d02d1a80-8bf0-4d1e-a345-fd60714d89e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:13.674735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d02d1a80-8bf0-4d1e-a345-fd60714d89e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:13.694515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e24b5cee-d35d-458d-a454-1927ecf79005 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:13.702650 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e24b5cee-d35d-458d-a454-1927ecf79005 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.160912 Jul 21 22:25:13.703248 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 898/1916] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:13 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:13.735472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d02d1a80-8bf0-4d1e-a345-fd60714d89e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:13.743394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d02d1a80-8bf0-4d1e-a345-fd60714d89e6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081916 Jul 21 22:25:13.743914 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1019/1917] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:13 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:14.586182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ff917b61-8f31-4e62-ac43-afcba14864c4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:14.586781 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ff917b61-8f31-4e62-ac43-afcba14864c4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:14.593124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff917b61-8f31-4e62-ac43-afcba14864c4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:14.593569 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff917b61-8f31-4e62-ac43-afcba14864c4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:14.594582 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff917b61-8f31-4e62-ac43-afcba14864c4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:14.595028 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff917b61-8f31-4e62-ac43-afcba14864c4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:14.720524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-84fe3121-9d3f-46eb-8d12-a37bffcece65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:14.720943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ff917b61-8f31-4e62-ac43-afcba14864c4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:14.721154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-84fe3121-9d3f-46eb-8d12-a37bffcece65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:14.727851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-84fe3121-9d3f-46eb-8d12-a37bffcece65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:14.728299 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-84fe3121-9d3f-46eb-8d12-a37bffcece65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:14.728780 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ff917b61-8f31-4e62-ac43-afcba14864c4 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146493 Jul 21 22:25:14.729066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-84fe3121-9d3f-46eb-8d12-a37bffcece65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:14.729359 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 899/1918] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:14 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:14.729579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-84fe3121-9d3f-46eb-8d12-a37bffcece65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:14.758899 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e9491cfa-5981-4448-988c-5a4e3fc32e21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:14.759595 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e9491cfa-5981-4448-988c-5a4e3fc32e21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:14.765596 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9491cfa-5981-4448-988c-5a4e3fc32e21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:14.766049 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9491cfa-5981-4448-988c-5a4e3fc32e21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:14.766932 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9491cfa-5981-4448-988c-5a4e3fc32e21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:14.767412 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9491cfa-5981-4448-988c-5a4e3fc32e21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:14.839931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9491cfa-5981-4448-988c-5a4e3fc32e21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:14.848576 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e9491cfa-5981-4448-988c-5a4e3fc32e21 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.093343 Jul 21 22:25:14.849352 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 900/1919] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:14 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:14.880659 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-84fe3121-9d3f-46eb-8d12-a37bffcece65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:14.888566 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-84fe3121-9d3f-46eb-8d12-a37bffcece65 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.172112 Jul 21 22:25:14.889361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1020/1920] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:14 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:15.746600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-db7b9afd-12b3-48e8-88db-3cba490736dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:15.747169 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-db7b9afd-12b3-48e8-88db-3cba490736dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:15.754249 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db7b9afd-12b3-48e8-88db-3cba490736dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:15.754703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db7b9afd-12b3-48e8-88db-3cba490736dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:15.755513 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db7b9afd-12b3-48e8-88db-3cba490736dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:15.755953 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db7b9afd-12b3-48e8-88db-3cba490736dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:15.865386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0249e5e1-cc97-410c-bc50-a7c88b586e0b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:15.866090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0249e5e1-cc97-410c-bc50-a7c88b586e0b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:15.872618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0249e5e1-cc97-410c-bc50-a7c88b586e0b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:15.873143 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0249e5e1-cc97-410c-bc50-a7c88b586e0b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:15.873922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0249e5e1-cc97-410c-bc50-a7c88b586e0b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:15.874358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0249e5e1-cc97-410c-bc50-a7c88b586e0b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:15.880853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-db7b9afd-12b3-48e8-88db-3cba490736dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:15.888966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-db7b9afd-12b3-48e8-88db-3cba490736dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146084 Jul 21 22:25:15.889631 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 901/1921] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:15 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:15.905212 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f0327b8f-7117-4679-8527-faa482c0dcc5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:15.905821 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f0327b8f-7117-4679-8527-faa482c0dcc5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:15.911919 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0327b8f-7117-4679-8527-faa482c0dcc5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:15.912376 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0327b8f-7117-4679-8527-faa482c0dcc5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:15.913150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0327b8f-7117-4679-8527-faa482c0dcc5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:15.913587 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0327b8f-7117-4679-8527-faa482c0dcc5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:15.936746 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-0249e5e1-cc97-410c-bc50-a7c88b586e0b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:15.945683 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0249e5e1-cc97-410c-bc50-a7c88b586e0b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084145 Jul 21 22:25:15.955816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1021/1922] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:15 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:16.046309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f0327b8f-7117-4679-8527-faa482c0dcc5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:16.054699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f0327b8f-7117-4679-8527-faa482c0dcc5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.153230 Jul 21 22:25:16.055295 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 902/1923] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:15 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:16.905654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-505a0ff4-fc4e-44f1-a815-be154d3d3836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:16.906261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-505a0ff4-fc4e-44f1-a815-be154d3d3836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:16.912755 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-505a0ff4-fc4e-44f1-a815-be154d3d3836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:16.913203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-505a0ff4-fc4e-44f1-a815-be154d3d3836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:16.913967 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-505a0ff4-fc4e-44f1-a815-be154d3d3836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:16.914401 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-505a0ff4-fc4e-44f1-a815-be154d3d3836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:16.963570 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b2cd3164-2a4c-4bb2-be0c-2171ba8ccd10 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:16.964322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b2cd3164-2a4c-4bb2-be0c-2171ba8ccd10 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:16.971101 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2cd3164-2a4c-4bb2-be0c-2171ba8ccd10 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:16.971549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2cd3164-2a4c-4bb2-be0c-2171ba8ccd10 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:16.972317 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2cd3164-2a4c-4bb2-be0c-2171ba8ccd10 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:16.972753 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2cd3164-2a4c-4bb2-be0c-2171ba8ccd10 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:17.054149 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b2cd3164-2a4c-4bb2-be0c-2171ba8ccd10 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:17.062204 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b2cd3164-2a4c-4bb2-be0c-2171ba8ccd10 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.102555 Jul 21 22:25:17.062792 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 903/1924] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:16 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:17.070511 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-505a0ff4-fc4e-44f1-a815-be154d3d3836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:17.072755 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7b4c1aeb-da33-46bf-845f-4c8041e6c5d2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:17.073370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7b4c1aeb-da33-46bf-845f-4c8041e6c5d2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:17.078677 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-505a0ff4-fc4e-44f1-a815-be154d3d3836 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.176868 Jul 21 22:25:17.079270 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1022/1925] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:16 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:17.079429 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b4c1aeb-da33-46bf-845f-4c8041e6c5d2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:17.079750 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b4c1aeb-da33-46bf-845f-4c8041e6c5d2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:17.080526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b4c1aeb-da33-46bf-845f-4c8041e6c5d2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:17.080966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b4c1aeb-da33-46bf-845f-4c8041e6c5d2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:17.214868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7b4c1aeb-da33-46bf-845f-4c8041e6c5d2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:17.218307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:17.224373 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7b4c1aeb-da33-46bf-845f-4c8041e6c5d2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.155314 Jul 21 22:25:17.224942 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 904/1926] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:17 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:18.078927 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ccd8e8ba-cdba-4d26-9d48-a663dcf39381 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:18.079721 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ccd8e8ba-cdba-4d26-9d48-a663dcf39381 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:18.086160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccd8e8ba-cdba-4d26-9d48-a663dcf39381 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:18.086610 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccd8e8ba-cdba-4d26-9d48-a663dcf39381 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:18.087463 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccd8e8ba-cdba-4d26-9d48-a663dcf39381 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:18.087903 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccd8e8ba-cdba-4d26-9d48-a663dcf39381 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:18.096319 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7993d639-de54-499d-b765-327082fe3f38 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:18.097021 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7993d639-de54-499d-b765-327082fe3f38 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:18.103965 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7993d639-de54-499d-b765-327082fe3f38 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:18.104430 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7993d639-de54-499d-b765-327082fe3f38 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:18.105198 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7993d639-de54-499d-b765-327082fe3f38 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:18.105632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7993d639-de54-499d-b765-327082fe3f38 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:18.151577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ccd8e8ba-cdba-4d26-9d48-a663dcf39381 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:18.160223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ccd8e8ba-cdba-4d26-9d48-a663dcf39381 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085150 Jul 21 22:25:18.160810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1023/1927] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:18 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:18.241431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-250b1c53-f263-4c0a-95d4-7df6bafc25dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:18.242038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-250b1c53-f263-4c0a-95d4-7df6bafc25dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:18.248277 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-250b1c53-f263-4c0a-95d4-7df6bafc25dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:18.248733 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-250b1c53-f263-4c0a-95d4-7df6bafc25dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:18.249505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-250b1c53-f263-4c0a-95d4-7df6bafc25dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:18.250052 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-250b1c53-f263-4c0a-95d4-7df6bafc25dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:18.250276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7993d639-de54-499d-b765-327082fe3f38 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:18.258250 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7993d639-de54-499d-b765-327082fe3f38 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.166354 Jul 21 22:25:18.258764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 905/1928] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:18 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:18.376355 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-250b1c53-f263-4c0a-95d4-7df6bafc25dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:18.384265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-250b1c53-f263-4c0a-95d4-7df6bafc25dc tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146681 Jul 21 22:25:18.384827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1024/1929] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:18 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:19.176906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7afc279a-d587-45cb-a6a0-8d3225ef8d45 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:19.177549 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7afc279a-d587-45cb-a6a0-8d3225ef8d45 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:19.183922 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7afc279a-d587-45cb-a6a0-8d3225ef8d45 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:19.184375 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7afc279a-d587-45cb-a6a0-8d3225ef8d45 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:19.185143 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7afc279a-d587-45cb-a6a0-8d3225ef8d45 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:19.185579 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7afc279a-d587-45cb-a6a0-8d3225ef8d45 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:19.245778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7afc279a-d587-45cb-a6a0-8d3225ef8d45 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:19.253665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7afc279a-d587-45cb-a6a0-8d3225ef8d45 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080595 Jul 21 22:25:19.254232 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 906/1930] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:19 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:19.275335 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a07dc807-fe96-440f-b572-f3208bb927c8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:19.275953 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a07dc807-fe96-440f-b572-f3208bb927c8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:19.283088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a07dc807-fe96-440f-b572-f3208bb927c8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:19.283547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a07dc807-fe96-440f-b572-f3208bb927c8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:19.284322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a07dc807-fe96-440f-b572-f3208bb927c8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:19.284763 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a07dc807-fe96-440f-b572-f3208bb927c8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:19.401754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-39f414f2-e80b-4f7a-9c15-3fcf8238fbfb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:19.402367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-39f414f2-e80b-4f7a-9c15-3fcf8238fbfb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:19.408465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39f414f2-e80b-4f7a-9c15-3fcf8238fbfb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:19.408916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39f414f2-e80b-4f7a-9c15-3fcf8238fbfb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:19.409707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39f414f2-e80b-4f7a-9c15-3fcf8238fbfb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:19.410128 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39f414f2-e80b-4f7a-9c15-3fcf8238fbfb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:19.417151 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a07dc807-fe96-440f-b572-f3208bb927c8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:19.425015 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a07dc807-fe96-440f-b572-f3208bb927c8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.153470 Jul 21 22:25:19.426019 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1025/1931] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:19 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:19.536789 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-39f414f2-e80b-4f7a-9c15-3fcf8238fbfb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:19.544737 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-39f414f2-e80b-4f7a-9c15-3fcf8238fbfb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146823 Jul 21 22:25:19.545314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 907/1932] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:19 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:20.276066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9dc22c6c-dcb2-4651-a6b7-6f21ca6f74a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:20.276678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9dc22c6c-dcb2-4651-a6b7-6f21ca6f74a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:20.283315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9dc22c6c-dcb2-4651-a6b7-6f21ca6f74a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:20.283798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9dc22c6c-dcb2-4651-a6b7-6f21ca6f74a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:20.284574 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9dc22c6c-dcb2-4651-a6b7-6f21ca6f74a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:20.285011 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9dc22c6c-dcb2-4651-a6b7-6f21ca6f74a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:20.349216 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9dc22c6c-dcb2-4651-a6b7-6f21ca6f74a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:20.357700 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9dc22c6c-dcb2-4651-a6b7-6f21ca6f74a2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085525 Jul 21 22:25:20.358268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1026/1933] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:20 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:20.442230 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-724598e2-0ae8-4954-9aca-427544694207 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:20.442804 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-724598e2-0ae8-4954-9aca-427544694207 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:20.449368 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-724598e2-0ae8-4954-9aca-427544694207 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:20.449820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-724598e2-0ae8-4954-9aca-427544694207 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:20.450584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-724598e2-0ae8-4954-9aca-427544694207 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:20.451038 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-724598e2-0ae8-4954-9aca-427544694207 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:20.564735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2ccc412b-9125-4f7d-afe1-018d5ea25f4c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:20.565361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2ccc412b-9125-4f7d-afe1-018d5ea25f4c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:20.571542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2ccc412b-9125-4f7d-afe1-018d5ea25f4c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:20.571980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2ccc412b-9125-4f7d-afe1-018d5ea25f4c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:20.572770 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2ccc412b-9125-4f7d-afe1-018d5ea25f4c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:20.573221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2ccc412b-9125-4f7d-afe1-018d5ea25f4c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:20.577332 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:20.581654 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-724598e2-0ae8-4954-9aca-427544694207 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:20.590447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-724598e2-0ae8-4954-9aca-427544694207 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152664 Jul 21 22:25:20.591255 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 908/1934] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:20 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:20.710885 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2ccc412b-9125-4f7d-afe1-018d5ea25f4c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:20.719114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2ccc412b-9125-4f7d-afe1-018d5ea25f4c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.158656 Jul 21 22:25:20.719773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1027/1935] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:20 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:21.377074 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8620aa44-2a3f-4c25-b1be-9daa0781bf58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:21.377682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8620aa44-2a3f-4c25-b1be-9daa0781bf58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:21.385279 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8620aa44-2a3f-4c25-b1be-9daa0781bf58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:21.385731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8620aa44-2a3f-4c25-b1be-9daa0781bf58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:21.386565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8620aa44-2a3f-4c25-b1be-9daa0781bf58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:21.387015 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8620aa44-2a3f-4c25-b1be-9daa0781bf58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:21.452472 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8620aa44-2a3f-4c25-b1be-9daa0781bf58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:21.460799 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8620aa44-2a3f-4c25-b1be-9daa0781bf58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.089713 Jul 21 22:25:21.461367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 909/1936] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:21 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:21.608250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-acc61b0f-2c25-4261-9c51-138d4a8b014f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:21.608863 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-acc61b0f-2c25-4261-9c51-138d4a8b014f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:21.615391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-acc61b0f-2c25-4261-9c51-138d4a8b014f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:21.615843 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-acc61b0f-2c25-4261-9c51-138d4a8b014f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:21.616607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-acc61b0f-2c25-4261-9c51-138d4a8b014f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:21.617044 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-acc61b0f-2c25-4261-9c51-138d4a8b014f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:21.735874 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f11e6505-0543-4fd9-a864-961d88e82f2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:21.736489 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f11e6505-0543-4fd9-a864-961d88e82f2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:21.742400 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f11e6505-0543-4fd9-a864-961d88e82f2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:21.742853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f11e6505-0543-4fd9-a864-961d88e82f2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:21.743667 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f11e6505-0543-4fd9-a864-961d88e82f2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:21.744104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f11e6505-0543-4fd9-a864-961d88e82f2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:21.751789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-acc61b0f-2c25-4261-9c51-138d4a8b014f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:21.759723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-acc61b0f-2c25-4261-9c51-138d4a8b014f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.155314 Jul 21 22:25:21.760295 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1028/1937] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:21 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:21.870544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f11e6505-0543-4fd9-a864-961d88e82f2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:21.879038 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f11e6505-0543-4fd9-a864-961d88e82f2e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147025 Jul 21 22:25:21.879619 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 910/1938] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:21 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:22.478406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8c309d0a-190e-4b7e-b165-1593f82f255e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:22.479025 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8c309d0a-190e-4b7e-b165-1593f82f255e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:22.485111 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c309d0a-190e-4b7e-b165-1593f82f255e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:22.485564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c309d0a-190e-4b7e-b165-1593f82f255e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:22.486334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c309d0a-190e-4b7e-b165-1593f82f255e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:22.486772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8c309d0a-190e-4b7e-b165-1593f82f255e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:22.549343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8c309d0a-190e-4b7e-b165-1593f82f255e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:22.557202 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8c309d0a-190e-4b7e-b165-1593f82f255e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082652 Jul 21 22:25:22.557736 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1029/1939] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:22 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:22.777426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1e0fa5c5-7382-4e2d-a11d-591201d040d5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:22.778020 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1e0fa5c5-7382-4e2d-a11d-591201d040d5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:22.785241 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e0fa5c5-7382-4e2d-a11d-591201d040d5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:22.785694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e0fa5c5-7382-4e2d-a11d-591201d040d5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:22.786454 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e0fa5c5-7382-4e2d-a11d-591201d040d5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:22.786887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e0fa5c5-7382-4e2d-a11d-591201d040d5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:22.896589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6f4b6574-8fab-4809-ae5c-7705aef3d2de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:22.897197 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6f4b6574-8fab-4809-ae5c-7705aef3d2de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:22.903576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f4b6574-8fab-4809-ae5c-7705aef3d2de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:22.904030 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f4b6574-8fab-4809-ae5c-7705aef3d2de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:22.904808 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f4b6574-8fab-4809-ae5c-7705aef3d2de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:22.905248 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f4b6574-8fab-4809-ae5c-7705aef3d2de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:22.916913 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1e0fa5c5-7382-4e2d-a11d-591201d040d5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:22.924872 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1e0fa5c5-7382-4e2d-a11d-591201d040d5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.151258 Jul 21 22:25:22.925442 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 911/1940] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:22 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:23.032923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6f4b6574-8fab-4809-ae5c-7705aef3d2de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:23.041775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6f4b6574-8fab-4809-ae5c-7705aef3d2de tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149120 Jul 21 22:25:23.042346 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1030/1941] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:22 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:23.574336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-429e3156-a535-4c14-bd78-87beefe53d43 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:23.574950 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-429e3156-a535-4c14-bd78-87beefe53d43 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:23.581028 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-429e3156-a535-4c14-bd78-87beefe53d43 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:23.581481 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-429e3156-a535-4c14-bd78-87beefe53d43 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:23.582248 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-429e3156-a535-4c14-bd78-87beefe53d43 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:23.582691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-429e3156-a535-4c14-bd78-87beefe53d43 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:23.646186 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-429e3156-a535-4c14-bd78-87beefe53d43 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:23.654183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-429e3156-a535-4c14-bd78-87beefe53d43 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083761 Jul 21 22:25:23.654752 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 912/1942] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:23 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:23.942486 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-13546f6e-e32f-477d-816e-3fb445a04eae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:23.943116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-13546f6e-e32f-477d-816e-3fb445a04eae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:23.949574 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-13546f6e-e32f-477d-816e-3fb445a04eae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:23.950021 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-13546f6e-e32f-477d-816e-3fb445a04eae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:23.950777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-13546f6e-e32f-477d-816e-3fb445a04eae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:23.951240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-13546f6e-e32f-477d-816e-3fb445a04eae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:24.058889 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e33daf54-85a7-4c6e-aff5-8a2167f0006e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:24.059534 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e33daf54-85a7-4c6e-aff5-8a2167f0006e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:24.066397 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e33daf54-85a7-4c6e-aff5-8a2167f0006e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:24.066852 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e33daf54-85a7-4c6e-aff5-8a2167f0006e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:24.067779 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e33daf54-85a7-4c6e-aff5-8a2167f0006e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:24.068234 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e33daf54-85a7-4c6e-aff5-8a2167f0006e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:24.080523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-13546f6e-e32f-477d-816e-3fb445a04eae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:24.088686 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-13546f6e-e32f-477d-816e-3fb445a04eae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.150700 Jul 21 22:25:24.089251 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1031/1943] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:23 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:24.195623 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e33daf54-85a7-4c6e-aff5-8a2167f0006e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:24.203437 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e33daf54-85a7-4c6e-aff5-8a2167f0006e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148454 Jul 21 22:25:24.204012 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 913/1944] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:24 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:24.671272 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-aa68eb27-4db0-4465-bdeb-0f7b41f21379 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:24.671883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-aa68eb27-4db0-4465-bdeb-0f7b41f21379 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:24.678100 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa68eb27-4db0-4465-bdeb-0f7b41f21379 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:24.678547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa68eb27-4db0-4465-bdeb-0f7b41f21379 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:24.679346 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa68eb27-4db0-4465-bdeb-0f7b41f21379 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:24.679781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa68eb27-4db0-4465-bdeb-0f7b41f21379 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:24.744175 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-aa68eb27-4db0-4465-bdeb-0f7b41f21379 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:24.752499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-aa68eb27-4db0-4465-bdeb-0f7b41f21379 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085118 Jul 21 22:25:24.753063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1032/1945] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:24 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:25.106196 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-43afb40f-c6ff-4ac2-b0a3-70b5b515c46b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:25.106718 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-43afb40f-c6ff-4ac2-b0a3-70b5b515c46b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:25.113210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43afb40f-c6ff-4ac2-b0a3-70b5b515c46b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:25.113658 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43afb40f-c6ff-4ac2-b0a3-70b5b515c46b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:25.114417 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43afb40f-c6ff-4ac2-b0a3-70b5b515c46b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:25.114879 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43afb40f-c6ff-4ac2-b0a3-70b5b515c46b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:25.242937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-43afb40f-c6ff-4ac2-b0a3-70b5b515c46b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:25.250733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-43afb40f-c6ff-4ac2-b0a3-70b5b515c46b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148573 Jul 21 22:25:25.251338 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 914/1946] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:25 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:25.407691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b25ce423-5e15-49de-b982-33e55b485933 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:25.408308 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b25ce423-5e15-49de-b982-33e55b485933 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:25.414273 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b25ce423-5e15-49de-b982-33e55b485933 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:25.414731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b25ce423-5e15-49de-b982-33e55b485933 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:25.415542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b25ce423-5e15-49de-b982-33e55b485933 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:25.415985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b25ce423-5e15-49de-b982-33e55b485933 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:25.544847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b25ce423-5e15-49de-b982-33e55b485933 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:25.552918 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b25ce423-5e15-49de-b982-33e55b485933 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.336162 Jul 21 22:25:25.553487 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1033/1947] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:25 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:25.888215 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1a2db4d8-228a-44bc-aa24-f534cb5ae042 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:25.888833 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1a2db4d8-228a-44bc-aa24-f534cb5ae042 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:25.894812 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a2db4d8-228a-44bc-aa24-f534cb5ae042 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:25.895302 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a2db4d8-228a-44bc-aa24-f534cb5ae042 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:25.896103 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a2db4d8-228a-44bc-aa24-f534cb5ae042 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:25.896544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a2db4d8-228a-44bc-aa24-f534cb5ae042 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:25.959651 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1a2db4d8-228a-44bc-aa24-f534cb5ae042 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:25.967544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1a2db4d8-228a-44bc-aa24-f534cb5ae042 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.202361 Jul 21 22:25:25.968125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 915/1948] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:25 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:26.267906 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8be54f1b-249f-459c-a001-df428b0e37e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:26.268518 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8be54f1b-249f-459c-a001-df428b0e37e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:26.274992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8be54f1b-249f-459c-a001-df428b0e37e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:26.275474 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8be54f1b-249f-459c-a001-df428b0e37e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:26.276243 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8be54f1b-249f-459c-a001-df428b0e37e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:26.276679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8be54f1b-249f-459c-a001-df428b0e37e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:26.502225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8be54f1b-249f-459c-a001-df428b0e37e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:26.510387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8be54f1b-249f-459c-a001-df428b0e37e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.246368 Jul 21 22:25:26.510944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1034/1949] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:26 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:26.570070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2dc07948-c50a-445a-b884-298e06222950 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:26.570684 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2dc07948-c50a-445a-b884-298e06222950 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:26.577001 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2dc07948-c50a-445a-b884-298e06222950 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:26.577459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2dc07948-c50a-445a-b884-298e06222950 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:26.578237 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2dc07948-c50a-445a-b884-298e06222950 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:26.579204 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2dc07948-c50a-445a-b884-298e06222950 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:26.706008 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2dc07948-c50a-445a-b884-298e06222950 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:26.713937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2dc07948-c50a-445a-b884-298e06222950 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148265 Jul 21 22:25:26.714518 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 916/1950] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:26 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:26.984536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b0203857-58c6-4cf4-8e5c-c5c5505e8758 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:26.985739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b0203857-58c6-4cf4-8e5c-c5c5505e8758 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:26.991981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0203857-58c6-4cf4-8e5c-c5c5505e8758 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:26.992420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0203857-58c6-4cf4-8e5c-c5c5505e8758 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:26.993199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0203857-58c6-4cf4-8e5c-c5c5505e8758 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:26.993638 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0203857-58c6-4cf4-8e5c-c5c5505e8758 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:27.057469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b0203857-58c6-4cf4-8e5c-c5c5505e8758 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:27.065337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b0203857-58c6-4cf4-8e5c-c5c5505e8758 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084685 Jul 21 22:25:27.065906 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1035/1951] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:26 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:27.527976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-506c5dd5-7068-415a-a83d-c69c977f1f62 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:27.528585 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-506c5dd5-7068-415a-a83d-c69c977f1f62 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:27.535196 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-506c5dd5-7068-415a-a83d-c69c977f1f62 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:27.535646 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-506c5dd5-7068-415a-a83d-c69c977f1f62 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:27.536405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-506c5dd5-7068-415a-a83d-c69c977f1f62 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:27.536840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-506c5dd5-7068-415a-a83d-c69c977f1f62 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:27.713196 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-506c5dd5-7068-415a-a83d-c69c977f1f62 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:27.721269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-506c5dd5-7068-415a-a83d-c69c977f1f62 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.197203 Jul 21 22:25:27.721833 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 917/1952] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:27 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:27.732221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9ac93fc7-a126-410f-bd7d-6750696e2e87 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:27.732838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9ac93fc7-a126-410f-bd7d-6750696e2e87 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:27.738812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ac93fc7-a126-410f-bd7d-6750696e2e87 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:27.739259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ac93fc7-a126-410f-bd7d-6750696e2e87 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:27.740028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ac93fc7-a126-410f-bd7d-6750696e2e87 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:27.740464 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ac93fc7-a126-410f-bd7d-6750696e2e87 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:27.867617 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9ac93fc7-a126-410f-bd7d-6750696e2e87 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:27.875470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9ac93fc7-a126-410f-bd7d-6750696e2e87 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147038 Jul 21 22:25:27.876032 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1036/1953] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:27 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:28.082142 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-22a37284-882a-44a4-884d-f997f27bdbb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:28.082770 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-22a37284-882a-44a4-884d-f997f27bdbb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:28.088793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22a37284-882a-44a4-884d-f997f27bdbb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:28.089253 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22a37284-882a-44a4-884d-f997f27bdbb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:28.090047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22a37284-882a-44a4-884d-f997f27bdbb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:28.090515 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22a37284-882a-44a4-884d-f997f27bdbb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:28.154210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-22a37284-882a-44a4-884d-f997f27bdbb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:28.162782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-22a37284-882a-44a4-884d-f997f27bdbb8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085048 Jul 21 22:25:28.163392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 918/1954] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:28 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:28.738855 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-89c29343-cd2e-44df-a73f-ddc55ac9598d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:28.739489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-89c29343-cd2e-44df-a73f-ddc55ac9598d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:28.745923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-89c29343-cd2e-44df-a73f-ddc55ac9598d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:28.746370 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-89c29343-cd2e-44df-a73f-ddc55ac9598d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:28.747161 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-89c29343-cd2e-44df-a73f-ddc55ac9598d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:28.747593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-89c29343-cd2e-44df-a73f-ddc55ac9598d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:28.872496 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-89c29343-cd2e-44df-a73f-ddc55ac9598d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:28.880872 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-89c29343-cd2e-44df-a73f-ddc55ac9598d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.146337 Jul 21 22:25:28.881440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1037/1955] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:28 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:28.892146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-937f29a0-e3cd-4c36-9818-fd47775427e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:28.892758 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-937f29a0-e3cd-4c36-9818-fd47775427e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:28.899118 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-937f29a0-e3cd-4c36-9818-fd47775427e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:28.899576 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-937f29a0-e3cd-4c36-9818-fd47775427e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:28.900337 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-937f29a0-e3cd-4c36-9818-fd47775427e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:28.900769 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-937f29a0-e3cd-4c36-9818-fd47775427e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:29.026277 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-937f29a0-e3cd-4c36-9818-fd47775427e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:29.034785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-937f29a0-e3cd-4c36-9818-fd47775427e6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146373 Jul 21 22:25:29.035459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 919/1956] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:28 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:29.179689 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f1fe3987-6e69-4c52-9e81-922cca0763f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:29.180294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f1fe3987-6e69-4c52-9e81-922cca0763f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:29.186243 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1fe3987-6e69-4c52-9e81-922cca0763f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:29.186693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1fe3987-6e69-4c52-9e81-922cca0763f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:29.187484 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1fe3987-6e69-4c52-9e81-922cca0763f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:29.187924 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f1fe3987-6e69-4c52-9e81-922cca0763f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:29.252080 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f1fe3987-6e69-4c52-9e81-922cca0763f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:29.260187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f1fe3987-6e69-4c52-9e81-922cca0763f3 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084520 Jul 21 22:25:29.261407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1038/1957] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:29 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:29.898234 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-93feb850-6223-488a-9183-ff88e6c11972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:29.898845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-93feb850-6223-488a-9183-ff88e6c11972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:29.905338 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93feb850-6223-488a-9183-ff88e6c11972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:29.905796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93feb850-6223-488a-9183-ff88e6c11972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:29.906565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93feb850-6223-488a-9183-ff88e6c11972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:29.907022 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93feb850-6223-488a-9183-ff88e6c11972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:30.033355 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-93feb850-6223-488a-9183-ff88e6c11972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:30.041599 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-93feb850-6223-488a-9183-ff88e6c11972 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147250 Jul 21 22:25:30.042168 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 920/1958] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:29 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:30.055457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-afb25ea0-3b28-495b-8471-350e9edd01c0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:30.056072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-afb25ea0-3b28-495b-8471-350e9edd01c0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:30.063336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-afb25ea0-3b28-495b-8471-350e9edd01c0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:30.063798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-afb25ea0-3b28-495b-8471-350e9edd01c0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:30.064577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-afb25ea0-3b28-495b-8471-350e9edd01c0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:30.065018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-afb25ea0-3b28-495b-8471-350e9edd01c0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:30.192129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-afb25ea0-3b28-495b-8471-350e9edd01c0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:30.200022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-afb25ea0-3b28-495b-8471-350e9edd01c0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148427 Jul 21 22:25:30.200591 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1039/1959] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:30 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:30.283180 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2541fd4d-9c3b-4e11-beab-bce78275bece tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:30.283789 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2541fd4d-9c3b-4e11-beab-bce78275bece tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:30.289723 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2541fd4d-9c3b-4e11-beab-bce78275bece tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:30.290168 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2541fd4d-9c3b-4e11-beab-bce78275bece tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:30.290924 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2541fd4d-9c3b-4e11-beab-bce78275bece tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:30.291380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2541fd4d-9c3b-4e11-beab-bce78275bece tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:30.309379 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:30.356926 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2541fd4d-9c3b-4e11-beab-bce78275bece tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:30.365496 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2541fd4d-9c3b-4e11-beab-bce78275bece tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.088318 Jul 21 22:25:30.366064 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 921/1960] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:30 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:31.058812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1169219b-3797-4df5-8189-d086500d2064 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:31.059525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1169219b-3797-4df5-8189-d086500d2064 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:31.061886 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=76 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:31.067220 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1169219b-3797-4df5-8189-d086500d2064 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:31.067673 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1169219b-3797-4df5-8189-d086500d2064 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:31.068539 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1169219b-3797-4df5-8189-d086500d2064 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:31.068879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1169219b-3797-4df5-8189-d086500d2064 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:31.196455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1169219b-3797-4df5-8189-d086500d2064 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:31.204806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1169219b-3797-4df5-8189-d086500d2064 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149888 Jul 21 22:25:31.205379 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1040/1961] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:31 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:31.216864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7ec0e2d0-9c1f-49bc-afbe-b4b86bba6962 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:31.217487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7ec0e2d0-9c1f-49bc-afbe-b4b86bba6962 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:31.220728 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=84 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:31.226039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7ec0e2d0-9c1f-49bc-afbe-b4b86bba6962 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:31.226496 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7ec0e2d0-9c1f-49bc-afbe-b4b86bba6962 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:31.227303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7ec0e2d0-9c1f-49bc-afbe-b4b86bba6962 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:31.227748 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7ec0e2d0-9c1f-49bc-afbe-b4b86bba6962 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:31.355506 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7ec0e2d0-9c1f-49bc-afbe-b4b86bba6962 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:31.363564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7ec0e2d0-9c1f-49bc-afbe-b4b86bba6962 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150571 Jul 21 22:25:31.364142 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 922/1962] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:31 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:31.381962 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ddcf70d5-b084-45d1-8bbd-eee9c3a6a53e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:31.382610 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ddcf70d5-b084-45d1-8bbd-eee9c3a6a53e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:31.388642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddcf70d5-b084-45d1-8bbd-eee9c3a6a53e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:31.389100 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddcf70d5-b084-45d1-8bbd-eee9c3a6a53e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:31.389864 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddcf70d5-b084-45d1-8bbd-eee9c3a6a53e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:31.390302 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ddcf70d5-b084-45d1-8bbd-eee9c3a6a53e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:31.453389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ddcf70d5-b084-45d1-8bbd-eee9c3a6a53e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:31.461983 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ddcf70d5-b084-45d1-8bbd-eee9c3a6a53e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083815 Jul 21 22:25:31.462549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1041/1963] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:31 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:32.222572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-888994ca-b485-4f78-bd84-56ee2af5a4a5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:32.223258 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-888994ca-b485-4f78-bd84-56ee2af5a4a5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:32.229698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-888994ca-b485-4f78-bd84-56ee2af5a4a5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:32.230148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-888994ca-b485-4f78-bd84-56ee2af5a4a5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:32.230913 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-888994ca-b485-4f78-bd84-56ee2af5a4a5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:32.231389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-888994ca-b485-4f78-bd84-56ee2af5a4a5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:32.362432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-888994ca-b485-4f78-bd84-56ee2af5a4a5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:32.370823 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-888994ca-b485-4f78-bd84-56ee2af5a4a5 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152919 Jul 21 22:25:32.371426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 923/1964] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:32 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:32.380408 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-190f6628-0120-4c87-ac78-3f9872572a8e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:32.381219 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-190f6628-0120-4c87-ac78-3f9872572a8e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:32.387698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-190f6628-0120-4c87-ac78-3f9872572a8e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:32.388151 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-190f6628-0120-4c87-ac78-3f9872572a8e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:32.388914 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-190f6628-0120-4c87-ac78-3f9872572a8e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:32.389352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-190f6628-0120-4c87-ac78-3f9872572a8e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:32.481583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c0cf6ab7-6195-445f-8eb2-8826bec3f6c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:32.481583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c0cf6ab7-6195-445f-8eb2-8826bec3f6c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:32.486115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c0cf6ab7-6195-445f-8eb2-8826bec3f6c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:32.486574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c0cf6ab7-6195-445f-8eb2-8826bec3f6c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:32.487390 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c0cf6ab7-6195-445f-8eb2-8826bec3f6c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:32.487836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c0cf6ab7-6195-445f-8eb2-8826bec3f6c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:32.521286 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-190f6628-0120-4c87-ac78-3f9872572a8e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:32.529674 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-190f6628-0120-4c87-ac78-3f9872572a8e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.153076 Jul 21 22:25:32.530358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1042/1965] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:32 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:32.552623 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c0cf6ab7-6195-445f-8eb2-8826bec3f6c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:32.560657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c0cf6ab7-6195-445f-8eb2-8826bec3f6c8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085491 Jul 21 22:25:32.561259 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 924/1966] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:32 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:33.388124 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f0d6e72d-601e-4c56-ba38-0eceefdbec16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:33.388765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f0d6e72d-601e-4c56-ba38-0eceefdbec16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:33.395781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0d6e72d-601e-4c56-ba38-0eceefdbec16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:33.396236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0d6e72d-601e-4c56-ba38-0eceefdbec16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:33.397008 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0d6e72d-601e-4c56-ba38-0eceefdbec16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:33.397447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f0d6e72d-601e-4c56-ba38-0eceefdbec16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:33.526170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f0d6e72d-601e-4c56-ba38-0eceefdbec16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:33.529619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:33.535917 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f0d6e72d-601e-4c56-ba38-0eceefdbec16 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.151721 Jul 21 22:25:33.536490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1043/1967] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:33 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:33.546945 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3e4f4108-9d08-4050-b25f-896e92878825 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:33.547584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3e4f4108-9d08-4050-b25f-896e92878825 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:33.554052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3e4f4108-9d08-4050-b25f-896e92878825 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:33.554504 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3e4f4108-9d08-4050-b25f-896e92878825 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:33.555306 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3e4f4108-9d08-4050-b25f-896e92878825 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:33.555746 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3e4f4108-9d08-4050-b25f-896e92878825 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:33.577402 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9b3f92d7-2442-407f-831a-6ec063ca2f0d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:33.578003 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9b3f92d7-2442-407f-831a-6ec063ca2f0d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:33.584818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b3f92d7-2442-407f-831a-6ec063ca2f0d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:33.585266 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b3f92d7-2442-407f-831a-6ec063ca2f0d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:33.586023 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b3f92d7-2442-407f-831a-6ec063ca2f0d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:33.586459 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b3f92d7-2442-407f-831a-6ec063ca2f0d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:33.655726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9b3f92d7-2442-407f-831a-6ec063ca2f0d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:33.663584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9b3f92d7-2442-407f-831a-6ec063ca2f0d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.090186 Jul 21 22:25:33.664155 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1044/1968] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:33 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:33.710583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3e4f4108-9d08-4050-b25f-896e92878825 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:33.718610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3e4f4108-9d08-4050-b25f-896e92878825 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.175498 Jul 21 22:25:33.719475 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 925/1969] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:33 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:34.552533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b9a6e187-d63c-4f8b-adfc-c1b559c599fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:34.553144 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b9a6e187-d63c-4f8b-adfc-c1b559c599fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:34.559774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9a6e187-d63c-4f8b-adfc-c1b559c599fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:34.560164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9a6e187-d63c-4f8b-adfc-c1b559c599fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:34.560921 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9a6e187-d63c-4f8b-adfc-c1b559c599fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:34.561352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9a6e187-d63c-4f8b-adfc-c1b559c599fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:34.680296 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ec9028a7-0c99-4cdd-a209-2bc88ee1489b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:34.680946 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ec9028a7-0c99-4cdd-a209-2bc88ee1489b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:34.688327 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec9028a7-0c99-4cdd-a209-2bc88ee1489b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:34.688783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b9a6e187-d63c-4f8b-adfc-c1b559c599fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:34.688950 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec9028a7-0c99-4cdd-a209-2bc88ee1489b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:34.689562 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec9028a7-0c99-4cdd-a209-2bc88ee1489b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:34.690001 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec9028a7-0c99-4cdd-a209-2bc88ee1489b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:34.696957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b9a6e187-d63c-4f8b-adfc-c1b559c599fb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148291 Jul 21 22:25:34.697528 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1045/1970] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:34 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:34.736218 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-275f41e8-411c-4ad1-aa87-68be40744c7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:34.736828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-275f41e8-411c-4ad1-aa87-68be40744c7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:34.742937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-275f41e8-411c-4ad1-aa87-68be40744c7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:34.743420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-275f41e8-411c-4ad1-aa87-68be40744c7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:34.744183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-275f41e8-411c-4ad1-aa87-68be40744c7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:34.744619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-275f41e8-411c-4ad1-aa87-68be40744c7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:34.751354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ec9028a7-0c99-4cdd-a209-2bc88ee1489b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:34.759270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ec9028a7-0c99-4cdd-a209-2bc88ee1489b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082945 Jul 21 22:25:34.759846 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 926/1971] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:34 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:34.877716 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-275f41e8-411c-4ad1-aa87-68be40744c7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:34.885651 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-275f41e8-411c-4ad1-aa87-68be40744c7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.153701 Jul 21 22:25:34.886224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1046/1972] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:34 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:35.713590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3cdb8c2f-d975-43eb-8ba6-d9f81311dfe8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:35.714195 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3cdb8c2f-d975-43eb-8ba6-d9f81311dfe8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:35.721064 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3cdb8c2f-d975-43eb-8ba6-d9f81311dfe8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:35.721514 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3cdb8c2f-d975-43eb-8ba6-d9f81311dfe8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:35.722282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3cdb8c2f-d975-43eb-8ba6-d9f81311dfe8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:35.722715 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3cdb8c2f-d975-43eb-8ba6-d9f81311dfe8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:35.776406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b5aa2382-9e55-463e-88af-9b532a87088d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:35.776982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b5aa2382-9e55-463e-88af-9b532a87088d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:35.784174 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b5aa2382-9e55-463e-88af-9b532a87088d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:35.784625 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b5aa2382-9e55-463e-88af-9b532a87088d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:35.785387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b5aa2382-9e55-463e-88af-9b532a87088d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:35.785822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b5aa2382-9e55-463e-88af-9b532a87088d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:35.866364 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b5aa2382-9e55-463e-88af-9b532a87088d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:35.874250 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b5aa2382-9e55-463e-88af-9b532a87088d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.101967 Jul 21 22:25:35.875173 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1047/1973] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:35 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:35.877281 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3cdb8c2f-d975-43eb-8ba6-d9f81311dfe8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:35.885277 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3cdb8c2f-d975-43eb-8ba6-d9f81311dfe8 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.175537 Jul 21 22:25:35.885838 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 927/1974] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:35 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:35.905349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c165b721-35ed-4fce-ac41-c2f49b6a10be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:35.905961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c165b721-35ed-4fce-ac41-c2f49b6a10be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:35.912489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c165b721-35ed-4fce-ac41-c2f49b6a10be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:35.912948 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c165b721-35ed-4fce-ac41-c2f49b6a10be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:35.913713 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c165b721-35ed-4fce-ac41-c2f49b6a10be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:35.914148 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c165b721-35ed-4fce-ac41-c2f49b6a10be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:36.043642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c165b721-35ed-4fce-ac41-c2f49b6a10be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:36.052085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c165b721-35ed-4fce-ac41-c2f49b6a10be tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150472 Jul 21 22:25:36.052659 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1048/1975] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:35 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:36.890444 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e630b28c-32f5-406d-bb60-8789c68bf043 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:36.891106 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e630b28c-32f5-406d-bb60-8789c68bf043 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:36.900187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e630b28c-32f5-406d-bb60-8789c68bf043 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:36.900643 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e630b28c-32f5-406d-bb60-8789c68bf043 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:36.901533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-abc8bb5a-53f8-4b99-8e40-34a0d94f215a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:36.902145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-abc8bb5a-53f8-4b99-8e40-34a0d94f215a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:36.902268 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e630b28c-32f5-406d-bb60-8789c68bf043 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:36.902675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e630b28c-32f5-406d-bb60-8789c68bf043 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:36.908712 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-abc8bb5a-53f8-4b99-8e40-34a0d94f215a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:36.909163 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-abc8bb5a-53f8-4b99-8e40-34a0d94f215a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:36.909928 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-abc8bb5a-53f8-4b99-8e40-34a0d94f215a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:36.910394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-abc8bb5a-53f8-4b99-8e40-34a0d94f215a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:36.990764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e630b28c-32f5-406d-bb60-8789c68bf043 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:36.999122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e630b28c-32f5-406d-bb60-8789c68bf043 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.112475 Jul 21 22:25:36.999708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 928/1976] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:36 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:37.060735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-abc8bb5a-53f8-4b99-8e40-34a0d94f215a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:37.069407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-abc8bb5a-53f8-4b99-8e40-34a0d94f215a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.171669 Jul 21 22:25:37.069592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-911b06a4-1c77-489c-a049-c2e75e8505cb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:37.069985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1049/1977] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:36 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:37.070227 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-911b06a4-1c77-489c-a049-c2e75e8505cb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:37.076277 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-911b06a4-1c77-489c-a049-c2e75e8505cb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:37.076726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-911b06a4-1c77-489c-a049-c2e75e8505cb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:37.077863 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-911b06a4-1c77-489c-a049-c2e75e8505cb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:37.078301 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-911b06a4-1c77-489c-a049-c2e75e8505cb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:37.212620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-911b06a4-1c77-489c-a049-c2e75e8505cb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:37.220953 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-911b06a4-1c77-489c-a049-c2e75e8505cb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.155167 Jul 21 22:25:37.221554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 929/1978] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:37 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:38.017201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-15fc85e3-9d7d-4c90-90f4-c4adeb2fc8e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:38.017920 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-15fc85e3-9d7d-4c90-90f4-c4adeb2fc8e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:38.024569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15fc85e3-9d7d-4c90-90f4-c4adeb2fc8e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:38.025097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15fc85e3-9d7d-4c90-90f4-c4adeb2fc8e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:38.025937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15fc85e3-9d7d-4c90-90f4-c4adeb2fc8e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:38.026378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-15fc85e3-9d7d-4c90-90f4-c4adeb2fc8e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:38.089466 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e3958f45-9f1a-49b0-a340-0db60cf352c7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:38.089925 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-15fc85e3-9d7d-4c90-90f4-c4adeb2fc8e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:38.090087 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e3958f45-9f1a-49b0-a340-0db60cf352c7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:38.097151 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3958f45-9f1a-49b0-a340-0db60cf352c7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:38.097604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3958f45-9f1a-49b0-a340-0db60cf352c7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:38.097944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-15fc85e3-9d7d-4c90-90f4-c4adeb2fc8e9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085213 Jul 21 22:25:38.098386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3958f45-9f1a-49b0-a340-0db60cf352c7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:38.098848 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1050/1979] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:38 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:38.098989 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3958f45-9f1a-49b0-a340-0db60cf352c7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:38.228125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e3958f45-9f1a-49b0-a340-0db60cf352c7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:38.236855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e3958f45-9f1a-49b0-a340-0db60cf352c7 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152113 Jul 21 22:25:38.237440 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 930/1980] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:38 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:38.240976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-44af9ad1-c308-4f53-8c50-866a8d676b31 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:38.241660 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-44af9ad1-c308-4f53-8c50-866a8d676b31 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:38.248699 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-44af9ad1-c308-4f53-8c50-866a8d676b31 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:38.249148 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-44af9ad1-c308-4f53-8c50-866a8d676b31 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:38.250439 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-44af9ad1-c308-4f53-8c50-866a8d676b31 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:38.250881 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-44af9ad1-c308-4f53-8c50-866a8d676b31 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:38.378257 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-44af9ad1-c308-4f53-8c50-866a8d676b31 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:38.386109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-44af9ad1-c308-4f53-8c50-866a8d676b31 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.152350 Jul 21 22:25:38.386670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1051/1981] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:38 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:39.115393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ebe7773c-c255-4a19-9809-58d582e84030 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:39.116033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ebe7773c-c255-4a19-9809-58d582e84030 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:39.122475 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ebe7773c-c255-4a19-9809-58d582e84030 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:39.122959 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ebe7773c-c255-4a19-9809-58d582e84030 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:39.123751 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ebe7773c-c255-4a19-9809-58d582e84030 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:39.124192 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ebe7773c-c255-4a19-9809-58d582e84030 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:39.185432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ebe7773c-c255-4a19-9809-58d582e84030 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:39.193349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ebe7773c-c255-4a19-9809-58d582e84030 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081796 Jul 21 22:25:39.193915 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 931/1982] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:39 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:39.254181 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-37a4582d-3da3-4de1-8426-c03828a7c3fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:39.254783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-37a4582d-3da3-4de1-8426-c03828a7c3fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:39.261255 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37a4582d-3da3-4de1-8426-c03828a7c3fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:39.261698 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37a4582d-3da3-4de1-8426-c03828a7c3fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:39.262454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37a4582d-3da3-4de1-8426-c03828a7c3fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:39.262885 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-37a4582d-3da3-4de1-8426-c03828a7c3fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:39.390873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-37a4582d-3da3-4de1-8426-c03828a7c3fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:39.398774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-37a4582d-3da3-4de1-8426-c03828a7c3fe tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149137 Jul 21 22:25:39.399366 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1052/1983] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:39 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:39.403699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4d8226aa-5224-4935-8480-3a2e07fe389b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:39.404307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4d8226aa-5224-4935-8480-3a2e07fe389b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:39.410337 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d8226aa-5224-4935-8480-3a2e07fe389b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:39.410785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d8226aa-5224-4935-8480-3a2e07fe389b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:39.411577 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d8226aa-5224-4935-8480-3a2e07fe389b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:39.412012 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d8226aa-5224-4935-8480-3a2e07fe389b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:39.539278 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4d8226aa-5224-4935-8480-3a2e07fe389b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:39.545067 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:25:39.545271 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:25:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 (ip 10.222.0.44) !!! Jul 21 22:25:39.548881 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4d8226aa-5224-4935-8480-3a2e07fe389b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148914 Jul 21 22:25:39.550060 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 932/1984] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:39 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:40.210062 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-99c8be71-7c34-4169-a588-de07319736bb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:40.210670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-99c8be71-7c34-4169-a588-de07319736bb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:40.216679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-99c8be71-7c34-4169-a588-de07319736bb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:40.217134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-99c8be71-7c34-4169-a588-de07319736bb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:40.217898 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-99c8be71-7c34-4169-a588-de07319736bb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:40.218344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-99c8be71-7c34-4169-a588-de07319736bb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:40.278539 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-99c8be71-7c34-4169-a588-de07319736bb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:40.287037 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-99c8be71-7c34-4169-a588-de07319736bb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080825 Jul 21 22:25:40.287600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1053/1985] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:40 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:40.415689 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4474b545-8a1a-411c-a550-74efce45af8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:40.416307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4474b545-8a1a-411c-a550-74efce45af8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:40.423642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4474b545-8a1a-411c-a550-74efce45af8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:40.424096 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4474b545-8a1a-411c-a550-74efce45af8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:40.424867 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4474b545-8a1a-411c-a550-74efce45af8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:40.425305 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4474b545-8a1a-411c-a550-74efce45af8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:40.555292 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4474b545-8a1a-411c-a550-74efce45af8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:40.563894 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4474b545-8a1a-411c-a550-74efce45af8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152063 Jul 21 22:25:40.564470 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 933/1986] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:40 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:40.565522 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2a36d9ac-cde4-4ae5-8b41-b460cba36083 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:40.566130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2a36d9ac-cde4-4ae5-8b41-b460cba36083 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:40.572186 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a36d9ac-cde4-4ae5-8b41-b460cba36083 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:40.572640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a36d9ac-cde4-4ae5-8b41-b460cba36083 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:40.573396 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a36d9ac-cde4-4ae5-8b41-b460cba36083 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:40.573825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2a36d9ac-cde4-4ae5-8b41-b460cba36083 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:40.701093 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2a36d9ac-cde4-4ae5-8b41-b460cba36083 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:40.709005 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2a36d9ac-cde4-4ae5-8b41-b460cba36083 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147238 Jul 21 22:25:40.709582 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1054/1987] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:40 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:41.303971 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-84791a31-332e-4436-a085-dd05e7fb463f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:41.304587 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-84791a31-332e-4436-a085-dd05e7fb463f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:41.310698 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84791a31-332e-4436-a085-dd05e7fb463f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:41.311190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84791a31-332e-4436-a085-dd05e7fb463f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:41.311993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84791a31-332e-4436-a085-dd05e7fb463f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:41.312431 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84791a31-332e-4436-a085-dd05e7fb463f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:41.372163 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-84791a31-332e-4436-a085-dd05e7fb463f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:41.380239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-84791a31-332e-4436-a085-dd05e7fb463f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.080112 Jul 21 22:25:41.380809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 934/1988] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:41 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:41.581461 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-868a8547-be48-4b8e-b9a2-2f4051cfdf65 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:41.582093 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-868a8547-be48-4b8e-b9a2-2f4051cfdf65 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:41.588402 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-868a8547-be48-4b8e-b9a2-2f4051cfdf65 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:41.588846 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-868a8547-be48-4b8e-b9a2-2f4051cfdf65 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:41.589600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-868a8547-be48-4b8e-b9a2-2f4051cfdf65 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:41.590033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-868a8547-be48-4b8e-b9a2-2f4051cfdf65 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:41.717514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-868a8547-be48-4b8e-b9a2-2f4051cfdf65 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:41.725478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9c283afe-aecd-4a90-8f1a-36379d41dceb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:41.726091 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9c283afe-aecd-4a90-8f1a-36379d41dceb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:41.726842 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-868a8547-be48-4b8e-b9a2-2f4051cfdf65 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149745 Jul 21 22:25:41.727465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1055/1989] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:41 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:41.733056 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9c283afe-aecd-4a90-8f1a-36379d41dceb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:41.733589 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9c283afe-aecd-4a90-8f1a-36379d41dceb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:41.734454 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9c283afe-aecd-4a90-8f1a-36379d41dceb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:41.734965 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9c283afe-aecd-4a90-8f1a-36379d41dceb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:41.860993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9c283afe-aecd-4a90-8f1a-36379d41dceb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:41.868834 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9c283afe-aecd-4a90-8f1a-36379d41dceb tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147097 Jul 21 22:25:41.869407 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 935/1990] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:41 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:42.397395 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4511f0e6-b5d7-4b35-9ee9-084752993efb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:42.398002 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4511f0e6-b5d7-4b35-9ee9-084752993efb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:42.404125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4511f0e6-b5d7-4b35-9ee9-084752993efb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:42.404573 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4511f0e6-b5d7-4b35-9ee9-084752993efb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:42.405337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4511f0e6-b5d7-4b35-9ee9-084752993efb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:42.405774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4511f0e6-b5d7-4b35-9ee9-084752993efb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:42.470020 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4511f0e6-b5d7-4b35-9ee9-084752993efb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:42.478226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4511f0e6-b5d7-4b35-9ee9-084752993efb tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084654 Jul 21 22:25:42.478803 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1056/1991] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:42 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:42.743929 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-05f5d051-b6cc-4920-aec7-3da76d9a6de3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:42.744559 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-05f5d051-b6cc-4920-aec7-3da76d9a6de3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:42.751604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-05f5d051-b6cc-4920-aec7-3da76d9a6de3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:42.752050 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-05f5d051-b6cc-4920-aec7-3da76d9a6de3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:42.752809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-05f5d051-b6cc-4920-aec7-3da76d9a6de3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:42.753243 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-05f5d051-b6cc-4920-aec7-3da76d9a6de3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:42.880535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-05f5d051-b6cc-4920-aec7-3da76d9a6de3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:42.885693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-68e289d9-6c16-4691-9f53-b5aae0deae1f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:42.886311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-68e289d9-6c16-4691-9f53-b5aae0deae1f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:42.888595 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-05f5d051-b6cc-4920-aec7-3da76d9a6de3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148512 Jul 21 22:25:42.889174 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 936/1992] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:42 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:42.893312 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-68e289d9-6c16-4691-9f53-b5aae0deae1f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:42.893763 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-68e289d9-6c16-4691-9f53-b5aae0deae1f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:42.894524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-68e289d9-6c16-4691-9f53-b5aae0deae1f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:42.894956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-68e289d9-6c16-4691-9f53-b5aae0deae1f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:43.022980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-68e289d9-6c16-4691-9f53-b5aae0deae1f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:43.030992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-68e289d9-6c16-4691-9f53-b5aae0deae1f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149246 Jul 21 22:25:43.031570 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1057/1993] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:42 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:43.495093 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d1ba41e6-e881-4d31-b179-3fc77df79081 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:43.495711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d1ba41e6-e881-4d31-b179-3fc77df79081 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:43.501661 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1ba41e6-e881-4d31-b179-3fc77df79081 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:43.502110 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1ba41e6-e881-4d31-b179-3fc77df79081 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:43.502911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1ba41e6-e881-4d31-b179-3fc77df79081 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:43.503375 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1ba41e6-e881-4d31-b179-3fc77df79081 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:43.566127 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d1ba41e6-e881-4d31-b179-3fc77df79081 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:43.574112 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d1ba41e6-e881-4d31-b179-3fc77df79081 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082903 Jul 21 22:25:43.574672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 937/1994] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:43 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:43.906603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3ecb769d-9add-482b-a3fc-f3da344ca9da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:43.907246 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3ecb769d-9add-482b-a3fc-f3da344ca9da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:43.913787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ecb769d-9add-482b-a3fc-f3da344ca9da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:43.914238 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ecb769d-9add-482b-a3fc-f3da344ca9da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:43.915026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ecb769d-9add-482b-a3fc-f3da344ca9da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:43.915465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3ecb769d-9add-482b-a3fc-f3da344ca9da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:44.046268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3ecb769d-9add-482b-a3fc-f3da344ca9da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:44.048040 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2441221d-6500-473f-8f67-03dad5110fa3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:44.048654 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2441221d-6500-473f-8f67-03dad5110fa3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:44.055102 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2441221d-6500-473f-8f67-03dad5110fa3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:44.055263 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3ecb769d-9add-482b-a3fc-f3da344ca9da tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152443 Jul 21 22:25:44.055556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2441221d-6500-473f-8f67-03dad5110fa3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:44.055768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1058/1995] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:43 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:44.056331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2441221d-6500-473f-8f67-03dad5110fa3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:44.056769 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2441221d-6500-473f-8f67-03dad5110fa3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:44.061569 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:44.187868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2441221d-6500-473f-8f67-03dad5110fa3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:44.195933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2441221d-6500-473f-8f67-03dad5110fa3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.152207 Jul 21 22:25:44.196520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 938/1996] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:44 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:44.590806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-45fba511-8277-4fe4-9670-ca6435373772 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:44.591439 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-45fba511-8277-4fe4-9670-ca6435373772 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:44.598159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-45fba511-8277-4fe4-9670-ca6435373772 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:44.598608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-45fba511-8277-4fe4-9670-ca6435373772 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:44.599406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-45fba511-8277-4fe4-9670-ca6435373772 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:44.599844 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-45fba511-8277-4fe4-9670-ca6435373772 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:44.662738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-45fba511-8277-4fe4-9670-ca6435373772 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:44.670693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-45fba511-8277-4fe4-9670-ca6435373772 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083786 Jul 21 22:25:44.671362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1059/1997] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:44 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:45.072893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e85e4fbf-d378-4849-8f28-50b117e4409e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:45.073506 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e85e4fbf-d378-4849-8f28-50b117e4409e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:45.080013 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e85e4fbf-d378-4849-8f28-50b117e4409e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:45.080466 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e85e4fbf-d378-4849-8f28-50b117e4409e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:45.081233 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e85e4fbf-d378-4849-8f28-50b117e4409e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:45.081671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e85e4fbf-d378-4849-8f28-50b117e4409e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:45.209546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e85e4fbf-d378-4849-8f28-50b117e4409e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:45.213531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5a5f4c3f-c9d4-4985-be0f-e64609881abf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:45.214138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5a5f4c3f-c9d4-4985-be0f-e64609881abf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:45.217559 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e85e4fbf-d378-4849-8f28-50b117e4409e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148590 Jul 21 22:25:45.218126 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 939/1998] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:45 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:45.221450 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a5f4c3f-c9d4-4985-be0f-e64609881abf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:45.221896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a5f4c3f-c9d4-4985-be0f-e64609881abf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:45.222653 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a5f4c3f-c9d4-4985-be0f-e64609881abf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:45.223120 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5a5f4c3f-c9d4-4985-be0f-e64609881abf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:45.240658 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:45.349176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5a5f4c3f-c9d4-4985-be0f-e64609881abf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:45.357133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5a5f4c3f-c9d4-4985-be0f-e64609881abf tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147584 Jul 21 22:25:45.357690 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1060/1999] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:45 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:45.687888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fc441e04-7608-439d-a094-3d218e845f70 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:45.688501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fc441e04-7608-439d-a094-3d218e845f70 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:45.694433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc441e04-7608-439d-a094-3d218e845f70 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:45.694888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc441e04-7608-439d-a094-3d218e845f70 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:45.695748 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc441e04-7608-439d-a094-3d218e845f70 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:45.696189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc441e04-7608-439d-a094-3d218e845f70 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:45.758552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fc441e04-7608-439d-a094-3d218e845f70 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:45.767040 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fc441e04-7608-439d-a094-3d218e845f70 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083470 Jul 21 22:25:45.767604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 940/2000] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:45 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:46.235152 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7cee49ba-59c5-4022-ab99-4774ba4b64d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:46.235762 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7cee49ba-59c5-4022-ab99-4774ba4b64d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:46.242222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7cee49ba-59c5-4022-ab99-4774ba4b64d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:46.242667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7cee49ba-59c5-4022-ab99-4774ba4b64d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:46.243464 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7cee49ba-59c5-4022-ab99-4774ba4b64d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:46.243900 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7cee49ba-59c5-4022-ab99-4774ba4b64d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:46.372430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7cee49ba-59c5-4022-ab99-4774ba4b64d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:46.374976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-23f606c9-d20c-45ff-b43c-5720ffc28224 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:46.375651 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-23f606c9-d20c-45ff-b43c-5720ffc28224 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:46.381409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7cee49ba-59c5-4022-ab99-4774ba4b64d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.150161 Jul 21 22:25:46.381982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1061/2001] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:46 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:46.382193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-23f606c9-d20c-45ff-b43c-5720ffc28224 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:46.382655 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-23f606c9-d20c-45ff-b43c-5720ffc28224 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:46.383465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-23f606c9-d20c-45ff-b43c-5720ffc28224 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:46.383912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-23f606c9-d20c-45ff-b43c-5720ffc28224 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:46.510899 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-23f606c9-d20c-45ff-b43c-5720ffc28224 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:46.519479 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-23f606c9-d20c-45ff-b43c-5720ffc28224 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148880 Jul 21 22:25:46.520049 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 941/2002] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:46 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:46.783650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6a1f33a6-5f89-48ff-bdb0-b8af0c1cc8b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:46.784178 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6a1f33a6-5f89-48ff-bdb0-b8af0c1cc8b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:46.790057 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a1f33a6-5f89-48ff-bdb0-b8af0c1cc8b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:46.790501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a1f33a6-5f89-48ff-bdb0-b8af0c1cc8b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:46.791292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a1f33a6-5f89-48ff-bdb0-b8af0c1cc8b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:46.791723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a1f33a6-5f89-48ff-bdb0-b8af0c1cc8b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:46.854933 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6a1f33a6-5f89-48ff-bdb0-b8af0c1cc8b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:46.863390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6a1f33a6-5f89-48ff-bdb0-b8af0c1cc8b9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083675 Jul 21 22:25:46.863950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1062/2003] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:46 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:47.399392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d30f7549-d8b1-4d9c-b127-f8ade8435596 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:47.400016 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d30f7549-d8b1-4d9c-b127-f8ade8435596 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:47.407170 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d30f7549-d8b1-4d9c-b127-f8ade8435596 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:47.407623 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d30f7549-d8b1-4d9c-b127-f8ade8435596 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:47.408394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d30f7549-d8b1-4d9c-b127-f8ade8435596 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:47.408836 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d30f7549-d8b1-4d9c-b127-f8ade8435596 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:47.537138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8247d0d1-377c-43c4-b5a2-2c72149a0d1a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:47.537812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8247d0d1-377c-43c4-b5a2-2c72149a0d1a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:47.544279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8247d0d1-377c-43c4-b5a2-2c72149a0d1a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:47.544728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8247d0d1-377c-43c4-b5a2-2c72149a0d1a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:47.545493 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8247d0d1-377c-43c4-b5a2-2c72149a0d1a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:47.545933 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8247d0d1-377c-43c4-b5a2-2c72149a0d1a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:47.547348 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d30f7549-d8b1-4d9c-b127-f8ade8435596 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:47.555533 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d30f7549-d8b1-4d9c-b127-f8ade8435596 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.160455 Jul 21 22:25:47.556116 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 942/2004] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:47 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:47.672810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8247d0d1-377c-43c4-b5a2-2c72149a0d1a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:47.680758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8247d0d1-377c-43c4-b5a2-2c72149a0d1a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147516 Jul 21 22:25:47.681320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1063/2005] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:47 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:47.879365 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a0a8cd16-b3a2-4b3b-8a9f-82c3c3474799 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:47.880027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a0a8cd16-b3a2-4b3b-8a9f-82c3c3474799 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:47.886025 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a0a8cd16-b3a2-4b3b-8a9f-82c3c3474799 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:47.886479 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a0a8cd16-b3a2-4b3b-8a9f-82c3c3474799 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:47.887276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a0a8cd16-b3a2-4b3b-8a9f-82c3c3474799 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:47.887715 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a0a8cd16-b3a2-4b3b-8a9f-82c3c3474799 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:47.952939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a0a8cd16-b3a2-4b3b-8a9f-82c3c3474799 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:47.960875 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a0a8cd16-b3a2-4b3b-8a9f-82c3c3474799 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085389 Jul 21 22:25:47.961439 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 943/2006] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:47 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:48.572601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8f6aedc1-6575-4ae1-9771-70a191bcb298 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:48.573136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8f6aedc1-6575-4ae1-9771-70a191bcb298 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:48.580202 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f6aedc1-6575-4ae1-9771-70a191bcb298 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:48.580658 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f6aedc1-6575-4ae1-9771-70a191bcb298 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:48.581423 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f6aedc1-6575-4ae1-9771-70a191bcb298 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:48.581859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f6aedc1-6575-4ae1-9771-70a191bcb298 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:48.697585 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-09af6aa1-4902-4508-a61d-20af2397d419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:48.698290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-09af6aa1-4902-4508-a61d-20af2397d419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:48.705371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09af6aa1-4902-4508-a61d-20af2397d419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:48.705833 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09af6aa1-4902-4508-a61d-20af2397d419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:48.706609 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09af6aa1-4902-4508-a61d-20af2397d419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:48.707074 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09af6aa1-4902-4508-a61d-20af2397d419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:48.708897 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8f6aedc1-6575-4ae1-9771-70a191bcb298 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:48.716840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8f6aedc1-6575-4ae1-9771-70a191bcb298 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148154 Jul 21 22:25:48.717416 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1064/2007] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:48 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:48.831558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-09af6aa1-4902-4508-a61d-20af2397d419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:48.839463 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-09af6aa1-4902-4508-a61d-20af2397d419 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.145654 Jul 21 22:25:48.840031 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 944/2008] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:48 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:48.977577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-65db657d-ab00-451f-8a22-7bd5d63b5107 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:48.978191 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-65db657d-ab00-451f-8a22-7bd5d63b5107 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:48.984735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-65db657d-ab00-451f-8a22-7bd5d63b5107 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:48.985183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-65db657d-ab00-451f-8a22-7bd5d63b5107 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:48.985949 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-65db657d-ab00-451f-8a22-7bd5d63b5107 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:48.986390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-65db657d-ab00-451f-8a22-7bd5d63b5107 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:49.051438 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-65db657d-ab00-451f-8a22-7bd5d63b5107 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:49.059348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-65db657d-ab00-451f-8a22-7bd5d63b5107 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085609 Jul 21 22:25:49.059919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1065/2009] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:48 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:49.734642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ed20d27e-1040-4250-93fb-2ff7e96884c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:49.735233 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ed20d27e-1040-4250-93fb-2ff7e96884c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:49.741671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed20d27e-1040-4250-93fb-2ff7e96884c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:49.742135 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed20d27e-1040-4250-93fb-2ff7e96884c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:49.742897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed20d27e-1040-4250-93fb-2ff7e96884c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:49.743357 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed20d27e-1040-4250-93fb-2ff7e96884c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:49.856757 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9ac36a58-f86a-42dc-8385-3f0d87399fa2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:49.857363 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9ac36a58-f86a-42dc-8385-3f0d87399fa2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:49.863725 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ac36a58-f86a-42dc-8385-3f0d87399fa2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:49.864172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ac36a58-f86a-42dc-8385-3f0d87399fa2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:49.864939 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ac36a58-f86a-42dc-8385-3f0d87399fa2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:49.865370 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9ac36a58-f86a-42dc-8385-3f0d87399fa2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:49.870329 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ed20d27e-1040-4250-93fb-2ff7e96884c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:49.878311 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ed20d27e-1040-4250-93fb-2ff7e96884c2 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148127 Jul 21 22:25:49.878883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 945/2010] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:49 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:49.992195 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9ac36a58-f86a-42dc-8385-3f0d87399fa2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:50.000001 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9ac36a58-f86a-42dc-8385-3f0d87399fa2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147076 Jul 21 22:25:50.000569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1066/2011] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:49 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:50.076760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4818fac5-070a-43a1-bb8d-150137ed6eb1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:50.077365 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4818fac5-070a-43a1-bb8d-150137ed6eb1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:50.083970 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4818fac5-070a-43a1-bb8d-150137ed6eb1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:50.084421 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4818fac5-070a-43a1-bb8d-150137ed6eb1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:50.085181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4818fac5-070a-43a1-bb8d-150137ed6eb1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:50.085620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4818fac5-070a-43a1-bb8d-150137ed6eb1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:50.149044 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4818fac5-070a-43a1-bb8d-150137ed6eb1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:50.156919 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4818fac5-070a-43a1-bb8d-150137ed6eb1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083968 Jul 21 22:25:50.157479 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 946/2012] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:50 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:50.895924 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c6698337-e0c5-4141-8b6e-05589581d1ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:50.896540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c6698337-e0c5-4141-8b6e-05589581d1ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:50.903549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c6698337-e0c5-4141-8b6e-05589581d1ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:50.904003 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c6698337-e0c5-4141-8b6e-05589581d1ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:50.904793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c6698337-e0c5-4141-8b6e-05589581d1ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:50.905260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c6698337-e0c5-4141-8b6e-05589581d1ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:51.017761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c7c5cbaa-75fe-4f8f-92ed-f466cb0dbd8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:51.018481 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c7c5cbaa-75fe-4f8f-92ed-f466cb0dbd8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:51.025124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c7c5cbaa-75fe-4f8f-92ed-f466cb0dbd8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:51.025653 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c7c5cbaa-75fe-4f8f-92ed-f466cb0dbd8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:51.026602 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c7c5cbaa-75fe-4f8f-92ed-f466cb0dbd8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:51.027140 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c7c5cbaa-75fe-4f8f-92ed-f466cb0dbd8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:51.040789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c6698337-e0c5-4141-8b6e-05589581d1ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:51.048656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c6698337-e0c5-4141-8b6e-05589581d1ae tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.156607 Jul 21 22:25:51.049256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1067/2013] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:50 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:51.153920 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c7c5cbaa-75fe-4f8f-92ed-f466cb0dbd8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:51.161838 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c7c5cbaa-75fe-4f8f-92ed-f466cb0dbd8a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148728 Jul 21 22:25:51.162404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 947/2014] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:51 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:51.174007 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d410a3ce-2d14-4035-8064-212070359fa1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:51.174640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d410a3ce-2d14-4035-8064-212070359fa1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:51.180673 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d410a3ce-2d14-4035-8064-212070359fa1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:51.181126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d410a3ce-2d14-4035-8064-212070359fa1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:51.181884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d410a3ce-2d14-4035-8064-212070359fa1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:51.182320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d410a3ce-2d14-4035-8064-212070359fa1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:51.251561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d410a3ce-2d14-4035-8064-212070359fa1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:51.264296 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d410a3ce-2d14-4035-8064-212070359fa1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.094625 Jul 21 22:25:51.264876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1068/2015] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:51 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:52.065614 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-84aa113f-e164-440c-b7da-68479306982d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:52.066247 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-84aa113f-e164-440c-b7da-68479306982d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:52.072767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84aa113f-e164-440c-b7da-68479306982d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:52.073220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84aa113f-e164-440c-b7da-68479306982d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:52.073981 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84aa113f-e164-440c-b7da-68479306982d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:52.074416 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84aa113f-e164-440c-b7da-68479306982d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:52.179462 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3f50ba7a-74d8-4ee9-8b3d-cffd819f21f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:52.180096 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3f50ba7a-74d8-4ee9-8b3d-cffd819f21f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:52.186816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3f50ba7a-74d8-4ee9-8b3d-cffd819f21f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:52.187302 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3f50ba7a-74d8-4ee9-8b3d-cffd819f21f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:52.188104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3f50ba7a-74d8-4ee9-8b3d-cffd819f21f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:52.188551 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3f50ba7a-74d8-4ee9-8b3d-cffd819f21f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:52.201565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-84aa113f-e164-440c-b7da-68479306982d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:52.210048 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-84aa113f-e164-440c-b7da-68479306982d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148270 Jul 21 22:25:52.210626 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 948/2016] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:52 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:52.283761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f725e299-762f-46a6-b7c3-907392f4c5f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:52.284888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f725e299-762f-46a6-b7c3-907392f4c5f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:52.291704 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f725e299-762f-46a6-b7c3-907392f4c5f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:52.292164 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f725e299-762f-46a6-b7c3-907392f4c5f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:52.292953 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f725e299-762f-46a6-b7c3-907392f4c5f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:52.293393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f725e299-762f-46a6-b7c3-907392f4c5f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:52.326044 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3f50ba7a-74d8-4ee9-8b3d-cffd819f21f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:52.335128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3f50ba7a-74d8-4ee9-8b3d-cffd819f21f3 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.159583 Jul 21 22:25:52.335706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1069/2017] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:52 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:52.370064 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f725e299-762f-46a6-b7c3-907392f4c5f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:52.378633 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f725e299-762f-46a6-b7c3-907392f4c5f4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.100600 Jul 21 22:25:52.379237 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 949/2018] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:52 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:53.228472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-50847cc3-2892-46a1-b5d1-8e531e25eb74 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:53.229079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-50847cc3-2892-46a1-b5d1-8e531e25eb74 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:53.235825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-50847cc3-2892-46a1-b5d1-8e531e25eb74 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:53.236284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-50847cc3-2892-46a1-b5d1-8e531e25eb74 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:53.237097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-50847cc3-2892-46a1-b5d1-8e531e25eb74 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:53.237539 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-50847cc3-2892-46a1-b5d1-8e531e25eb74 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:53.357672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f7ea0853-762c-42c8-94a2-79d011d05ba7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:53.358285 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f7ea0853-762c-42c8-94a2-79d011d05ba7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:53.363832 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-50847cc3-2892-46a1-b5d1-8e531e25eb74 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:53.364942 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f7ea0853-762c-42c8-94a2-79d011d05ba7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:53.365394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f7ea0853-762c-42c8-94a2-79d011d05ba7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:53.366175 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f7ea0853-762c-42c8-94a2-79d011d05ba7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:53.366613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f7ea0853-762c-42c8-94a2-79d011d05ba7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:53.371876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-50847cc3-2892-46a1-b5d1-8e531e25eb74 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147200 Jul 21 22:25:53.372453 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1070/2019] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:53 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:53.395596 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c61b0a96-acd2-4bcd-8b13-405b9d20ab61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:53.396209 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c61b0a96-acd2-4bcd-8b13-405b9d20ab61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:53.402128 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c61b0a96-acd2-4bcd-8b13-405b9d20ab61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:53.402593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c61b0a96-acd2-4bcd-8b13-405b9d20ab61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:53.403430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c61b0a96-acd2-4bcd-8b13-405b9d20ab61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:53.403877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c61b0a96-acd2-4bcd-8b13-405b9d20ab61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:53.481531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c61b0a96-acd2-4bcd-8b13-405b9d20ab61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:53.490262 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c61b0a96-acd2-4bcd-8b13-405b9d20ab61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.098341 Jul 21 22:25:53.490841 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1071/2020] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:53 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:53.524778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f7ea0853-762c-42c8-94a2-79d011d05ba7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:53.533664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f7ea0853-762c-42c8-94a2-79d011d05ba7 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.179812 Jul 21 22:25:53.534237 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 950/2021] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:53 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:54.389767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d97ef19f-8aa5-40c1-b291-5f7ce4649c0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:54.390373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d97ef19f-8aa5-40c1-b291-5f7ce4649c0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:54.397077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d97ef19f-8aa5-40c1-b291-5f7ce4649c0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:54.397521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d97ef19f-8aa5-40c1-b291-5f7ce4649c0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:54.398274 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d97ef19f-8aa5-40c1-b291-5f7ce4649c0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:54.398705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d97ef19f-8aa5-40c1-b291-5f7ce4649c0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:54.507774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-73d5d3f8-8382-4c7f-a8f9-226a3155d492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:54.508526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-73d5d3f8-8382-4c7f-a8f9-226a3155d492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:54.514923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73d5d3f8-8382-4c7f-a8f9-226a3155d492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:54.515369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73d5d3f8-8382-4c7f-a8f9-226a3155d492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:54.516172 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73d5d3f8-8382-4c7f-a8f9-226a3155d492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:54.516608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73d5d3f8-8382-4c7f-a8f9-226a3155d492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:54.525891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d97ef19f-8aa5-40c1-b291-5f7ce4649c0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:54.534382 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d97ef19f-8aa5-40c1-b291-5f7ce4649c0e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148466 Jul 21 22:25:54.534953 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1072/2022] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:54 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:54.549876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-70cb90ca-46e6-4131-a64a-efd400031bc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:54.550481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-70cb90ca-46e6-4131-a64a-efd400031bc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:54.556495 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-70cb90ca-46e6-4131-a64a-efd400031bc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:54.556950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-70cb90ca-46e6-4131-a64a-efd400031bc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:54.557716 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-70cb90ca-46e6-4131-a64a-efd400031bc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:54.558156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-70cb90ca-46e6-4131-a64a-efd400031bc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:54.580218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-73d5d3f8-8382-4c7f-a8f9-226a3155d492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:54.588401 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-73d5d3f8-8382-4c7f-a8f9-226a3155d492 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084495 Jul 21 22:25:54.588978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 951/2023] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:54 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:54.689183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-70cb90ca-46e6-4131-a64a-efd400031bc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:54.697282 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-70cb90ca-46e6-4131-a64a-efd400031bc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.151684 Jul 21 22:25:54.697841 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1073/2024] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:54 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:55.552156 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cd53c71b-65c6-4621-abfa-1eb3ed8f43d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:55.552760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cd53c71b-65c6-4621-abfa-1eb3ed8f43d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:55.559332 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd53c71b-65c6-4621-abfa-1eb3ed8f43d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:55.559785 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd53c71b-65c6-4621-abfa-1eb3ed8f43d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:55.560543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd53c71b-65c6-4621-abfa-1eb3ed8f43d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:55.560975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cd53c71b-65c6-4621-abfa-1eb3ed8f43d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:55.606797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6b530d41-ee30-4def-99d0-a8f8084562e8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:55.607449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6b530d41-ee30-4def-99d0-a8f8084562e8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:55.615565 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b530d41-ee30-4def-99d0-a8f8084562e8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:55.616013 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b530d41-ee30-4def-99d0-a8f8084562e8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:55.616775 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b530d41-ee30-4def-99d0-a8f8084562e8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:55.617207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6b530d41-ee30-4def-99d0-a8f8084562e8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:55.692036 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6b530d41-ee30-4def-99d0-a8f8084562e8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:55.699985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6b530d41-ee30-4def-99d0-a8f8084562e8 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.096937 Jul 21 22:25:55.700558 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1074/2025] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:55 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:55.713082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cd53c71b-65c6-4621-abfa-1eb3ed8f43d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:55.713525 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-63d28a86-cbde-45d4-9199-76962c901528 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:55.714175 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-63d28a86-cbde-45d4-9199-76962c901528 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:55.721560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-63d28a86-cbde-45d4-9199-76962c901528 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:55.721808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cd53c71b-65c6-4621-abfa-1eb3ed8f43d6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.173489 Jul 21 22:25:55.722025 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-63d28a86-cbde-45d4-9199-76962c901528 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:55.722402 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 952/2026] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:55 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:55.722806 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-63d28a86-cbde-45d4-9199-76962c901528 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:55.723354 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-63d28a86-cbde-45d4-9199-76962c901528 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:55.851913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-63d28a86-cbde-45d4-9199-76962c901528 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:55.859783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-63d28a86-cbde-45d4-9199-76962c901528 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150126 Jul 21 22:25:55.860347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1075/2027] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:55 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:56.717403 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e2924317-df1b-494b-b128-6127d1e48869 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:56.718904 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e2924317-df1b-494b-b128-6127d1e48869 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:56.725117 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e2924317-df1b-494b-b128-6127d1e48869 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:56.725601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e2924317-df1b-494b-b128-6127d1e48869 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:56.726381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e2924317-df1b-494b-b128-6127d1e48869 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:56.726822 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e2924317-df1b-494b-b128-6127d1e48869 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:56.737783 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f2fe47a3-4143-47be-b80a-6ba51e757d9a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:56.738361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f2fe47a3-4143-47be-b80a-6ba51e757d9a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:56.744570 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2fe47a3-4143-47be-b80a-6ba51e757d9a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:56.745028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2fe47a3-4143-47be-b80a-6ba51e757d9a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:56.745795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2fe47a3-4143-47be-b80a-6ba51e757d9a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:56.746233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2fe47a3-4143-47be-b80a-6ba51e757d9a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:56.790439 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e2924317-df1b-494b-b128-6127d1e48869 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:56.798528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e2924317-df1b-494b-b128-6127d1e48869 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085100 Jul 21 22:25:56.799129 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 953/2028] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:56 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:56.876507 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5735e515-d98f-4251-af71-e0d6920b13ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:56.877124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5735e515-d98f-4251-af71-e0d6920b13ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:56.882561 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f2fe47a3-4143-47be-b80a-6ba51e757d9a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:56.883322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5735e515-d98f-4251-af71-e0d6920b13ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:56.883774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5735e515-d98f-4251-af71-e0d6920b13ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:56.884545 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5735e515-d98f-4251-af71-e0d6920b13ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:56.884982 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5735e515-d98f-4251-af71-e0d6920b13ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:56.891196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f2fe47a3-4143-47be-b80a-6ba51e757d9a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.157199 Jul 21 22:25:56.891779 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1076/2029] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:56 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:57.016012 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5735e515-d98f-4251-af71-e0d6920b13ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:57.019508 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:57.025009 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5735e515-d98f-4251-af71-e0d6920b13ea tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.152810 Jul 21 22:25:57.025592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 954/2030] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:56 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:57.815998 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8fab3c03-c982-4b71-9cb5-11ea37689060 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:57.816555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8fab3c03-c982-4b71-9cb5-11ea37689060 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:57.822967 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8fab3c03-c982-4b71-9cb5-11ea37689060 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:57.823440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8fab3c03-c982-4b71-9cb5-11ea37689060 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:57.824199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8fab3c03-c982-4b71-9cb5-11ea37689060 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:57.824631 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8fab3c03-c982-4b71-9cb5-11ea37689060 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:57.829150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:25:57.885973 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8fab3c03-c982-4b71-9cb5-11ea37689060 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:57.894415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8fab3c03-c982-4b71-9cb5-11ea37689060 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082883 Jul 21 22:25:57.894981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1077/2031] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:57 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:57.907978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5e0a86d5-db69-4bf1-9b1e-9b1920a2ab19 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:57.908594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5e0a86d5-db69-4bf1-9b1e-9b1920a2ab19 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:57.915189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e0a86d5-db69-4bf1-9b1e-9b1920a2ab19 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:57.915645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e0a86d5-db69-4bf1-9b1e-9b1920a2ab19 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:57.916417 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e0a86d5-db69-4bf1-9b1e-9b1920a2ab19 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:57.916854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e0a86d5-db69-4bf1-9b1e-9b1920a2ab19 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:58.041633 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f86fc6e2-69d7-4705-979c-9356c756af25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:58.042196 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5e0a86d5-db69-4bf1-9b1e-9b1920a2ab19 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:58.042361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f86fc6e2-69d7-4705-979c-9356c756af25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:58.048726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f86fc6e2-69d7-4705-979c-9356c756af25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:58.049171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f86fc6e2-69d7-4705-979c-9356c756af25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:58.049930 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f86fc6e2-69d7-4705-979c-9356c756af25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:58.050362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f86fc6e2-69d7-4705-979c-9356c756af25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:58.051242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5e0a86d5-db69-4bf1-9b1e-9b1920a2ab19 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147012 Jul 21 22:25:58.051823 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 955/2032] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:57 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:58.180262 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f86fc6e2-69d7-4705-979c-9356c756af25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:58.188675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f86fc6e2-69d7-4705-979c-9356c756af25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150916 Jul 21 22:25:58.189251 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1078/2033] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:58 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:25:58.571552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:25:58.571775 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:25:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:25:58.910941 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-58f2fb9f-d935-4469-94ad-c3976a1a7ffe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:58.911604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-58f2fb9f-d935-4469-94ad-c3976a1a7ffe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:58.918073 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-58f2fb9f-d935-4469-94ad-c3976a1a7ffe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:58.918520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-58f2fb9f-d935-4469-94ad-c3976a1a7ffe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:58.919317 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-58f2fb9f-d935-4469-94ad-c3976a1a7ffe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:58.919752 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-58f2fb9f-d935-4469-94ad-c3976a1a7ffe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:58.980856 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-58f2fb9f-d935-4469-94ad-c3976a1a7ffe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:58.989199 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-58f2fb9f-d935-4469-94ad-c3976a1a7ffe tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082039 Jul 21 22:25:58.989767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 956/2034] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:58 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:59.068071 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-beca711a-9e25-4674-a53d-53e70530ac8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:59.068704 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-beca711a-9e25-4674-a53d-53e70530ac8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:59.075235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-beca711a-9e25-4674-a53d-53e70530ac8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:59.075682 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-beca711a-9e25-4674-a53d-53e70530ac8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:59.076436 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-beca711a-9e25-4674-a53d-53e70530ac8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:59.076873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-beca711a-9e25-4674-a53d-53e70530ac8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:59.204086 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-beca711a-9e25-4674-a53d-53e70530ac8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:59.205902 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-28998e70-8330-4a41-84b5-89e0fc1669c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:25:59.206527 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-28998e70-8330-4a41-84b5-89e0fc1669c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:25:59.212156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-beca711a-9e25-4674-a53d-53e70530ac8b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147881 Jul 21 22:25:59.212503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-28998e70-8330-4a41-84b5-89e0fc1669c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:59.212757 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1079/2035] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:59 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:25:59.212965 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-28998e70-8330-4a41-84b5-89e0fc1669c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:59.213748 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-28998e70-8330-4a41-84b5-89e0fc1669c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:25:59.214197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-28998e70-8330-4a41-84b5-89e0fc1669c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:25:59.564003 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-28998e70-8330-4a41-84b5-89e0fc1669c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:25:59.571921 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-28998e70-8330-4a41-84b5-89e0fc1669c8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.369977 Jul 21 22:25:59.572530 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 957/2036] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:25:59 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:00.005979 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-79ecebb6-a927-4da6-add0-9062a66ac196 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:00.006628 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-79ecebb6-a927-4da6-add0-9062a66ac196 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:00.012807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79ecebb6-a927-4da6-add0-9062a66ac196 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:00.013260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79ecebb6-a927-4da6-add0-9062a66ac196 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:00.014063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79ecebb6-a927-4da6-add0-9062a66ac196 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:00.014506 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-79ecebb6-a927-4da6-add0-9062a66ac196 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:00.076001 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-79ecebb6-a927-4da6-add0-9062a66ac196 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:00.083839 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-79ecebb6-a927-4da6-add0-9062a66ac196 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081719 Jul 21 22:26:00.084413 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1080/2037] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:00 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:00.229964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9901a896-2aa3-4eda-b1e8-53629139781d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:00.230528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9901a896-2aa3-4eda-b1e8-53629139781d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:00.237070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9901a896-2aa3-4eda-b1e8-53629139781d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:00.237522 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9901a896-2aa3-4eda-b1e8-53629139781d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:00.238292 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9901a896-2aa3-4eda-b1e8-53629139781d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:00.238731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9901a896-2aa3-4eda-b1e8-53629139781d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:00.375252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9901a896-2aa3-4eda-b1e8-53629139781d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:00.385651 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9901a896-2aa3-4eda-b1e8-53629139781d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.159615 Jul 21 22:26:00.386248 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 958/2038] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:00 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:00.589742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c5419d65-1385-4a81-a76c-5ef5683d2056 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:00.590352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c5419d65-1385-4a81-a76c-5ef5683d2056 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:00.596624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c5419d65-1385-4a81-a76c-5ef5683d2056 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:00.597072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c5419d65-1385-4a81-a76c-5ef5683d2056 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:00.597832 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c5419d65-1385-4a81-a76c-5ef5683d2056 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:00.598262 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c5419d65-1385-4a81-a76c-5ef5683d2056 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:00.728245 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c5419d65-1385-4a81-a76c-5ef5683d2056 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:00.736138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c5419d65-1385-4a81-a76c-5ef5683d2056 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150480 Jul 21 22:26:00.736657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1081/2039] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:00 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:01.101456 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-98f0b9d3-4558-430c-a7fb-3434724db9d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:01.101969 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-98f0b9d3-4558-430c-a7fb-3434724db9d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:01.107992 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-98f0b9d3-4558-430c-a7fb-3434724db9d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:01.108440 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-98f0b9d3-4558-430c-a7fb-3434724db9d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:01.109200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-98f0b9d3-4558-430c-a7fb-3434724db9d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:01.109635 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-98f0b9d3-4558-430c-a7fb-3434724db9d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:01.169400 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-98f0b9d3-4558-430c-a7fb-3434724db9d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:01.177245 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-98f0b9d3-4558-430c-a7fb-3434724db9d7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.079685 Jul 21 22:26:01.177808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 959/2040] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:01 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:01.403490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-03880bd0-4f4f-4ec1-9ae2-e38c8e4d6b37 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:01.404112 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-03880bd0-4f4f-4ec1-9ae2-e38c8e4d6b37 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:01.406419 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=84 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:01.411766 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-03880bd0-4f4f-4ec1-9ae2-e38c8e4d6b37 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:01.412217 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-03880bd0-4f4f-4ec1-9ae2-e38c8e4d6b37 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:01.412986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-03880bd0-4f4f-4ec1-9ae2-e38c8e4d6b37 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:01.413428 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-03880bd0-4f4f-4ec1-9ae2-e38c8e4d6b37 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:01.542877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-03880bd0-4f4f-4ec1-9ae2-e38c8e4d6b37 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:01.550750 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-03880bd0-4f4f-4ec1-9ae2-e38c8e4d6b37 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.151129 Jul 21 22:26:01.551349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1082/2041] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:01 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:01.753759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d887e1f7-1ef6-4185-a4c4-64c5f4f58431 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:01.754286 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d887e1f7-1ef6-4185-a4c4-64c5f4f58431 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:01.756573 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=76 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:01.762074 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d887e1f7-1ef6-4185-a4c4-64c5f4f58431 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:01.762524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d887e1f7-1ef6-4185-a4c4-64c5f4f58431 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:01.763322 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d887e1f7-1ef6-4185-a4c4-64c5f4f58431 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:01.763765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d887e1f7-1ef6-4185-a4c4-64c5f4f58431 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:01.890229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d887e1f7-1ef6-4185-a4c4-64c5f4f58431 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:01.898121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d887e1f7-1ef6-4185-a4c4-64c5f4f58431 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148860 Jul 21 22:26:01.898692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 960/2042] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:01 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:02.193883 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-db2c2ca2-6844-4984-b026-aa7555ab6af4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:02.194570 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-db2c2ca2-6844-4984-b026-aa7555ab6af4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:02.200526 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db2c2ca2-6844-4984-b026-aa7555ab6af4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:02.200973 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db2c2ca2-6844-4984-b026-aa7555ab6af4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:02.201726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db2c2ca2-6844-4984-b026-aa7555ab6af4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:02.202294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db2c2ca2-6844-4984-b026-aa7555ab6af4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:02.264344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-db2c2ca2-6844-4984-b026-aa7555ab6af4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:02.272442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-db2c2ca2-6844-4984-b026-aa7555ab6af4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082366 Jul 21 22:26:02.273020 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1083/2043] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:02 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:02.567641 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8511f9f9-73c5-460d-8ede-4d49b4ba7907 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:02.568259 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8511f9f9-73c5-460d-8ede-4d49b4ba7907 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:02.574300 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8511f9f9-73c5-460d-8ede-4d49b4ba7907 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:02.574757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8511f9f9-73c5-460d-8ede-4d49b4ba7907 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:02.575564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8511f9f9-73c5-460d-8ede-4d49b4ba7907 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:02.576011 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8511f9f9-73c5-460d-8ede-4d49b4ba7907 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:02.707712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8511f9f9-73c5-460d-8ede-4d49b4ba7907 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:02.715606 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8511f9f9-73c5-460d-8ede-4d49b4ba7907 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.151795 Jul 21 22:26:02.716176 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 961/2044] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:02 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:02.915519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-acb3532c-d79c-473c-bccc-6a1c8bb3ca8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:02.916171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-acb3532c-d79c-473c-bccc-6a1c8bb3ca8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:02.923255 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-acb3532c-d79c-473c-bccc-6a1c8bb3ca8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:02.923704 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-acb3532c-d79c-473c-bccc-6a1c8bb3ca8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:02.924454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-acb3532c-d79c-473c-bccc-6a1c8bb3ca8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:02.924887 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-acb3532c-d79c-473c-bccc-6a1c8bb3ca8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:03.055378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-acb3532c-d79c-473c-bccc-6a1c8bb3ca8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:03.063337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-acb3532c-d79c-473c-bccc-6a1c8bb3ca8b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.151650 Jul 21 22:26:03.063899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1084/2045] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:02 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:03.289773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-95ab4379-3d18-4710-afc3-4afdf786b2cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:03.290349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-95ab4379-3d18-4710-afc3-4afdf786b2cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:03.297826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95ab4379-3d18-4710-afc3-4afdf786b2cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:03.298273 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95ab4379-3d18-4710-afc3-4afdf786b2cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:03.299095 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95ab4379-3d18-4710-afc3-4afdf786b2cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:03.299532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95ab4379-3d18-4710-afc3-4afdf786b2cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:03.368508 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-95ab4379-3d18-4710-afc3-4afdf786b2cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:03.376457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-95ab4379-3d18-4710-afc3-4afdf786b2cf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.090657 Jul 21 22:26:03.377023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 962/2046] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:03 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:03.733461 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1e02e368-de3a-4af5-8186-0328af4f373f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:03.734065 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1e02e368-de3a-4af5-8186-0328af4f373f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:03.740102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1e02e368-de3a-4af5-8186-0328af4f373f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:03.740545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1e02e368-de3a-4af5-8186-0328af4f373f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:03.741299 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1e02e368-de3a-4af5-8186-0328af4f373f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:03.741725 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1e02e368-de3a-4af5-8186-0328af4f373f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:03.869807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1e02e368-de3a-4af5-8186-0328af4f373f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:03.878116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1e02e368-de3a-4af5-8186-0328af4f373f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148534 Jul 21 22:26:03.878676 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1085/2047] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:03 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:04.080350 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7465d841-71f5-4894-ad27-3d5387a5b28c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:04.080964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7465d841-71f5-4894-ad27-3d5387a5b28c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:04.087312 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7465d841-71f5-4894-ad27-3d5387a5b28c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:04.087768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7465d841-71f5-4894-ad27-3d5387a5b28c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:04.088531 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7465d841-71f5-4894-ad27-3d5387a5b28c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:04.088969 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7465d841-71f5-4894-ad27-3d5387a5b28c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:04.213321 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7465d841-71f5-4894-ad27-3d5387a5b28c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:04.221479 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7465d841-71f5-4894-ad27-3d5387a5b28c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.145041 Jul 21 22:26:04.222044 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 963/2048] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:04 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:04.393259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-351388fb-9033-4215-b555-196100396044 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:04.393894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-351388fb-9033-4215-b555-196100396044 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:04.400529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-351388fb-9033-4215-b555-196100396044 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:04.400978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-351388fb-9033-4215-b555-196100396044 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:04.401742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-351388fb-9033-4215-b555-196100396044 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:04.402179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-351388fb-9033-4215-b555-196100396044 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:04.466968 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-351388fb-9033-4215-b555-196100396044 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:04.475663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-351388fb-9033-4215-b555-196100396044 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.086355 Jul 21 22:26:04.476225 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1086/2049] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:04 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:04.895167 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-53f8acfb-63a2-4641-9981-0a83f92ec6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:04.895778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-53f8acfb-63a2-4641-9981-0a83f92ec6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:04.902211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53f8acfb-63a2-4641-9981-0a83f92ec6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:04.902658 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53f8acfb-63a2-4641-9981-0a83f92ec6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:04.903441 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53f8acfb-63a2-4641-9981-0a83f92ec6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:04.903875 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53f8acfb-63a2-4641-9981-0a83f92ec6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:05.028787 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-53f8acfb-63a2-4641-9981-0a83f92ec6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:05.037134 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-53f8acfb-63a2-4641-9981-0a83f92ec6f6 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.145966 Jul 21 22:26:05.037697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 964/2050] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:04 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:05.238486 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-08925845-f7b0-403c-bed8-6c7b5c61f391 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:05.239046 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-08925845-f7b0-403c-bed8-6c7b5c61f391 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:05.245094 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-08925845-f7b0-403c-bed8-6c7b5c61f391 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:05.245546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-08925845-f7b0-403c-bed8-6c7b5c61f391 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:05.246311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-08925845-f7b0-403c-bed8-6c7b5c61f391 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:05.246765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-08925845-f7b0-403c-bed8-6c7b5c61f391 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:05.371237 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-08925845-f7b0-403c-bed8-6c7b5c61f391 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:05.379403 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-08925845-f7b0-403c-bed8-6c7b5c61f391 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.144852 Jul 21 22:26:05.379974 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1087/2051] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:05 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:05.493581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c435e560-6ed9-4955-9668-7c2b22b79720 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:05.494137 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c435e560-6ed9-4955-9668-7c2b22b79720 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:05.500124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c435e560-6ed9-4955-9668-7c2b22b79720 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:05.500574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c435e560-6ed9-4955-9668-7c2b22b79720 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:05.501340 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c435e560-6ed9-4955-9668-7c2b22b79720 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:05.501781 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c435e560-6ed9-4955-9668-7c2b22b79720 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:05.564014 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c435e560-6ed9-4955-9668-7c2b22b79720 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:05.571933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c435e560-6ed9-4955-9668-7c2b22b79720 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082238 Jul 21 22:26:05.572490 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 965/2052] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:05 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:06.054523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c181568a-b859-462b-b4c4-942f5fe8fb9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:06.055156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c181568a-b859-462b-b4c4-942f5fe8fb9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:06.061705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c181568a-b859-462b-b4c4-942f5fe8fb9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:06.062154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c181568a-b859-462b-b4c4-942f5fe8fb9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:06.062906 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c181568a-b859-462b-b4c4-942f5fe8fb9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:06.063364 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c181568a-b859-462b-b4c4-942f5fe8fb9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:06.192387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c181568a-b859-462b-b4c4-942f5fe8fb9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:06.200292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c181568a-b859-462b-b4c4-942f5fe8fb9d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149606 Jul 21 22:26:06.200867 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1088/2053] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:06 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:06.399244 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b91cad1c-36b2-4a5a-9caa-188bd2e6c850 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:06.399914 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b91cad1c-36b2-4a5a-9caa-188bd2e6c850 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:06.407071 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b91cad1c-36b2-4a5a-9caa-188bd2e6c850 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:06.407526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b91cad1c-36b2-4a5a-9caa-188bd2e6c850 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:06.408298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b91cad1c-36b2-4a5a-9caa-188bd2e6c850 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:06.408742 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b91cad1c-36b2-4a5a-9caa-188bd2e6c850 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:06.536404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b91cad1c-36b2-4a5a-9caa-188bd2e6c850 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:06.544325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b91cad1c-36b2-4a5a-9caa-188bd2e6c850 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149939 Jul 21 22:26:06.544893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 966/2054] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:06 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:06.588887 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-512459a6-6226-43d3-bd96-ffeafb22e1d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:06.589442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-512459a6-6226-43d3-bd96-ffeafb22e1d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:06.595702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-512459a6-6226-43d3-bd96-ffeafb22e1d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:06.596160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-512459a6-6226-43d3-bd96-ffeafb22e1d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:06.596929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-512459a6-6226-43d3-bd96-ffeafb22e1d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:06.597373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-512459a6-6226-43d3-bd96-ffeafb22e1d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:06.660918 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-512459a6-6226-43d3-bd96-ffeafb22e1d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:06.669215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-512459a6-6226-43d3-bd96-ffeafb22e1d6 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084253 Jul 21 22:26:06.669795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1089/2055] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:06 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:07.218265 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-07fcd09a-faa7-47f5-a6e6-609a850fa4a9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:07.219188 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-07fcd09a-faa7-47f5-a6e6-609a850fa4a9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:07.225357 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07fcd09a-faa7-47f5-a6e6-609a850fa4a9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:07.225811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07fcd09a-faa7-47f5-a6e6-609a850fa4a9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:07.226582 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07fcd09a-faa7-47f5-a6e6-609a850fa4a9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:07.227044 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-07fcd09a-faa7-47f5-a6e6-609a850fa4a9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:07.353104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-07fcd09a-faa7-47f5-a6e6-609a850fa4a9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:07.360872 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-07fcd09a-faa7-47f5-a6e6-609a850fa4a9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147077 Jul 21 22:26:07.361434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 967/2056] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:07 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:07.561802 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8fbde3e8-489e-4b5b-baa8-39e30a667b8d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:07.562417 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8fbde3e8-489e-4b5b-baa8-39e30a667b8d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:07.568937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8fbde3e8-489e-4b5b-baa8-39e30a667b8d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:07.569384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8fbde3e8-489e-4b5b-baa8-39e30a667b8d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:07.570145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8fbde3e8-489e-4b5b-baa8-39e30a667b8d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:07.570577 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8fbde3e8-489e-4b5b-baa8-39e30a667b8d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:07.687163 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-009bfa65-8135-42c8-ad7b-c43b227ffcf1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:07.688471 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-009bfa65-8135-42c8-ad7b-c43b227ffcf1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:07.697025 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-009bfa65-8135-42c8-ad7b-c43b227ffcf1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:07.697479 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-009bfa65-8135-42c8-ad7b-c43b227ffcf1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:07.698019 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8fbde3e8-489e-4b5b-baa8-39e30a667b8d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:07.698258 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-009bfa65-8135-42c8-ad7b-c43b227ffcf1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:07.698694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-009bfa65-8135-42c8-ad7b-c43b227ffcf1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:07.708349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8fbde3e8-489e-4b5b-baa8-39e30a667b8d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150832 Jul 21 22:26:07.708953 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1090/2057] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:07 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:07.771732 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-009bfa65-8135-42c8-ad7b-c43b227ffcf1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:07.779796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-009bfa65-8135-42c8-ad7b-c43b227ffcf1 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.097181 Jul 21 22:26:07.781054 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 968/2058] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:07 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:08.378143 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-50f0cc96-b25c-48d4-9683-ca14795d5c73 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:08.378810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-50f0cc96-b25c-48d4-9683-ca14795d5c73 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:08.384952 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-50f0cc96-b25c-48d4-9683-ca14795d5c73 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:08.385405 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-50f0cc96-b25c-48d4-9683-ca14795d5c73 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:08.386169 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-50f0cc96-b25c-48d4-9683-ca14795d5c73 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:08.386609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-50f0cc96-b25c-48d4-9683-ca14795d5c73 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:08.517901 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-50f0cc96-b25c-48d4-9683-ca14795d5c73 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:08.525850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-50f0cc96-b25c-48d4-9683-ca14795d5c73 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152030 Jul 21 22:26:08.526416 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1091/2059] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:08 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:08.730622 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4ee2f8f9-f2a0-4001-b862-deb331f2c706 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:08.731295 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4ee2f8f9-f2a0-4001-b862-deb331f2c706 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:08.738390 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ee2f8f9-f2a0-4001-b862-deb331f2c706 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:08.738845 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ee2f8f9-f2a0-4001-b862-deb331f2c706 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:08.739646 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ee2f8f9-f2a0-4001-b862-deb331f2c706 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:08.740088 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4ee2f8f9-f2a0-4001-b862-deb331f2c706 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:08.797642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-05c257ef-c2d6-42f6-82ce-0f9318b640a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:08.798378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-05c257ef-c2d6-42f6-82ce-0f9318b640a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:08.804767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-05c257ef-c2d6-42f6-82ce-0f9318b640a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:08.805223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-05c257ef-c2d6-42f6-82ce-0f9318b640a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:08.805985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-05c257ef-c2d6-42f6-82ce-0f9318b640a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:08.806420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-05c257ef-c2d6-42f6-82ce-0f9318b640a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:08.879716 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-05c257ef-c2d6-42f6-82ce-0f9318b640a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:08.887505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-05c257ef-c2d6-42f6-82ce-0f9318b640a0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.094230 Jul 21 22:26:08.888070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1092/2060] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:08 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:08.895608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4ee2f8f9-f2a0-4001-b862-deb331f2c706 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:08.903645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4ee2f8f9-f2a0-4001-b862-deb331f2c706 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.176825 Jul 21 22:26:08.904217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 969/2061] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:08 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:09.542436 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b6a7391c-807e-46cb-a2a1-872acd57897b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:09.543068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b6a7391c-807e-46cb-a2a1-872acd57897b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:09.549082 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b6a7391c-807e-46cb-a2a1-872acd57897b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:09.549528 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b6a7391c-807e-46cb-a2a1-872acd57897b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:09.550280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b6a7391c-807e-46cb-a2a1-872acd57897b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:09.550709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b6a7391c-807e-46cb-a2a1-872acd57897b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:09.678814 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b6a7391c-807e-46cb-a2a1-872acd57897b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:09.684564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:09.690564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b6a7391c-807e-46cb-a2a1-872acd57897b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152224 Jul 21 22:26:09.691165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1093/2062] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:09 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:09.904110 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f217d81c-904e-4505-8e59-c353871df560 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:09.904716 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f217d81c-904e-4505-8e59-c353871df560 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:09.911313 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f217d81c-904e-4505-8e59-c353871df560 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:09.911761 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f217d81c-904e-4505-8e59-c353871df560 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:09.912524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f217d81c-904e-4505-8e59-c353871df560 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:09.912963 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f217d81c-904e-4505-8e59-c353871df560 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:09.921711 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d16d6de3-41d5-404f-839a-62a4b25f6a1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:09.922349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d16d6de3-41d5-404f-839a-62a4b25f6a1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:09.928764 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d16d6de3-41d5-404f-839a-62a4b25f6a1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:09.929243 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d16d6de3-41d5-404f-839a-62a4b25f6a1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:09.930012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d16d6de3-41d5-404f-839a-62a4b25f6a1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:09.930452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d16d6de3-41d5-404f-839a-62a4b25f6a1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:09.976490 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f217d81c-904e-4505-8e59-c353871df560 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:09.985070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f217d81c-904e-4505-8e59-c353871df560 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084759 Jul 21 22:26:09.985646 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 970/2063] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:09 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:10.073550 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d16d6de3-41d5-404f-839a-62a4b25f6a1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:10.081424 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d16d6de3-41d5-404f-839a-62a4b25f6a1c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.164318 Jul 21 22:26:10.081986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1094/2064] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:09 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:10.709975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-47c6482c-15ba-4451-b82b-592abc5f6ef0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:10.710840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-47c6482c-15ba-4451-b82b-592abc5f6ef0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:10.716970 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47c6482c-15ba-4451-b82b-592abc5f6ef0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:10.718052 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47c6482c-15ba-4451-b82b-592abc5f6ef0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:10.719193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47c6482c-15ba-4451-b82b-592abc5f6ef0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:10.719634 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47c6482c-15ba-4451-b82b-592abc5f6ef0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:10.737809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:10.850498 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-47c6482c-15ba-4451-b82b-592abc5f6ef0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:10.858408 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-47c6482c-15ba-4451-b82b-592abc5f6ef0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.152390 Jul 21 22:26:10.858976 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 971/2065] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:10 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:11.001260 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-02dce73f-8955-44e3-9caf-4245786bc327 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:11.001811 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-02dce73f-8955-44e3-9caf-4245786bc327 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:11.008263 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02dce73f-8955-44e3-9caf-4245786bc327 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:11.008717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02dce73f-8955-44e3-9caf-4245786bc327 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:11.009480 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02dce73f-8955-44e3-9caf-4245786bc327 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:11.009917 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-02dce73f-8955-44e3-9caf-4245786bc327 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:11.076610 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-02dce73f-8955-44e3-9caf-4245786bc327 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:11.085189 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-02dce73f-8955-44e3-9caf-4245786bc327 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.087773 Jul 21 22:26:11.085753 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1095/2066] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:10 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:11.098611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3c0d36e2-a747-4674-a514-c63b9f7caa92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:11.099264 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3c0d36e2-a747-4674-a514-c63b9f7caa92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:11.105737 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c0d36e2-a747-4674-a514-c63b9f7caa92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:11.106225 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c0d36e2-a747-4674-a514-c63b9f7caa92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:11.107207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c0d36e2-a747-4674-a514-c63b9f7caa92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:11.107648 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c0d36e2-a747-4674-a514-c63b9f7caa92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:11.237137 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3c0d36e2-a747-4674-a514-c63b9f7caa92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:11.245075 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3c0d36e2-a747-4674-a514-c63b9f7caa92 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150277 Jul 21 22:26:11.245641 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 972/2067] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:11 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:11.876745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f661eefd-0049-4df8-901d-44318101e443 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:11.877280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f661eefd-0049-4df8-901d-44318101e443 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:11.883267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f661eefd-0049-4df8-901d-44318101e443 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:11.883711 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f661eefd-0049-4df8-901d-44318101e443 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:11.884464 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f661eefd-0049-4df8-901d-44318101e443 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:11.884899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f661eefd-0049-4df8-901d-44318101e443 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:12.013734 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f661eefd-0049-4df8-901d-44318101e443 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:12.022092 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f661eefd-0049-4df8-901d-44318101e443 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.149996 Jul 21 22:26:12.022646 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1096/2068] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:11 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:12.101497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-39bed3e0-3a51-450b-9272-44c16508939b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:12.102142 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-39bed3e0-3a51-450b-9272-44c16508939b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:12.108572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39bed3e0-3a51-450b-9272-44c16508939b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:12.109024 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39bed3e0-3a51-450b-9272-44c16508939b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:12.109793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39bed3e0-3a51-450b-9272-44c16508939b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:12.110232 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39bed3e0-3a51-450b-9272-44c16508939b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:12.170944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-39bed3e0-3a51-450b-9272-44c16508939b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:12.178839 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-39bed3e0-3a51-450b-9272-44c16508939b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.081171 Jul 21 22:26:12.179430 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 973/2069] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:12 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:12.262261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-49cb2ae0-4aeb-47e4-968a-e49daf130cc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:12.262870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-49cb2ae0-4aeb-47e4-968a-e49daf130cc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:12.268956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49cb2ae0-4aeb-47e4-968a-e49daf130cc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:12.269412 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49cb2ae0-4aeb-47e4-968a-e49daf130cc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:12.270172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49cb2ae0-4aeb-47e4-968a-e49daf130cc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:12.270608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49cb2ae0-4aeb-47e4-968a-e49daf130cc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:12.402705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-49cb2ae0-4aeb-47e4-968a-e49daf130cc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:12.410751 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-49cb2ae0-4aeb-47e4-968a-e49daf130cc6 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.152273 Jul 21 22:26:12.411351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1097/2070] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:12 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:13.038902 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-40b7fe41-1f19-4f46-8cbf-23436d388401 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:13.039546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-40b7fe41-1f19-4f46-8cbf-23436d388401 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:13.045872 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40b7fe41-1f19-4f46-8cbf-23436d388401 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:13.046396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40b7fe41-1f19-4f46-8cbf-23436d388401 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:13.047210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40b7fe41-1f19-4f46-8cbf-23436d388401 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:13.047648 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-40b7fe41-1f19-4f46-8cbf-23436d388401 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:13.190995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-40b7fe41-1f19-4f46-8cbf-23436d388401 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:13.196120 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-11398944-8328-4fc6-a8dd-9718cf6575b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:13.196740 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-11398944-8328-4fc6-a8dd-9718cf6575b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:13.198261 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-40b7fe41-1f19-4f46-8cbf-23436d388401 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.163482 Jul 21 22:26:13.199415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 974/2071] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:13 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:13.204055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-11398944-8328-4fc6-a8dd-9718cf6575b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:13.204429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-11398944-8328-4fc6-a8dd-9718cf6575b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:13.205213 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-11398944-8328-4fc6-a8dd-9718cf6575b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:13.205655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-11398944-8328-4fc6-a8dd-9718cf6575b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:13.268933 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-11398944-8328-4fc6-a8dd-9718cf6575b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:13.277391 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-11398944-8328-4fc6-a8dd-9718cf6575b4 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084851 Jul 21 22:26:13.277976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1098/2072] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:13 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:13.428348 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8fe583c7-b4aa-4a4e-b81b-8f1688b55510 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:13.428995 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8fe583c7-b4aa-4a4e-b81b-8f1688b55510 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:13.434934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fe583c7-b4aa-4a4e-b81b-8f1688b55510 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:13.435410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fe583c7-b4aa-4a4e-b81b-8f1688b55510 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:13.436656 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fe583c7-b4aa-4a4e-b81b-8f1688b55510 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:13.437093 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fe583c7-b4aa-4a4e-b81b-8f1688b55510 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:13.568543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8fe583c7-b4aa-4a4e-b81b-8f1688b55510 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:13.577357 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8fe583c7-b4aa-4a4e-b81b-8f1688b55510 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.152054 Jul 21 22:26:13.577961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 975/2073] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:13 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:14.215849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-91bf806f-7cf5-42f1-bfc7-0ed165fef66f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:14.216457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-91bf806f-7cf5-42f1-bfc7-0ed165fef66f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:14.223731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91bf806f-7cf5-42f1-bfc7-0ed165fef66f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:14.224181 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91bf806f-7cf5-42f1-bfc7-0ed165fef66f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:14.224944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91bf806f-7cf5-42f1-bfc7-0ed165fef66f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:14.225382 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-91bf806f-7cf5-42f1-bfc7-0ed165fef66f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:14.294147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d1c87dbf-3281-4490-baa9-a9e951a3fd2e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:14.294765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d1c87dbf-3281-4490-baa9-a9e951a3fd2e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:14.301814 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1c87dbf-3281-4490-baa9-a9e951a3fd2e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:14.302269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1c87dbf-3281-4490-baa9-a9e951a3fd2e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:14.303068 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1c87dbf-3281-4490-baa9-a9e951a3fd2e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:14.303512 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1c87dbf-3281-4490-baa9-a9e951a3fd2e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:14.379402 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d1c87dbf-3281-4490-baa9-a9e951a3fd2e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:14.383365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-91bf806f-7cf5-42f1-bfc7-0ed165fef66f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:14.387511 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d1c87dbf-3281-4490-baa9-a9e951a3fd2e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.097121 Jul 21 22:26:14.388099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 976/2074] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:14 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:14.392752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-91bf806f-7cf5-42f1-bfc7-0ed165fef66f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.180655 Jul 21 22:26:14.393326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1099/2075] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:14 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:14.595267 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8bb4992b-03bc-463a-81bb-57047048711b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:14.595912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8bb4992b-03bc-463a-81bb-57047048711b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:14.601927 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8bb4992b-03bc-463a-81bb-57047048711b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:14.602379 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8bb4992b-03bc-463a-81bb-57047048711b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:14.603181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8bb4992b-03bc-463a-81bb-57047048711b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:14.603624 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8bb4992b-03bc-463a-81bb-57047048711b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:14.729476 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8bb4992b-03bc-463a-81bb-57047048711b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:14.737395 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8bb4992b-03bc-463a-81bb-57047048711b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146997 Jul 21 22:26:14.737901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 977/2076] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:14 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:15.405125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-248d0762-5efd-458f-9226-365c558b6d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:15.406331 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-248d0762-5efd-458f-9226-365c558b6d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:15.409556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1d943153-4183-406a-8a8a-8bfb0d7f2ae0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:15.410213 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1d943153-4183-406a-8a8a-8bfb0d7f2ae0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:15.414084 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-248d0762-5efd-458f-9226-365c558b6d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:15.414543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-248d0762-5efd-458f-9226-365c558b6d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:15.415359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-248d0762-5efd-458f-9226-365c558b6d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:15.415803 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-248d0762-5efd-458f-9226-365c558b6d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:15.416860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d943153-4183-406a-8a8a-8bfb0d7f2ae0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:15.417314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d943153-4183-406a-8a8a-8bfb0d7f2ae0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:15.418199 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d943153-4183-406a-8a8a-8bfb0d7f2ae0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:15.418526 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d943153-4183-406a-8a8a-8bfb0d7f2ae0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:15.486242 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-248d0762-5efd-458f-9226-365c558b6d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:15.494357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-248d0762-5efd-458f-9226-365c558b6d07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.093392 Jul 21 22:26:15.494957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1100/2077] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:15 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:15.572147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1d943153-4183-406a-8a8a-8bfb0d7f2ae0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:15.580094 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1d943153-4183-406a-8a8a-8bfb0d7f2ae0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.174428 Jul 21 22:26:15.580673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 978/2078] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:15 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:15.754613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-955f9f0a-90d8-4dba-a527-c8f3b9f42e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:15.755170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-955f9f0a-90d8-4dba-a527-c8f3b9f42e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:15.761262 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-955f9f0a-90d8-4dba-a527-c8f3b9f42e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:15.762033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-955f9f0a-90d8-4dba-a527-c8f3b9f42e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:15.762478 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-955f9f0a-90d8-4dba-a527-c8f3b9f42e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:15.762913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-955f9f0a-90d8-4dba-a527-c8f3b9f42e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:15.891017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-955f9f0a-90d8-4dba-a527-c8f3b9f42e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:15.898795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-955f9f0a-90d8-4dba-a527-c8f3b9f42e5f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148137 Jul 21 22:26:15.899394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1101/2079] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:15 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:16.511779 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-89760534-55df-4032-849e-8daf0ebb60d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:16.512426 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-89760534-55df-4032-849e-8daf0ebb60d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:16.519560 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-89760534-55df-4032-849e-8daf0ebb60d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:16.520021 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-89760534-55df-4032-849e-8daf0ebb60d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:16.520796 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-89760534-55df-4032-849e-8daf0ebb60d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:16.521243 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-89760534-55df-4032-849e-8daf0ebb60d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:16.581817 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-89760534-55df-4032-849e-8daf0ebb60d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:16.589903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-89760534-55df-4032-849e-8daf0ebb60d2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082062 Jul 21 22:26:16.590478 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 979/2080] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:16 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:16.597267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-54cc627b-ba4e-49d0-9cf3-ada3d26a9a07 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:16.597877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-54cc627b-ba4e-49d0-9cf3-ada3d26a9a07 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:16.604356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-54cc627b-ba4e-49d0-9cf3-ada3d26a9a07 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:16.604810 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-54cc627b-ba4e-49d0-9cf3-ada3d26a9a07 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:16.605611 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-54cc627b-ba4e-49d0-9cf3-ada3d26a9a07 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:16.606055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-54cc627b-ba4e-49d0-9cf3-ada3d26a9a07 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:16.734296 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-54cc627b-ba4e-49d0-9cf3-ada3d26a9a07 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:16.742210 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-54cc627b-ba4e-49d0-9cf3-ada3d26a9a07 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148974 Jul 21 22:26:16.742776 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1102/2081] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:16 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:16.916665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fb8832ae-9a9f-4e39-9d9a-0e7e8adfd779 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:16.917542 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fb8832ae-9a9f-4e39-9d9a-0e7e8adfd779 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:16.924105 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb8832ae-9a9f-4e39-9d9a-0e7e8adfd779 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:16.924562 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb8832ae-9a9f-4e39-9d9a-0e7e8adfd779 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:16.925336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb8832ae-9a9f-4e39-9d9a-0e7e8adfd779 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:16.925778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb8832ae-9a9f-4e39-9d9a-0e7e8adfd779 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:17.052732 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fb8832ae-9a9f-4e39-9d9a-0e7e8adfd779 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:17.061070 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fb8832ae-9a9f-4e39-9d9a-0e7e8adfd779 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148254 Jul 21 22:26:17.061642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 980/2082] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:16 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:17.606732 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7f6c93bf-8222-47b3-936c-f3aa3cadacdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:17.607383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7f6c93bf-8222-47b3-936c-f3aa3cadacdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:17.613873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f6c93bf-8222-47b3-936c-f3aa3cadacdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:17.614429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f6c93bf-8222-47b3-936c-f3aa3cadacdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:17.615231 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f6c93bf-8222-47b3-936c-f3aa3cadacdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:17.615670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7f6c93bf-8222-47b3-936c-f3aa3cadacdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:17.677929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7f6c93bf-8222-47b3-936c-f3aa3cadacdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:17.685751 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7f6c93bf-8222-47b3-936c-f3aa3cadacdf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.082909 Jul 21 22:26:17.686325 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1103/2083] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:17 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:17.759831 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9e79cce0-0e27-48d7-8c64-7a7cf200c823 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:17.760384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9e79cce0-0e27-48d7-8c64-7a7cf200c823 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:17.767512 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e79cce0-0e27-48d7-8c64-7a7cf200c823 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:17.767965 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e79cce0-0e27-48d7-8c64-7a7cf200c823 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:17.768738 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e79cce0-0e27-48d7-8c64-7a7cf200c823 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:17.769178 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e79cce0-0e27-48d7-8c64-7a7cf200c823 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:17.901109 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9e79cce0-0e27-48d7-8c64-7a7cf200c823 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:17.909013 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9e79cce0-0e27-48d7-8c64-7a7cf200c823 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.153136 Jul 21 22:26:17.909578 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 981/2084] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:17 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:18.078338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-700df8d1-7df8-4bd4-b838-7819c2d74798 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:18.078870 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-700df8d1-7df8-4bd4-b838-7819c2d74798 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:18.084830 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-700df8d1-7df8-4bd4-b838-7819c2d74798 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:18.085279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-700df8d1-7df8-4bd4-b838-7819c2d74798 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:18.086036 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-700df8d1-7df8-4bd4-b838-7819c2d74798 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:18.086468 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-700df8d1-7df8-4bd4-b838-7819c2d74798 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:18.212203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-700df8d1-7df8-4bd4-b838-7819c2d74798 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:18.220338 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-700df8d1-7df8-4bd4-b838-7819c2d74798 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.146563 Jul 21 22:26:18.220905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1104/2085] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:18 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:18.702237 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ee74d880-f2f1-44da-bc12-77ebc5b7904b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:18.702859 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ee74d880-f2f1-44da-bc12-77ebc5b7904b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:18.709712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee74d880-f2f1-44da-bc12-77ebc5b7904b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:18.710498 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee74d880-f2f1-44da-bc12-77ebc5b7904b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:18.711891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee74d880-f2f1-44da-bc12-77ebc5b7904b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:18.712671 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee74d880-f2f1-44da-bc12-77ebc5b7904b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:18.785258 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ee74d880-f2f1-44da-bc12-77ebc5b7904b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:18.793024 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ee74d880-f2f1-44da-bc12-77ebc5b7904b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.094696 Jul 21 22:26:18.793605 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 982/2086] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:18 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:18.926061 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2b6a3a33-6f49-4f85-820f-c836fbf7909a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:18.926706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2b6a3a33-6f49-4f85-820f-c836fbf7909a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:18.933472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2b6a3a33-6f49-4f85-820f-c836fbf7909a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:18.933922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2b6a3a33-6f49-4f85-820f-c836fbf7909a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:18.934707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2b6a3a33-6f49-4f85-820f-c836fbf7909a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:18.935180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2b6a3a33-6f49-4f85-820f-c836fbf7909a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:19.065360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2b6a3a33-6f49-4f85-820f-c836fbf7909a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:19.073792 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2b6a3a33-6f49-4f85-820f-c836fbf7909a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.151508 Jul 21 22:26:19.074388 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1105/2087] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:18 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:19.237181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9a72ea1d-681b-469d-bb06-896efa3ae316 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:19.237839 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9a72ea1d-681b-469d-bb06-896efa3ae316 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:19.244188 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9a72ea1d-681b-469d-bb06-896efa3ae316 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:19.244636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9a72ea1d-681b-469d-bb06-896efa3ae316 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:19.245396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9a72ea1d-681b-469d-bb06-896efa3ae316 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:19.245828 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9a72ea1d-681b-469d-bb06-896efa3ae316 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:19.371907 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9a72ea1d-681b-469d-bb06-896efa3ae316 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:19.380356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9a72ea1d-681b-469d-bb06-896efa3ae316 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.147012 Jul 21 22:26:19.380929 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 983/2088] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:19 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:19.810384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-de37dd6f-1216-42d7-8dbe-631f12085d29 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:19.811602 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-de37dd6f-1216-42d7-8dbe-631f12085d29 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:19.817633 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de37dd6f-1216-42d7-8dbe-631f12085d29 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:19.818099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de37dd6f-1216-42d7-8dbe-631f12085d29 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:19.818844 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de37dd6f-1216-42d7-8dbe-631f12085d29 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:19.819309 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-de37dd6f-1216-42d7-8dbe-631f12085d29 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:19.882822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-de37dd6f-1216-42d7-8dbe-631f12085d29 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:19.890753 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-de37dd6f-1216-42d7-8dbe-631f12085d29 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084263 Jul 21 22:26:19.891352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1106/2089] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:19 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:20.091636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6c94e62a-dc25-4289-99d0-b72beef13df9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:20.092706 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6c94e62a-dc25-4289-99d0-b72beef13df9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:20.099557 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6c94e62a-dc25-4289-99d0-b72beef13df9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:20.100046 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6c94e62a-dc25-4289-99d0-b72beef13df9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:20.100824 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6c94e62a-dc25-4289-99d0-b72beef13df9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:20.101269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6c94e62a-dc25-4289-99d0-b72beef13df9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:20.227351 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6c94e62a-dc25-4289-99d0-b72beef13df9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:20.235827 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6c94e62a-dc25-4289-99d0-b72beef13df9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148086 Jul 21 22:26:20.236406 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 984/2090] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:20 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:20.398072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-72cc1067-a5d0-4689-a452-d57200efe324 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:20.398712 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-72cc1067-a5d0-4689-a452-d57200efe324 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:20.405846 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72cc1067-a5d0-4689-a452-d57200efe324 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:20.406293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72cc1067-a5d0-4689-a452-d57200efe324 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:20.407088 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72cc1067-a5d0-4689-a452-d57200efe324 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:20.407530 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72cc1067-a5d0-4689-a452-d57200efe324 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:20.535158 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-72cc1067-a5d0-4689-a452-d57200efe324 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:20.543106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-72cc1067-a5d0-4689-a452-d57200efe324 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.148851 Jul 21 22:26:20.543679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1107/2091] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:20 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:20.907820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-094022cf-8d98-4c4c-9e14-d6266730e723 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:20.908433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-094022cf-8d98-4c4c-9e14-d6266730e723 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:20.914438 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-094022cf-8d98-4c4c-9e14-d6266730e723 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:20.914888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-094022cf-8d98-4c4c-9e14-d6266730e723 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:20.915680 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-094022cf-8d98-4c4c-9e14-d6266730e723 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:20.916118 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-094022cf-8d98-4c4c-9e14-d6266730e723 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:20.979296 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-094022cf-8d98-4c4c-9e14-d6266730e723 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:20.987203 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-094022cf-8d98-4c4c-9e14-d6266730e723 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083215 Jul 21 22:26:20.987772 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 985/2092] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:20 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:21.253006 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-62f981eb-f282-43fb-a964-81feca08d0de tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:21.253546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-62f981eb-f282-43fb-a964-81feca08d0de tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:21.259573 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-62f981eb-f282-43fb-a964-81feca08d0de tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:21.260026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-62f981eb-f282-43fb-a964-81feca08d0de tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:21.260788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-62f981eb-f282-43fb-a964-81feca08d0de tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:21.261261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-62f981eb-f282-43fb-a964-81feca08d0de tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:21.386015 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-62f981eb-f282-43fb-a964-81feca08d0de tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:21.393993 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-62f981eb-f282-43fb-a964-81feca08d0de tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.144925 Jul 21 22:26:21.394576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1108/2093] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:21 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:21.560068 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b2ea8d98-8a62-47c0-828f-495b9d63dd25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:21.560590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b2ea8d98-8a62-47c0-828f-495b9d63dd25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:21.567186 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2ea8d98-8a62-47c0-828f-495b9d63dd25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:21.567639 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2ea8d98-8a62-47c0-828f-495b9d63dd25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:21.568404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2ea8d98-8a62-47c0-828f-495b9d63dd25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:21.568837 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2ea8d98-8a62-47c0-828f-495b9d63dd25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:21.694004 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b2ea8d98-8a62-47c0-828f-495b9d63dd25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:21.701935 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b2ea8d98-8a62-47c0-828f-495b9d63dd25 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.145795 Jul 21 22:26:21.702525 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 986/2094] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:21 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:22.003598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4837b11c-5973-4f84-9ee9-617b752f689f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:22.004241 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4837b11c-5973-4f84-9ee9-617b752f689f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:22.010717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4837b11c-5973-4f84-9ee9-617b752f689f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:22.011205 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4837b11c-5973-4f84-9ee9-617b752f689f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:22.011974 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4837b11c-5973-4f84-9ee9-617b752f689f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:22.012410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4837b11c-5973-4f84-9ee9-617b752f689f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:22.075639 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4837b11c-5973-4f84-9ee9-617b752f689f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:22.087399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4837b11c-5973-4f84-9ee9-617b752f689f tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.087387 Jul 21 22:26:22.088232 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1109/2095] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:21 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:22.414539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8b1c088a-5dea-4b44-b0e1-af02f66f452b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:22.415209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8b1c088a-5dea-4b44-b0e1-af02f66f452b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:22.421121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b1c088a-5dea-4b44-b0e1-af02f66f452b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:22.421565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b1c088a-5dea-4b44-b0e1-af02f66f452b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:22.422328 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b1c088a-5dea-4b44-b0e1-af02f66f452b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:22.422778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8b1c088a-5dea-4b44-b0e1-af02f66f452b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:22.551636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8b1c088a-5dea-4b44-b0e1-af02f66f452b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:22.559589 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8b1c088a-5dea-4b44-b0e1-af02f66f452b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.148939 Jul 21 22:26:22.560171 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 987/2096] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:22 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:22.719033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f40d8520-2393-44db-b93a-40afcb8c6d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:22.719712 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f40d8520-2393-44db-b93a-40afcb8c6d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:22.725724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f40d8520-2393-44db-b93a-40afcb8c6d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:22.726175 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f40d8520-2393-44db-b93a-40afcb8c6d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:22.726939 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f40d8520-2393-44db-b93a-40afcb8c6d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:22.727399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f40d8520-2393-44db-b93a-40afcb8c6d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:22.745168 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:22.856413 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f40d8520-2393-44db-b93a-40afcb8c6d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:22.864349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f40d8520-2393-44db-b93a-40afcb8c6d00 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.149452 Jul 21 22:26:22.864913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1110/2097] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:22 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:23.109848 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c8e8a83d-30d8-41a7-b0bb-bac49092cfd0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:23.110381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c8e8a83d-30d8-41a7-b0bb-bac49092cfd0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:23.116930 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c8e8a83d-30d8-41a7-b0bb-bac49092cfd0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:23.117378 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c8e8a83d-30d8-41a7-b0bb-bac49092cfd0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:23.118139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c8e8a83d-30d8-41a7-b0bb-bac49092cfd0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:23.118574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c8e8a83d-30d8-41a7-b0bb-bac49092cfd0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:23.122497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:23.186669 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c8e8a83d-30d8-41a7-b0bb-bac49092cfd0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:23.194697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c8e8a83d-30d8-41a7-b0bb-bac49092cfd0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.088773 Jul 21 22:26:23.195313 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 988/2098] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:23 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:23.577050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-056f980f-8388-4c7a-bb74-46f1610c037d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:23.577666 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-056f980f-8388-4c7a-bb74-46f1610c037d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:23.584179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-056f980f-8388-4c7a-bb74-46f1610c037d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:23.584655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-056f980f-8388-4c7a-bb74-46f1610c037d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:23.585398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-056f980f-8388-4c7a-bb74-46f1610c037d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:23.585837 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-056f980f-8388-4c7a-bb74-46f1610c037d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:23.712375 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-056f980f-8388-4c7a-bb74-46f1610c037d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:23.720604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-056f980f-8388-4c7a-bb74-46f1610c037d tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.147462 Jul 21 22:26:23.721177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1111/2099] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:23 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:23.881573 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-13beabc8-3818-4191-b4a7-a82ad08678e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:23.882193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-13beabc8-3818-4191-b4a7-a82ad08678e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:23.888301 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13beabc8-3818-4191-b4a7-a82ad08678e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:23.888827 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13beabc8-3818-4191-b4a7-a82ad08678e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:23.889593 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13beabc8-3818-4191-b4a7-a82ad08678e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:23.890033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13beabc8-3818-4191-b4a7-a82ad08678e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:24.019650 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-13beabc8-3818-4191-b4a7-a82ad08678e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:24.027752 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-13beabc8-3818-4191-b4a7-a82ad08678e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.150219 Jul 21 22:26:24.028330 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 989/2100] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:23 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:24.210847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8f63c318-6c3f-4da6-abcd-80019c26ce07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:24.211482 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8f63c318-6c3f-4da6-abcd-80019c26ce07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:24.218157 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f63c318-6c3f-4da6-abcd-80019c26ce07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:24.218799 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f63c318-6c3f-4da6-abcd-80019c26ce07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:24.219584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f63c318-6c3f-4da6-abcd-80019c26ce07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:24.220018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8f63c318-6c3f-4da6-abcd-80019c26ce07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:24.283311 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8f63c318-6c3f-4da6-abcd-80019c26ce07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:24.291256 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8f63c318-6c3f-4da6-abcd-80019c26ce07 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.084177 Jul 21 22:26:24.291821 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1112/2101] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:24 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:24.737442 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c03a61cd-be1c-43c0-a061-5cfb6f1d5059 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:24.737980 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c03a61cd-be1c-43c0-a061-5cfb6f1d5059 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:24.744537 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c03a61cd-be1c-43c0-a061-5cfb6f1d5059 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:24.744994 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c03a61cd-be1c-43c0-a061-5cfb6f1d5059 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:24.745765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c03a61cd-be1c-43c0-a061-5cfb6f1d5059 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:24.746210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c03a61cd-be1c-43c0-a061-5cfb6f1d5059 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:24.884361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c03a61cd-be1c-43c0-a061-5cfb6f1d5059 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:24.892948 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c03a61cd-be1c-43c0-a061-5cfb6f1d5059 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.159521 Jul 21 22:26:24.893513 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 990/2102] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:24 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:25.045891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6e981002-9fe5-4511-bcca-bac4c31f2bd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:25.046415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6e981002-9fe5-4511-bcca-bac4c31f2bd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:25.052830 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e981002-9fe5-4511-bcca-bac4c31f2bd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:25.053275 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e981002-9fe5-4511-bcca-bac4c31f2bd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:25.054031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e981002-9fe5-4511-bcca-bac4c31f2bd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:25.054464 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6e981002-9fe5-4511-bcca-bac4c31f2bd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:25.186133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6e981002-9fe5-4511-bcca-bac4c31f2bd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:25.194022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6e981002-9fe5-4511-bcca-bac4c31f2bd8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.152552 Jul 21 22:26:25.194593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1113/2103] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:25 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:25.307852 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-697bec00-fdbc-467d-a8cc-515717fecb37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:25.308376 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-697bec00-fdbc-467d-a8cc-515717fecb37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:25.314371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-697bec00-fdbc-467d-a8cc-515717fecb37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:25.314819 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-697bec00-fdbc-467d-a8cc-515717fecb37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:25.315616 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-697bec00-fdbc-467d-a8cc-515717fecb37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:25.316049 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-697bec00-fdbc-467d-a8cc-515717fecb37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:25.379321 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-697bec00-fdbc-467d-a8cc-515717fecb37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:25.387373 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-697bec00-fdbc-467d-a8cc-515717fecb37 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.083309 Jul 21 22:26:25.387947 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 991/2104] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:25 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:26.017655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bd025e92-6335-4bb5-81b5-3e7db678bbeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:26.018266 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bd025e92-6335-4bb5-81b5-3e7db678bbeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: b34275f2-dfb0-4cd8-bac0-3e182fcb2fca] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:26.024464 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd025e92-6335-4bb5-81b5-3e7db678bbeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:26.024914 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd025e92-6335-4bb5-81b5-3e7db678bbeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:26.025681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd025e92-6335-4bb5-81b5-3e7db678bbeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:26.026114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd025e92-6335-4bb5-81b5-3e7db678bbeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:26.157739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bd025e92-6335-4bb5-81b5-3e7db678bbeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:26.166169 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bd025e92-6335-4bb5-81b5-3e7db678bbeb tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca" status: 200 len: 1559 microversion: 2.1 time: 0.259708 Jul 21 22:26:26.166688 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1114/2105] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:25 2022] GET /compute/v2.1/servers/b34275f2-dfb0-4cd8-bac0-3e182fcb2fca => generated 1559 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:26.211305 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a749290b-3aee-4263-95b0-c7722a724cc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:26.212540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a749290b-3aee-4263-95b0-c7722a724cc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:26.219517 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a749290b-3aee-4263-95b0-c7722a724cc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:26.219974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a749290b-3aee-4263-95b0-c7722a724cc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:26.220745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a749290b-3aee-4263-95b0-c7722a724cc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:26.221358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a749290b-3aee-4263-95b0-c7722a724cc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:26.351552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a749290b-3aee-4263-95b0-c7722a724cc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:26.360015 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a749290b-3aee-4263-95b0-c7722a724cc2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.152563 Jul 21 22:26:26.360622 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 992/2106] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:26 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:26.404222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-994f28f9-d29a-468b-acc3-9e7f453e956e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:26.404862 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-994f28f9-d29a-468b-acc3-9e7f453e956e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:26.411022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-994f28f9-d29a-468b-acc3-9e7f453e956e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:26.411522 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-994f28f9-d29a-468b-acc3-9e7f453e956e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:26.412279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-994f28f9-d29a-468b-acc3-9e7f453e956e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:26.412727 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-994f28f9-d29a-468b-acc3-9e7f453e956e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:26.477010 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-994f28f9-d29a-468b-acc3-9e7f453e956e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:26.485619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-994f28f9-d29a-468b-acc3-9e7f453e956e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 200 len: 1369 microversion: 2.1 time: 0.085232 Jul 21 22:26:26.486215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1115/2107] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:26 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:26.503024 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6030df90-f7ff-48b4-8992-efd5347babc0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '.version_select at 0x7faca1e1d0d0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:26.522772 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6030df90-f7ff-48b4-8992-efd5347babc0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1782920728" status: 202 len: 0 microversion: 2.1 time: 0.023465 Jul 21 22:26:26.523387 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 993/2108] 10.222.0.44 () {58 vars in 1220 bytes} [Thu Jul 21 22:26:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1782920728 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:26:27.378417 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-04140e4f-b88d-408e-b925-fe780e5e51a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:27.379194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-04140e4f-b88d-408e-b925-fe780e5e51a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:27.385800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04140e4f-b88d-408e-b925-fe780e5e51a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:27.386253 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04140e4f-b88d-408e-b925-fe780e5e51a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:27.387027 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04140e4f-b88d-408e-b925-fe780e5e51a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:27.387475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04140e4f-b88d-408e-b925-fe780e5e51a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:27.520613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-04140e4f-b88d-408e-b925-fe780e5e51a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:27.528654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-04140e4f-b88d-408e-b925-fe780e5e51a5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 200 len: 1727 microversion: 2.1 time: 0.154029 Jul 21 22:26:27.529747 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1116/2109] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:27 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:27.547632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ea7f8d32-3498-4a19-92ec-b67edb6646c9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '.version_select at 0x7faca1f999d0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:27.555365 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0434ce9f-3b17-4421-ad1b-78c211ceb254 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Action: 'create', calling method: .version_select at 0x7faca6ed1ee0>, body: {"keypair": {"name": "tempest-keypair-1242969614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBs0S6hOKsN90Vq/ifJGd6OuutECHQ+m2jgajZ+Erz8N4mOkCX9s1V/OGBgVwLLUbPIW/5jkyXWPLPWnRe31LmiZ94eH6d2ByYsvTC5cO/2DEYHqxSH8NSL+BzaM1x1b3A=="}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:27.569701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-0434ce9f-3b17-4421-ad1b-78c211ceb254 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Getting quotas for project 64e8fc83edda464e8ec9f7c2ee9c142c. Resources: {'key_pairs'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:26:27.574407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-0434ce9f-3b17-4421-ad1b-78c211ceb254 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Getting quotas for user 9f6537f0b9d44ba58cb5a5552f2c5b4e and project 64e8fc83edda464e8ec9f7c2ee9c142c. Resources: {'key_pairs'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:26:27.576941 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ea7f8d32-3498-4a19-92ec-b67edb6646c9 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283027389" status: 202 len: 0 microversion: 2.1 time: 0.034276 Jul 21 22:26:27.577999 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 994/2110] 10.222.0.44 () {58 vars in 1220 bytes} [Thu Jul 21 22:26:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283027389 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:26:27.607850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0434ce9f-3b17-4421-ad1b-78c211ceb254 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055554 Jul 21 22:26:27.608479 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1117/2111] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 22:26:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:26:28.719925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-00b4ed24-5705-46f1-9949-434ebd7817bd req-2d03c84a-da0b-4c72-ad84-e593b0727f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7365f289-299d-4d2d-ba74-1ca18cf88e06", "tag": "eed67bc7-6a60-4e49-80a2-4868db4a2cb0"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:28.733213 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-00b4ed24-5705-46f1-9949-434ebd7817bd req-2d03c84a-da0b-4c72-ad84-e593b0727f01 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:28.734030 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-00b4ed24-5705-46f1-9949-434ebd7817bd req-2d03c84a-da0b-4c72-ad84-e593b0727f01 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:28.749190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-00b4ed24-5705-46f1-9949-434ebd7817bd req-2d03c84a-da0b-4c72-ad84-e593b0727f01 service nova] Creating event network-changed:eed67bc7-6a60-4e49-80a2-4868db4a2cb0 for instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 on hv-cinder-82002 Jul 21 22:26:28.756254 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-00b4ed24-5705-46f1-9949-434ebd7817bd req-2d03c84a-da0b-4c72-ad84-e593b0727f01 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149078 Jul 21 22:26:28.757701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 995/2112] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:26:28.879515 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d61c0c48-4ff6-4f5a-9084-98e31e29ca7d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Action: 'create', calling method: .version_select at 0x7faca2716dc0>, body: {"keypair": {"name": "tempest-keypair-1102677831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDXfYp7dThv74bAn/kTkC2VPDUpRI5l5EpcYakR0wQwLuFgFghjg2sk6RuKz/FZYAeGj1oLds10Ra6bTUexXiUAe4qzhxmeuLjPW10E5LVuCP1LAGPHNY7Pl0baYP9jZA=="}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:28.910310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-d61c0c48-4ff6-4f5a-9084-98e31e29ca7d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'key_pairs'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:26:28.915963 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-d61c0c48-4ff6-4f5a-9084-98e31e29ca7d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for user 73f068abea75404fb2829065a674aee4 and project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'key_pairs'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:26:28.951730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d61c0c48-4ff6-4f5a-9084-98e31e29ca7d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075650 Jul 21 22:26:28.953822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1118/2113] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 22:26:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:29.202812 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1019278860", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc67d31e-e173-4f41-bc3f-7c414a4954bb"}], "security_groups": [{"name": "tempest-securitygroup--1741804296"}], "key_name": "tempest-keypair-1242969614", "user_data": "}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:29.329503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] validate_networks() for [('cc67d31e-e173-4f41-bc3f-7c414a4954bb', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:26:29.832737 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:26:29.833327 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:26:29.833808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:26:29.834231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:26:29.834643 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:26:29.843731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:29.844184 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:29.844994 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:29.845452 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:29.862103 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Getting quotas for project 64e8fc83edda464e8ec9f7c2ee9c142c. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:26:29.866013 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Getting quotas for user 9f6537f0b9d44ba58cb5a5552f2c5b4e and project 64e8fc83edda464e8ec9f7c2ee9c142c. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:26:29.877783 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:26:29.880188 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:26:29.927057 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ea798a26-76c7-4c2e-b70e-8e7c5b3dc29c tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.729075 Jul 21 22:26:29.927801 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 996/2114] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 22:26:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:26:29.939087 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1efff01d-8735-4ceb-84b4-520659dbaf3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:29.941136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1efff01d-8735-4ceb-84b4-520659dbaf3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:30.000453 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1efff01d-8735-4ceb-84b4-520659dbaf3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:30.007649 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1efff01d-8735-4ceb-84b4-520659dbaf3b tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1238 microversion: 2.1 time: 0.073883 Jul 21 22:26:30.008847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1119/2115] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:29 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:30.634197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-801136618", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31aaafc3-d737-47df-987b-f83f4d3a2678"}], "security_groups": [{"name": "tempest-securitygroup--1316403423"}], "key_name": "tempest-keypair-1102677831", "user_data": "}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:30.738881 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] validate_networks() for [('31aaafc3-d737-47df-987b-f83f4d3a2678', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:26:31.025377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3c37fb94-82f3-4d7c-b1dc-bf66a0176e72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:31.026044 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3c37fb94-82f3-4d7c-b1dc-bf66a0176e72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:31.032997 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3c37fb94-82f3-4d7c-b1dc-bf66a0176e72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:31.033689 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3c37fb94-82f3-4d7c-b1dc-bf66a0176e72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:31.034777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3c37fb94-82f3-4d7c-b1dc-bf66a0176e72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:31.035245 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3c37fb94-82f3-4d7c-b1dc-bf66a0176e72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:31.132797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3c37fb94-82f3-4d7c-b1dc-bf66a0176e72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:31.140798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3c37fb94-82f3-4d7c-b1dc-bf66a0176e72 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1290 microversion: 2.1 time: 0.119177 Jul 21 22:26:31.141624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1120/2116] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:31 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1290 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:31.160474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:26:31.161022 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:26:31.161368 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:26:31.161780 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:26:31.162190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:26:31.171904 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:31.172570 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:31.173555 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:31.174013 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:31.185511 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:31.196984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:26:31.205274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for user 73f068abea75404fb2829065a674aee4 and project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:26:31.218957 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:26:31.221129 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:26:31.267989 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0b358a77-0237-4e9c-abb8-b1334eec2116 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.638510 Jul 21 22:26:31.273855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 997/2117] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 22:26:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:26:31.279823 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d3a1efb3-913e-4516-bf4d-398cf5ad8d84 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:31.280453 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d3a1efb3-913e-4516-bf4d-398cf5ad8d84 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:31.282428 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:31.577602 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d3a1efb3-913e-4516-bf4d-398cf5ad8d84 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:31.587451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d3a1efb3-913e-4516-bf4d-398cf5ad8d84 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1241 microversion: 2.1 time: 0.312332 Jul 21 22:26:31.591041 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1121/2118] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:31 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1241 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:32.158256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fb997928-ebdb-4722-a52d-890c8750109e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:32.158898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fb997928-ebdb-4722-a52d-890c8750109e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:32.166028 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb997928-ebdb-4722-a52d-890c8750109e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:32.166617 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb997928-ebdb-4722-a52d-890c8750109e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:32.167270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb997928-ebdb-4722-a52d-890c8750109e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:32.167717 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb997928-ebdb-4722-a52d-890c8750109e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:32.297336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fb997928-ebdb-4722-a52d-890c8750109e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:32.307081 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fb997928-ebdb-4722-a52d-890c8750109e tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1364 microversion: 2.1 time: 0.153062 Jul 21 22:26:32.307675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 998/2119] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:32 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:32.604873 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-30e3f033-6318-4f41-865c-dc6254accd7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:32.605515 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-30e3f033-6318-4f41-865c-dc6254accd7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:32.612707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-30e3f033-6318-4f41-865c-dc6254accd7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:32.613157 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-30e3f033-6318-4f41-865c-dc6254accd7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:32.613930 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-30e3f033-6318-4f41-865c-dc6254accd7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:32.614359 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-30e3f033-6318-4f41-865c-dc6254accd7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:32.690749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-30e3f033-6318-4f41-865c-dc6254accd7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:32.700896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-30e3f033-6318-4f41-865c-dc6254accd7b tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1299 microversion: 2.1 time: 0.099850 Jul 21 22:26:32.701678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1122/2120] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:32 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:32.891347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-f6ea44e8-84f2-4e2c-b584-4acee33ad0a5 req-14772032-1cf8-4a90-996e-887c1b14341c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5d93d14-2eae-43dc-871b-356fd5dda85c", "tag": "ced5ebc6-2d23-4040-814d-c3296ebe9156"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:32.906415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f6ea44e8-84f2-4e2c-b584-4acee33ad0a5 req-14772032-1cf8-4a90-996e-887c1b14341c service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:32.907360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f6ea44e8-84f2-4e2c-b584-4acee33ad0a5 req-14772032-1cf8-4a90-996e-887c1b14341c service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:32.929400 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-f6ea44e8-84f2-4e2c-b584-4acee33ad0a5 req-14772032-1cf8-4a90-996e-887c1b14341c service nova] Creating event network-changed:ced5ebc6-2d23-4040-814d-c3296ebe9156 for instance c5d93d14-2eae-43dc-871b-356fd5dda85c on hv-cinder-82002 Jul 21 22:26:32.935269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-f6ea44e8-84f2-4e2c-b584-4acee33ad0a5 req-14772032-1cf8-4a90-996e-887c1b14341c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056566 Jul 21 22:26:32.936477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 999/2121] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:33.325164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-73e540ca-f938-4f61-bda8-3f2f24151c3d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:33.326474 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-73e540ca-f938-4f61-bda8-3f2f24151c3d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:33.333836 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73e540ca-f938-4f61-bda8-3f2f24151c3d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:33.334707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73e540ca-f938-4f61-bda8-3f2f24151c3d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:33.335632 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73e540ca-f938-4f61-bda8-3f2f24151c3d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:33.336178 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-73e540ca-f938-4f61-bda8-3f2f24151c3d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:33.608731 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-73e540ca-f938-4f61-bda8-3f2f24151c3d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:33.616671 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-73e540ca-f938-4f61-bda8-3f2f24151c3d tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1364 microversion: 2.1 time: 0.295702 Jul 21 22:26:33.617240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1123/2122] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:33 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1364 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:33.719540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5d95e188-3f26-420e-9fd1-ff50e11c77a2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:33.720290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5d95e188-3f26-420e-9fd1-ff50e11c77a2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:33.726366 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d95e188-3f26-420e-9fd1-ff50e11c77a2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:33.726822 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d95e188-3f26-420e-9fd1-ff50e11c77a2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:33.727632 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d95e188-3f26-420e-9fd1-ff50e11c77a2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:33.728091 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d95e188-3f26-420e-9fd1-ff50e11c77a2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:33.973674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5d95e188-3f26-420e-9fd1-ff50e11c77a2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:33.981665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5d95e188-3f26-420e-9fd1-ff50e11c77a2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1367 microversion: 2.1 time: 0.267629 Jul 21 22:26:33.982173 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1000/2123] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:33 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:34.180448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-d9792dca-b6fd-4f86-9b4e-1448498665e8 req-a2c1060d-9263-4704-b653-17d611986f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3848999-7ff7-4b1c-932d-1bb4d9eaba0c", "tag": "88096e4b-6d97-4f28-8780-275db20167ff"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:34.189138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-d9792dca-b6fd-4f86-9b4e-1448498665e8 req-a2c1060d-9263-4704-b653-17d611986f28 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:34.189588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-d9792dca-b6fd-4f86-9b4e-1448498665e8 req-a2c1060d-9263-4704-b653-17d611986f28 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:34.202699 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-d9792dca-b6fd-4f86-9b4e-1448498665e8 req-a2c1060d-9263-4704-b653-17d611986f28 service nova] Creating event network-changed:88096e4b-6d97-4f28-8780-275db20167ff for instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c on hv-cinder-82002 Jul 21 22:26:34.207784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-d9792dca-b6fd-4f86-9b4e-1448498665e8 req-a2c1060d-9263-4704-b653-17d611986f28 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089136 Jul 21 22:26:34.208400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1124/2124] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:34.633374 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f87ab954-945c-41c3-aca5-e2f802cf5f71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:34.633989 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f87ab954-945c-41c3-aca5-e2f802cf5f71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:34.640620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f87ab954-945c-41c3-aca5-e2f802cf5f71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:34.641073 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f87ab954-945c-41c3-aca5-e2f802cf5f71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:34.641843 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f87ab954-945c-41c3-aca5-e2f802cf5f71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:34.642282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f87ab954-945c-41c3-aca5-e2f802cf5f71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:34.775497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f87ab954-945c-41c3-aca5-e2f802cf5f71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:34.782855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f87ab954-945c-41c3-aca5-e2f802cf5f71 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1364 microversion: 2.1 time: 0.153371 Jul 21 22:26:34.783454 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1001/2125] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:34 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:34.999321 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-19396d09-6343-4e27-8609-5e72c27e364a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:34.999937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-19396d09-6343-4e27-8609-5e72c27e364a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:35.006130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-19396d09-6343-4e27-8609-5e72c27e364a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:35.006582 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-19396d09-6343-4e27-8609-5e72c27e364a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:35.007378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-19396d09-6343-4e27-8609-5e72c27e364a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:35.007819 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-19396d09-6343-4e27-8609-5e72c27e364a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:35.134724 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-19396d09-6343-4e27-8609-5e72c27e364a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:35.142118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-19396d09-6343-4e27-8609-5e72c27e364a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1367 microversion: 2.1 time: 0.148190 Jul 21 22:26:35.142692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1125/2126] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:34 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:35.799559 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-94d51ac2-90af-4ab6-b5bc-59e0d5b563de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:35.800113 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-94d51ac2-90af-4ab6-b5bc-59e0d5b563de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:35.806636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-94d51ac2-90af-4ab6-b5bc-59e0d5b563de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:35.807128 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-94d51ac2-90af-4ab6-b5bc-59e0d5b563de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:35.807902 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-94d51ac2-90af-4ab6-b5bc-59e0d5b563de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:35.808347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-94d51ac2-90af-4ab6-b5bc-59e0d5b563de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:36.002283 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-94d51ac2-90af-4ab6-b5bc-59e0d5b563de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:36.010760 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-94d51ac2-90af-4ab6-b5bc-59e0d5b563de tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1364 microversion: 2.1 time: 0.215035 Jul 21 22:26:36.011767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1002/2127] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:35 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:36.158785 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1602e7ad-5913-4b3f-9955-6b89aa1dceb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:36.159463 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1602e7ad-5913-4b3f-9955-6b89aa1dceb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:36.167292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1602e7ad-5913-4b3f-9955-6b89aa1dceb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:36.167742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1602e7ad-5913-4b3f-9955-6b89aa1dceb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:36.168508 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1602e7ad-5913-4b3f-9955-6b89aa1dceb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:36.168940 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1602e7ad-5913-4b3f-9955-6b89aa1dceb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:36.392123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1602e7ad-5913-4b3f-9955-6b89aa1dceb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:36.400618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1602e7ad-5913-4b3f-9955-6b89aa1dceb0 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1367 microversion: 2.1 time: 0.245614 Jul 21 22:26:36.401199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1126/2128] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:36 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:37.028206 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7059995a-d2d0-40c3-8971-6b64944eead5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:37.029384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7059995a-d2d0-40c3-8971-6b64944eead5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:37.035945 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7059995a-d2d0-40c3-8971-6b64944eead5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:37.036406 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7059995a-d2d0-40c3-8971-6b64944eead5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:37.037177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7059995a-d2d0-40c3-8971-6b64944eead5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:37.037617 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7059995a-d2d0-40c3-8971-6b64944eead5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:37.166258 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7059995a-d2d0-40c3-8971-6b64944eead5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:37.173692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7059995a-d2d0-40c3-8971-6b64944eead5 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1364 microversion: 2.1 time: 0.149348 Jul 21 22:26:37.174621 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1003/2129] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:37 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:37.419048 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-64b27ba7-dabb-45b8-bd1e-af214ccc9a6f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:37.419635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-64b27ba7-dabb-45b8-bd1e-af214ccc9a6f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:37.426888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-64b27ba7-dabb-45b8-bd1e-af214ccc9a6f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:37.427364 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-64b27ba7-dabb-45b8-bd1e-af214ccc9a6f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:37.428239 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-64b27ba7-dabb-45b8-bd1e-af214ccc9a6f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:37.428672 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-64b27ba7-dabb-45b8-bd1e-af214ccc9a6f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:37.557113 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-64b27ba7-dabb-45b8-bd1e-af214ccc9a6f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:37.565009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-64b27ba7-dabb-45b8-bd1e-af214ccc9a6f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1367 microversion: 2.1 time: 0.149869 Jul 21 22:26:37.565570 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1127/2130] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:37 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:38.190215 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-18e522f0-2ae8-4147-8c81-ef05e8ae33c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:38.190820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-18e522f0-2ae8-4147-8c81-ef05e8ae33c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:38.197450 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18e522f0-2ae8-4147-8c81-ef05e8ae33c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:38.197903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18e522f0-2ae8-4147-8c81-ef05e8ae33c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:38.198673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18e522f0-2ae8-4147-8c81-ef05e8ae33c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:38.199139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-18e522f0-2ae8-4147-8c81-ef05e8ae33c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:38.327164 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-18e522f0-2ae8-4147-8c81-ef05e8ae33c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:38.334416 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-18e522f0-2ae8-4147-8c81-ef05e8ae33c7 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1364 microversion: 2.1 time: 0.148050 Jul 21 22:26:38.334974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1004/2131] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:38 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:38.584457 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-49af0c02-67b7-44d0-a656-c92b21b3883c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:38.585729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-49af0c02-67b7-44d0-a656-c92b21b3883c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:38.592372 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49af0c02-67b7-44d0-a656-c92b21b3883c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:38.592824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49af0c02-67b7-44d0-a656-c92b21b3883c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:38.593894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49af0c02-67b7-44d0-a656-c92b21b3883c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:38.594334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49af0c02-67b7-44d0-a656-c92b21b3883c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:38.721070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-49af0c02-67b7-44d0-a656-c92b21b3883c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:38.728430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-49af0c02-67b7-44d0-a656-c92b21b3883c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1367 microversion: 2.1 time: 0.149331 Jul 21 22:26:38.729007 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1128/2132] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:38 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:39.327336 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-79caa6bc-3f82-4819-886f-386027aa224c req-b4ca6581-a0e0-4f6a-a5fb-febe8d68d26b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d93d14-2eae-43dc-871b-356fd5dda85c", "name": "network-vif-plugged", "status": "completed", "tag": "ced5ebc6-2d23-4040-814d-c3296ebe9156"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:39.335541 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-79caa6bc-3f82-4819-886f-386027aa224c req-b4ca6581-a0e0-4f6a-a5fb-febe8d68d26b service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:39.335838 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-79caa6bc-3f82-4819-886f-386027aa224c req-b4ca6581-a0e0-4f6a-a5fb-febe8d68d26b service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:39.347354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-79caa6bc-3f82-4819-886f-386027aa224c req-b4ca6581-a0e0-4f6a-a5fb-febe8d68d26b service nova] Creating event network-vif-plugged:ced5ebc6-2d23-4040-814d-c3296ebe9156 for instance c5d93d14-2eae-43dc-871b-356fd5dda85c on hv-cinder-82002 Jul 21 22:26:39.352365 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-79caa6bc-3f82-4819-886f-386027aa224c req-b4ca6581-a0e0-4f6a-a5fb-febe8d68d26b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083908 Jul 21 22:26:39.352993 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1005/2133] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:39.353123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8d681f89-0150-4a26-b9ec-d4931ea7bf19 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:39.353695 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8d681f89-0150-4a26-b9ec-d4931ea7bf19 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:39.360868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8d681f89-0150-4a26-b9ec-d4931ea7bf19 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:39.361265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8d681f89-0150-4a26-b9ec-d4931ea7bf19 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:39.362034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8d681f89-0150-4a26-b9ec-d4931ea7bf19 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:39.362471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8d681f89-0150-4a26-b9ec-d4931ea7bf19 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:39.500319 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8d681f89-0150-4a26-b9ec-d4931ea7bf19 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:39.509867 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8d681f89-0150-4a26-b9ec-d4931ea7bf19 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1364 microversion: 2.1 time: 0.162108 Jul 21 22:26:39.510547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1129/2134] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:39 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:39.745628 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-84b5ad4a-027a-4308-92e2-20d71476287c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:39.746333 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-84b5ad4a-027a-4308-92e2-20d71476287c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:39.752573 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84b5ad4a-027a-4308-92e2-20d71476287c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:39.753029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84b5ad4a-027a-4308-92e2-20d71476287c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:39.753799 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84b5ad4a-027a-4308-92e2-20d71476287c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:39.754239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84b5ad4a-027a-4308-92e2-20d71476287c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:39.880484 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-84b5ad4a-027a-4308-92e2-20d71476287c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:39.888360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-84b5ad4a-027a-4308-92e2-20d71476287c tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1367 microversion: 2.1 time: 0.146574 Jul 21 22:26:39.888926 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1006/2135] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:39 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:40.526608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6716d4f9-7a4a-4e0b-a534-844b49267c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:40.527247 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6716d4f9-7a4a-4e0b-a534-844b49267c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:40.534399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6716d4f9-7a4a-4e0b-a534-844b49267c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:40.534817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6716d4f9-7a4a-4e0b-a534-844b49267c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:40.536015 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6716d4f9-7a4a-4e0b-a534-844b49267c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:40.536681 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6716d4f9-7a4a-4e0b-a534-844b49267c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:40.674079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6716d4f9-7a4a-4e0b-a534-844b49267c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:40.681469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6716d4f9-7a4a-4e0b-a534-844b49267c42 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1364 microversion: 2.1 time: 0.158691 Jul 21 22:26:40.682035 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1130/2136] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:40 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:40.904999 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d81c183b-f29a-4a7a-ab3f-91a51ad02a3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:40.905613 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d81c183b-f29a-4a7a-ab3f-91a51ad02a3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:40.912099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d81c183b-f29a-4a7a-ab3f-91a51ad02a3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:40.912551 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d81c183b-f29a-4a7a-ab3f-91a51ad02a3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:40.913316 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d81c183b-f29a-4a7a-ab3f-91a51ad02a3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:40.913770 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d81c183b-f29a-4a7a-ab3f-91a51ad02a3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:41.045777 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d81c183b-f29a-4a7a-ab3f-91a51ad02a3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:41.053527 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d81c183b-f29a-4a7a-ab3f-91a51ad02a3e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1367 microversion: 2.1 time: 0.152340 Jul 21 22:26:41.054714 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1007/2137] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:40 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:41.697739 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-40bbb6e0-2ae8-457d-be2e-84e9c95382ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:41.698475 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-40bbb6e0-2ae8-457d-be2e-84e9c95382ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:41.700893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=12 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:41.706505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40bbb6e0-2ae8-457d-be2e-84e9c95382ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:41.706956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40bbb6e0-2ae8-457d-be2e-84e9c95382ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:41.707751 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40bbb6e0-2ae8-457d-be2e-84e9c95382ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:41.708271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40bbb6e0-2ae8-457d-be2e-84e9c95382ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:41.837688 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-40bbb6e0-2ae8-457d-be2e-84e9c95382ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:41.841754 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:41.847263 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-40bbb6e0-2ae8-457d-be2e-84e9c95382ab tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1550 microversion: 2.1 time: 0.153287 Jul 21 22:26:41.847843 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1131/2138] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:41 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:41.865129 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6b0ca838-38b3-4a25-a86a-cb1ccf288ecf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:41.865821 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6b0ca838-38b3-4a25-a86a-cb1ccf288ecf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:41.868300 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:41.868600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=12 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:41.876627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6b0ca838-38b3-4a25-a86a-cb1ccf288ecf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:41.877085 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6b0ca838-38b3-4a25-a86a-cb1ccf288ecf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:41.877883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6b0ca838-38b3-4a25-a86a-cb1ccf288ecf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:41.878325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6b0ca838-38b3-4a25-a86a-cb1ccf288ecf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:41.966830 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6b0ca838-38b3-4a25-a86a-cb1ccf288ecf tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106631 Jul 21 22:26:41.967467 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1008/2139] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 22:26:41 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:42.071046 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b9d4c1c7-5431-40bd-8ac0-dced98d14e0f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:42.071662 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b9d4c1c7-5431-40bd-8ac0-dced98d14e0f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:42.078609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9d4c1c7-5431-40bd-8ac0-dced98d14e0f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:42.079089 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9d4c1c7-5431-40bd-8ac0-dced98d14e0f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:42.079868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9d4c1c7-5431-40bd-8ac0-dced98d14e0f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:42.080303 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9d4c1c7-5431-40bd-8ac0-dced98d14e0f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:42.300095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b9d4c1c7-5431-40bd-8ac0-dced98d14e0f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:42.307625 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b9d4c1c7-5431-40bd-8ac0-dced98d14e0f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1367 microversion: 2.1 time: 0.240436 Jul 21 22:26:42.308204 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1132/2140] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:42 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:43.209908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-277cf255-a47c-430c-abee-309d18810c65 req-08b8d3e4-fe51-4c3c-a277-86a121237ffc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5d93d14-2eae-43dc-871b-356fd5dda85c", "tag": "ced5ebc6-2d23-4040-814d-c3296ebe9156"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:43.222104 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-277cf255-a47c-430c-abee-309d18810c65 req-08b8d3e4-fe51-4c3c-a277-86a121237ffc service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:43.222857 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-277cf255-a47c-430c-abee-309d18810c65 req-08b8d3e4-fe51-4c3c-a277-86a121237ffc service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:43.235119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-277cf255-a47c-430c-abee-309d18810c65 req-08b8d3e4-fe51-4c3c-a277-86a121237ffc service nova] Creating event network-changed:ced5ebc6-2d23-4040-814d-c3296ebe9156 for instance c5d93d14-2eae-43dc-871b-356fd5dda85c on hv-cinder-82002 Jul 21 22:26:43.241028 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-277cf255-a47c-430c-abee-309d18810c65 req-08b8d3e4-fe51-4c3c-a277-86a121237ffc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035045 Jul 21 22:26:43.241636 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1009/2141] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:43.299671 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-385060f8-0ff5-4df9-9f38-07d5c1ca221e req-5dce68fb-2086-44f0-80a0-deda3d6e2f59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3848999-7ff7-4b1c-932d-1bb4d9eaba0c", "name": "network-vif-plugged", "status": "completed", "tag": "88096e4b-6d97-4f28-8780-275db20167ff"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:43.307930 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-385060f8-0ff5-4df9-9f38-07d5c1ca221e req-5dce68fb-2086-44f0-80a0-deda3d6e2f59 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:43.308752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-385060f8-0ff5-4df9-9f38-07d5c1ca221e req-5dce68fb-2086-44f0-80a0-deda3d6e2f59 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:43.322568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-385060f8-0ff5-4df9-9f38-07d5c1ca221e req-5dce68fb-2086-44f0-80a0-deda3d6e2f59 service nova] Creating event network-vif-plugged:88096e4b-6d97-4f28-8780-275db20167ff for instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c on hv-cinder-82002 Jul 21 22:26:43.326609 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1d914c1c-96dd-4a35-856c-705cdfa2ff10 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:43.327358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1d914c1c-96dd-4a35-856c-705cdfa2ff10 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:43.335470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-385060f8-0ff5-4df9-9f38-07d5c1ca221e req-5dce68fb-2086-44f0-80a0-deda3d6e2f59 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039666 Jul 21 22:26:43.337066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1133/2142] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:43.338348 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d914c1c-96dd-4a35-856c-705cdfa2ff10 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:43.338804 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d914c1c-96dd-4a35-856c-705cdfa2ff10 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:43.339627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d914c1c-96dd-4a35-856c-705cdfa2ff10 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:43.340066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d914c1c-96dd-4a35-856c-705cdfa2ff10 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:43.524425 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1d914c1c-96dd-4a35-856c-705cdfa2ff10 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:43.537794 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1d914c1c-96dd-4a35-856c-705cdfa2ff10 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1367 microversion: 2.1 time: 0.215448 Jul 21 22:26:43.538394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1010/2143] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:43 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:26:44.556207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-92c2a740-4b0e-4cb6-a0a9-46cc9e1ba827 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:44.556926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-92c2a740-4b0e-4cb6-a0a9-46cc9e1ba827 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:44.563316 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92c2a740-4b0e-4cb6-a0a9-46cc9e1ba827 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:44.563768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92c2a740-4b0e-4cb6-a0a9-46cc9e1ba827 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:44.564526 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92c2a740-4b0e-4cb6-a0a9-46cc9e1ba827 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:44.564962 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92c2a740-4b0e-4cb6-a0a9-46cc9e1ba827 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:44.695047 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-92c2a740-4b0e-4cb6-a0a9-46cc9e1ba827 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:44.702849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-92c2a740-4b0e-4cb6-a0a9-46cc9e1ba827 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1367 microversion: 2.1 time: 0.151352 Jul 21 22:26:44.703519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1134/2144] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:44 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:45.720688 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c86c5bfe-28ff-4e8b-89ad-3464ad28d7a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:45.721290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c86c5bfe-28ff-4e8b-89ad-3464ad28d7a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:45.728065 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c86c5bfe-28ff-4e8b-89ad-3464ad28d7a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:45.728525 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c86c5bfe-28ff-4e8b-89ad-3464ad28d7a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:45.729300 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c86c5bfe-28ff-4e8b-89ad-3464ad28d7a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:45.729747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c86c5bfe-28ff-4e8b-89ad-3464ad28d7a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:45.736889 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:26:45.862389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c86c5bfe-28ff-4e8b-89ad-3464ad28d7a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:26:45.869916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c86c5bfe-28ff-4e8b-89ad-3464ad28d7a1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1557 microversion: 2.1 time: 0.153401 Jul 21 22:26:45.870481 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1011/2145] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:26:45 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:26:45.887027 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-621b574b-8590-4e4d-a3fc-66c9c33e27e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:26:45.888203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-621b574b-8590-4e4d-a3fc-66c9c33e27e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:26:45.894648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-621b574b-8590-4e4d-a3fc-66c9c33e27e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:45.895129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-621b574b-8590-4e4d-a3fc-66c9c33e27e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:45.895891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-621b574b-8590-4e4d-a3fc-66c9c33e27e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:45.896329 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-621b574b-8590-4e4d-a3fc-66c9c33e27e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:45.975290 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-621b574b-8590-4e4d-a3fc-66c9c33e27e2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092280 Jul 21 22:26:45.975892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1135/2146] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 22:26:45 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:26:46.905396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-84248287-8368-4a9b-9e7c-1c787eabafd0 req-0f3c2994-7ba1-4957-8d35-205f69561e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3848999-7ff7-4b1c-932d-1bb4d9eaba0c", "tag": "88096e4b-6d97-4f28-8780-275db20167ff"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:26:46.914073 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-84248287-8368-4a9b-9e7c-1c787eabafd0 req-0f3c2994-7ba1-4957-8d35-205f69561e85 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:26:46.914520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-84248287-8368-4a9b-9e7c-1c787eabafd0 req-0f3c2994-7ba1-4957-8d35-205f69561e85 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:26:46.926482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-84248287-8368-4a9b-9e7c-1c787eabafd0 req-0f3c2994-7ba1-4957-8d35-205f69561e85 service nova] Creating event network-changed:88096e4b-6d97-4f28-8780-275db20167ff for instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c on hv-cinder-82002 Jul 21 22:26:46.931736 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-84248287-8368-4a9b-9e7c-1c787eabafd0 req-0f3c2994-7ba1-4957-8d35-205f69561e85 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031898 Jul 21 22:26:46.932342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1012/2147] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:27:09.251313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:27:09.252024 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:27:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:27:26.818820 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=31 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:26.820923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=18 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:27:26.828847 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-9e21e645-9f71-4b70-97bc-f9ec3da4ad8c req-b3824ce6-1763-437f-80b1-41eed1c1a4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7365f289-299d-4d2d-ba74-1ca18cf88e06", "name": "network-vif-deleted", "tag": "eed67bc7-6a60-4e49-80a2-4868db4a2cb0"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:27:26.843803 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-9e21e645-9f71-4b70-97bc-f9ec3da4ad8c req-b3824ce6-1763-437f-80b1-41eed1c1a4fc service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:27:26.844521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-9e21e645-9f71-4b70-97bc-f9ec3da4ad8c req-b3824ce6-1763-437f-80b1-41eed1c1a4fc service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:27:26.862652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-9e21e645-9f71-4b70-97bc-f9ec3da4ad8c req-b3824ce6-1763-437f-80b1-41eed1c1a4fc service nova] Creating event network-vif-deleted:eed67bc7-6a60-4e49-80a2-4868db4a2cb0 for instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 on hv-cinder-82002 Jul 21 22:27:26.863538 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-9e21e645-9f71-4b70-97bc-f9ec3da4ad8c req-b3824ce6-1763-437f-80b1-41eed1c1a4fc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046481 Jul 21 22:27:26.864448 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1136/2148] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:28:10.857203 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:10.858179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:10.862798 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-635170d9-5529-4173-8454-b0aa1a4f5e51 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:28:10.863416 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-635170d9-5529-4173-8454-b0aa1a4f5e51 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:28:10.871413 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-635170d9-5529-4173-8454-b0aa1a4f5e51 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:28:10.871871 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-635170d9-5529-4173-8454-b0aa1a4f5e51 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:28:10.872678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-635170d9-5529-4173-8454-b0aa1a4f5e51 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:28:10.873157 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-635170d9-5529-4173-8454-b0aa1a4f5e51 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:28:10.896830 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-635170d9-5529-4173-8454-b0aa1a4f5e51 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c/ips" status: 200 len: 146 microversion: 2.1 time: 0.042800 Jul 21 22:28:10.897429 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1013/2149] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 22:28:10 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:28:14.319921 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:14.320654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:28:14.325442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9948c25b-3835-4c11-bcbd-913750c8bf59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:28:14.326016 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9948c25b-3835-4c11-bcbd-913750c8bf59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:28:14.332849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9948c25b-3835-4c11-bcbd-913750c8bf59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:28:14.333294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9948c25b-3835-4c11-bcbd-913750c8bf59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:28:14.334050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9948c25b-3835-4c11-bcbd-913750c8bf59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:28:14.334479 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9948c25b-3835-4c11-bcbd-913750c8bf59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:28:14.357614 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9948c25b-3835-4c11-bcbd-913750c8bf59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c/ips" status: 200 len: 150 microversion: 2.1 time: 0.039371 Jul 21 22:28:14.358167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1137/2150] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 22:28:14 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:28:59.564527 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:28:59.565005 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:28:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:29:10.947808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:10.948628 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:10.952493 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2c827f8c-0fdc-4797-9a8d-fc43afc64f61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:10.952990 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2c827f8c-0fdc-4797-9a8d-fc43afc64f61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:10.959723 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2c827f8c-0fdc-4797-9a8d-fc43afc64f61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:10.960174 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2c827f8c-0fdc-4797-9a8d-fc43afc64f61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:10.960940 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2c827f8c-0fdc-4797-9a8d-fc43afc64f61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:10.961380 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2c827f8c-0fdc-4797-9a8d-fc43afc64f61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:10.987741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2c827f8c-0fdc-4797-9a8d-fc43afc64f61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:29:11.062046 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2c827f8c-0fdc-4797-9a8d-fc43afc64f61 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 204 len: 0 microversion: 2.1 time: 0.115374 Jul 21 22:29:11.062966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1014/2151] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:29:10 2022] DELETE /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:29:11.071279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bf1f3584-1e51-40cc-aa91-0a153434efb9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:11.071919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bf1f3584-1e51-40cc-aa91-0a153434efb9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:11.073948 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:11.074588 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=4 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:11.080381 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf1f3584-1e51-40cc-aa91-0a153434efb9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:11.080827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf1f3584-1e51-40cc-aa91-0a153434efb9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:11.081589 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf1f3584-1e51-40cc-aa91-0a153434efb9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:11.082019 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf1f3584-1e51-40cc-aa91-0a153434efb9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:11.212738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bf1f3584-1e51-40cc-aa91-0a153434efb9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:11.221060 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bf1f3584-1e51-40cc-aa91-0a153434efb9 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1675 microversion: 2.1 time: 0.153833 Jul 21 22:29:11.221613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1138/2152] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:11 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:12.239416 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4155fcf4-1d55-443a-a8f8-31a83fdb9418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:12.240114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4155fcf4-1d55-443a-a8f8-31a83fdb9418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:12.246655 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4155fcf4-1d55-443a-a8f8-31a83fdb9418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:12.247152 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4155fcf4-1d55-443a-a8f8-31a83fdb9418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:12.248569 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4155fcf4-1d55-443a-a8f8-31a83fdb9418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:12.249025 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4155fcf4-1d55-443a-a8f8-31a83fdb9418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:12.382500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4155fcf4-1d55-443a-a8f8-31a83fdb9418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:12.391406 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4155fcf4-1d55-443a-a8f8-31a83fdb9418 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1675 microversion: 2.1 time: 0.156199 Jul 21 22:29:12.392708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1015/2153] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:12 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:13.409373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2387bfad-12d5-4199-a3ec-b84353b50a76 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:13.409986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2387bfad-12d5-4199-a3ec-b84353b50a76 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:13.416390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2387bfad-12d5-4199-a3ec-b84353b50a76 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:13.416841 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2387bfad-12d5-4199-a3ec-b84353b50a76 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:13.417604 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2387bfad-12d5-4199-a3ec-b84353b50a76 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:13.418044 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2387bfad-12d5-4199-a3ec-b84353b50a76 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:13.481678 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2387bfad-12d5-4199-a3ec-b84353b50a76 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f6537f0b9d44ba58cb5a5552f2c5b4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e8fc83edda464e8ec9f7c2ee9c142c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:13.489559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2387bfad-12d5-4199-a3ec-b84353b50a76 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 200 len: 1607 microversion: 2.1 time: 0.084000 Jul 21 22:29:13.490137 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1139/2154] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:13 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 1607 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:13.554522 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-744a1ba7-08f5-4f87-b13f-31de92bb3867 req-60daf391-b9e1-4a5c-854f-7ca008026b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d93d14-2eae-43dc-871b-356fd5dda85c", "name": "network-vif-deleted", "tag": "ced5ebc6-2d23-4040-814d-c3296ebe9156"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:29:13.565084 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-744a1ba7-08f5-4f87-b13f-31de92bb3867 req-60daf391-b9e1-4a5c-854f-7ca008026b68 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:13.565506 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-744a1ba7-08f5-4f87-b13f-31de92bb3867 req-60daf391-b9e1-4a5c-854f-7ca008026b68 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:13.579125 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-744a1ba7-08f5-4f87-b13f-31de92bb3867 req-60daf391-b9e1-4a5c-854f-7ca008026b68 service nova] Creating event network-vif-deleted:ced5ebc6-2d23-4040-814d-c3296ebe9156 for instance c5d93d14-2eae-43dc-871b-356fd5dda85c on hv-cinder-82002 Jul 21 22:29:13.584854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-744a1ba7-08f5-4f87-b13f-31de92bb3867 req-60daf391-b9e1-4a5c-854f-7ca008026b68 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033704 Jul 21 22:29:13.593500 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1016/2155] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:29:14.433044 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8243ee84-9efd-4df7-8176-a350f8439024 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:14.433564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8243ee84-9efd-4df7-8176-a350f8439024 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:14.440277 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8243ee84-9efd-4df7-8176-a350f8439024 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:14.440730 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8243ee84-9efd-4df7-8176-a350f8439024 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:14.441516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8243ee84-9efd-4df7-8176-a350f8439024 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:14.441957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8243ee84-9efd-4df7-8176-a350f8439024 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:14.470986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8243ee84-9efd-4df7-8176-a350f8439024 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Going to try to terminate instance {{(pid=117979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:29:14.507969 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-da05daf6-1f41-48c1-bc0d-50cc0f2a4297 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:14.508579 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-da05daf6-1f41-48c1-bc0d-50cc0f2a4297 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:14.515732 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-da05daf6-1f41-48c1-bc0d-50cc0f2a4297 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:14.516256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-da05daf6-1f41-48c1-bc0d-50cc0f2a4297 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:14.517027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-da05daf6-1f41-48c1-bc0d-50cc0f2a4297 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:14.517473 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-da05daf6-1f41-48c1-bc0d-50cc0f2a4297 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:14.532287 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-da05daf6-1f41-48c1-bc0d-50cc0f2a4297 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] HTTP exception thrown: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-da05daf6-1f41-48c1-bc0d-50cc0f2a4297 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Request method failure captured: Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c HTTP/1.1 Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwsFoQuFzo2FslExyVTADChaJIs6N9-o5VsNNOQT6SZ9p5oybpNMCsOCZlhpZABdWxKinYf5u4ZG1tARrF46oAgdhaQ5A2jaRTfL56kRa7dxhitIuKMLzZz4qYQ5ouY9PdmQ5B98yRhbQLMuSvyefpqsG0a5Zq3gCR9k5F79Ab1l6Y Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:29:14.534239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:29:14.535984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_64e8fc83edda464e8ec9f7c2ee9c142c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:29:14.535984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:29:14.535984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:29:14.535984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:29:14.535984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:29:14.535984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:29:14.535984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:29:14.535984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 9f6537f0b9d44ba58cb5a5552f2c5b4e Jul 21 22:29:14.535984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:29:14.535984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:29:14.535984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:14.535984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': 'c5d93d14-2eae-43dc-871b-356fd5dda85c'} Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:29:14.536849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:14.538291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:29:14.539759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-da05daf6-1f41-48c1-bc0d-50cc0f2a4297 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Returning 404 to user: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:29:14.539759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-da05daf6-1f41-48c1-bc0d-50cc0f2a4297 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 404 len: 111 microversion: 2.1 time: 0.032129 Jul 21 22:29:14.540950 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1017/2156] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:14 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:29:14.545916 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9798c8be-1d25-42b3-b459-613b79533ff2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '.version_select at 0x7faca1e60e50>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:14.563170 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8243ee84-9efd-4df7-8176-a350f8439024 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 204 len: 0 microversion: 2.1 time: 0.133183 Jul 21 22:29:14.563618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1140/2157] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:29:14 2022] DELETE /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:29:14.574657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9a6293d7-529b-44ca-b74b-71afb87a480f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:14.576129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9a6293d7-529b-44ca-b74b-71afb87a480f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:14.577771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9798c8be-1d25-42b3-b459-613b79533ff2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1242969614" status: 202 len: 0 microversion: 2.1 time: 0.035755 Jul 21 22:29:14.578357 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1018/2158] 10.222.0.44 () {58 vars in 1220 bytes} [Thu Jul 21 22:29:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1242969614 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:29:14.582708 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a6293d7-529b-44ca-b74b-71afb87a480f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:14.582708 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a6293d7-529b-44ca-b74b-71afb87a480f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:14.583481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a6293d7-529b-44ca-b74b-71afb87a480f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:14.583917 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a6293d7-529b-44ca-b74b-71afb87a480f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:14.719129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9a6293d7-529b-44ca-b74b-71afb87a480f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:14.726612 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9a6293d7-529b-44ca-b74b-71afb87a480f tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1682 microversion: 2.1 time: 0.157428 Jul 21 22:29:14.727207 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1141/2159] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:14 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:29:15.222898 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-263d7127-280b-416f-8281-1e2935183ff0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:15.223430 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-263d7127-280b-416f-8281-1e2935183ff0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:15.230296 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-263d7127-280b-416f-8281-1e2935183ff0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:15.230758 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-263d7127-280b-416f-8281-1e2935183ff0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:15.231552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-263d7127-280b-416f-8281-1e2935183ff0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:15.232483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-263d7127-280b-416f-8281-1e2935183ff0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:15.245181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-263d7127-280b-416f-8281-1e2935183ff0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] HTTP exception thrown: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-263d7127-280b-416f-8281-1e2935183ff0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Request method failure captured: Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c HTTP/1.1 Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwsFoQuFzo2FslExyVTADChaJIs6N9-o5VsNNOQT6SZ9p5oybpNMCsOCZlhpZABdWxKinYf5u4ZG1tARrF46oAgdhaQ5A2jaRTfL56kRa7dxhitIuKMLzZz4qYQ5ouY9PdmQ5B98yRhbQLMuSvyefpqsG0a5Zq3gCR9k5F79Ab1l6Y Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:29:15.246708 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:29:15.248974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_64e8fc83edda464e8ec9f7c2ee9c142c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:29:15.248974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:29:15.248974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:29:15.248974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:29:15.248974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:29:15.248974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:29:15.248974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:29:15.248974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 9f6537f0b9d44ba58cb5a5552f2c5b4e Jul 21 22:29:15.248974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:29:15.248974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:29:15.248974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:15.248974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': 'c5d93d14-2eae-43dc-871b-356fd5dda85c'} Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:29:15.250146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:15.251826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:29:15.253790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-263d7127-280b-416f-8281-1e2935183ff0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Returning 404 to user: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:29:15.253790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-263d7127-280b-416f-8281-1e2935183ff0 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 404 len: 111 microversion: 2.1 time: 0.029742 Jul 21 22:29:15.253790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1019/2160] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:29:15 2022] DELETE /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:29:15.258144 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-40b30da4-3508-4455-b7b2-96f4ad06a8c2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:15.258772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-40b30da4-3508-4455-b7b2-96f4ad06a8c2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: c5d93d14-2eae-43dc-871b-356fd5dda85c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:15.264714 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40b30da4-3508-4455-b7b2-96f4ad06a8c2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:15.265160 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40b30da4-3508-4455-b7b2-96f4ad06a8c2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:15.265917 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40b30da4-3508-4455-b7b2-96f4ad06a8c2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:15.266351 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-40b30da4-3508-4455-b7b2-96f4ad06a8c2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:15.279222 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-40b30da4-3508-4455-b7b2-96f4ad06a8c2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] HTTP exception thrown: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-40b30da4-3508-4455-b7b2-96f4ad06a8c2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Request method failure captured: Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c HTTP/1.1 Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwsFoQuFzo2FslExyVTADChaJIs6N9-o5VsNNOQT6SZ9p5oybpNMCsOCZlhpZABdWxKinYf5u4ZG1tARrF46oAgdhaQ5A2jaRTfL56kRa7dxhitIuKMLzZz4qYQ5ouY9PdmQ5B98yRhbQLMuSvyefpqsG0a5Zq3gCR9k5F79Ab1l6Y Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:29:15.280853 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:29:15.283154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_64e8fc83edda464e8ec9f7c2ee9c142c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:29:15.283154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:29:15.283154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:29:15.283154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:29:15.283154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:29:15.283154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:29:15.283154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:29:15.283154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 9f6537f0b9d44ba58cb5a5552f2c5b4e Jul 21 22:29:15.283154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:29:15.283154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:29:15.283154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:15.283154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': 'c5d93d14-2eae-43dc-871b-356fd5dda85c'} Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:29:15.284240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. Jul 21 22:29:15.286619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:29:15.288122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-40b30da4-3508-4455-b7b2-96f4ad06a8c2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Returning 404 to user: Instance c5d93d14-2eae-43dc-871b-356fd5dda85c could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:29:15.288122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-40b30da4-3508-4455-b7b2-96f4ad06a8c2 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c" status: 404 len: 111 microversion: 2.1 time: 0.027931 Jul 21 22:29:15.288122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1142/2161] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:15 2022] GET /compute/v2.1/servers/c5d93d14-2eae-43dc-871b-356fd5dda85c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:29:15.744172 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3c28038a-4272-4132-85da-1416eb5f4c59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:15.744709 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3c28038a-4272-4132-85da-1416eb5f4c59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:15.751061 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c28038a-4272-4132-85da-1416eb5f4c59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:15.751514 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c28038a-4272-4132-85da-1416eb5f4c59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:15.752275 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c28038a-4272-4132-85da-1416eb5f4c59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:15.752707 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3c28038a-4272-4132-85da-1416eb5f4c59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:15.884449 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3c28038a-4272-4132-85da-1416eb5f4c59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:15.892443 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3c28038a-4272-4132-85da-1416eb5f4c59 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1682 microversion: 2.1 time: 0.152201 Jul 21 22:29:15.893004 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1020/2162] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:15 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:16.910654 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2536557c-12d4-4356-8383-1d383851ca91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:16.911240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2536557c-12d4-4356-8383-1d383851ca91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:16.917579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2536557c-12d4-4356-8383-1d383851ca91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:16.918033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2536557c-12d4-4356-8383-1d383851ca91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:16.918797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2536557c-12d4-4356-8383-1d383851ca91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:16.919890 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2536557c-12d4-4356-8383-1d383851ca91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:16.983929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2536557c-12d4-4356-8383-1d383851ca91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:16.991794 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2536557c-12d4-4356-8383-1d383851ca91 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 200 len: 1614 microversion: 2.1 time: 0.084820 Jul 21 22:29:16.992377 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1143/2163] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:16 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 1614 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:17.326608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-38fa73d2-e9b3-46ad-86b9-295d35425916 req-97e0b13d-2023-448a-866a-7cfe657161c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3848999-7ff7-4b1c-932d-1bb4d9eaba0c", "name": "network-vif-deleted", "tag": "88096e4b-6d97-4f28-8780-275db20167ff"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:29:17.335147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-38fa73d2-e9b3-46ad-86b9-295d35425916 req-97e0b13d-2023-448a-866a-7cfe657161c8 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:17.335592 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-38fa73d2-e9b3-46ad-86b9-295d35425916 req-97e0b13d-2023-448a-866a-7cfe657161c8 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:17.347432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-38fa73d2-e9b3-46ad-86b9-295d35425916 req-97e0b13d-2023-448a-866a-7cfe657161c8 service nova] Creating event network-vif-deleted:88096e4b-6d97-4f28-8780-275db20167ff for instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c on hv-cinder-82002 Jul 21 22:29:17.352355 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-38fa73d2-e9b3-46ad-86b9-295d35425916 req-97e0b13d-2023-448a-866a-7cfe657161c8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029901 Jul 21 22:29:17.353265 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1021/2164] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:29:18.009003 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f18ab213-ce6d-4543-8a54-934ef7b3c3f4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:18.009618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f18ab213-ce6d-4543-8a54-934ef7b3c3f4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:18.016527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f18ab213-ce6d-4543-8a54-934ef7b3c3f4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:18.016985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f18ab213-ce6d-4543-8a54-934ef7b3c3f4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:18.017765 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f18ab213-ce6d-4543-8a54-934ef7b3c3f4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:18.018203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f18ab213-ce6d-4543-8a54-934ef7b3c3f4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:18.031961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-f18ab213-ce6d-4543-8a54-934ef7b3c3f4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] HTTP exception thrown: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f18ab213-ce6d-4543-8a54-934ef7b3c3f4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Request method failure captured: Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c HTTP/1.1 Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwq5cO8Iqs9BNx6Mzryp9hZtqim1vH8HuegCxrBuP4XGTqM74Ohh4WW_J2xt7YkUUdtgarY1MbMXrA_UelMtrho4YuwAwHA1g3NEpX3Am91Bsh0TFHZTsHViUUwnnQ3b29fzazVBCaTklKontb6LNgtPxGazR2DvDr1xBxhj2kB17I Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:29:18.033509 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:29:18.035293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47878d7ed9cb49adba1f84a2ffb2deda", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:29:18.035293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:29:18.035293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:29:18.035293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:29:18.035293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:29:18.035293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:29:18.035293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:29:18.035293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 73f068abea75404fb2829065a674aee4 Jul 21 22:29:18.035293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:29:18.035293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:29:18.035293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:29:18.035293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': 'd3848999-7ff7-4b1c-932d-1bb4d9eaba0c'} Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:29:18.036279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:29:18.037913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:29:18.039429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f18ab213-ce6d-4543-8a54-934ef7b3c3f4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Returning 404 to user: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:29:18.039429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f18ab213-ce6d-4543-8a54-934ef7b3c3f4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 404 len: 111 microversion: 2.1 time: 0.029839 Jul 21 22:29:18.039429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1144/2165] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:18 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:29:18.045693 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8a3a9738-4946-439b-975d-3c262850431d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '.version_select at 0x7faca1e1d8b0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:18.064207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8a3a9738-4946-439b-975d-3c262850431d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102677831" status: 202 len: 0 microversion: 2.1 time: 0.023744 Jul 21 22:29:18.064771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1022/2166] 10.222.0.44 () {58 vars in 1220 bytes} [Thu Jul 21 22:29:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102677831 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:29:18.580877 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:29:18.581553 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:29:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:29:18.714141 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-173ff5c7-7d41-4474-88c9-530b22ae3f85 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Action: 'create', calling method: .version_select at 0x7faca6e13280>, body: {"keypair": {"name": "tempest-keypair-1489390838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTOSJXPkvVAEbC0/z0AR2hXCDuzrOfRVh3gr7wU+WlEyBxC6D9xINSAa6HiYNxwNcpIKAxESH1LYpl+JerL4NZ7rIFCGxuS1TwSlBTw2z1w4oTul/676YdVeKakkhv3dw=="}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:29:18.728601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-173ff5c7-7d41-4474-88c9-530b22ae3f85 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'key_pairs'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:29:18.732361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-173ff5c7-7d41-4474-88c9-530b22ae3f85 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for user 73f068abea75404fb2829065a674aee4 and project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'key_pairs'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:29:18.753832 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-173ff5c7-7d41-4474-88c9-530b22ae3f85 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043525 Jul 21 22:29:18.754937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1145/2167] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 22:29:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:29:20.034252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1759152183", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31aaafc3-d737-47df-987b-f83f4d3a2678"}], "security_groups": [{"name": "tempest-securitygroup--440377783"}], "key_name": "tempest-keypair-1489390838", "user_data": "}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:29:20.135214 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] validate_networks() for [('31aaafc3-d737-47df-987b-f83f4d3a2678', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:29:20.503043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:29:20.503468 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:29:20.503973 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:29:20.504411 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:29:20.504819 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:29:20.514121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:20.514567 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:20.515392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:20.515829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:20.532749 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:29:20.536637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Getting quotas for user 73f068abea75404fb2829065a674aee4 and project 47878d7ed9cb49adba1f84a2ffb2deda. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:29:20.547457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:29:20.549824 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:29:20.596910 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d74db35d-4393-4322-a17d-7af0faa0689d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.567466 Jul 21 22:29:20.597773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1023/2168] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 22:29:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:29:20.608006 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2693d0a4-4ff4-4052-b0d6-6c166f508844 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:20.609215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2693d0a4-4ff4-4052-b0d6-6c166f508844 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:20.663296 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2693d0a4-4ff4-4052-b0d6-6c166f508844 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:20.669989 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2693d0a4-4ff4-4052-b0d6-6c166f508844 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 200 len: 1242 microversion: 2.1 time: 0.066277 Jul 21 22:29:20.670620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1146/2169] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:20 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:21.689158 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-00fbbd0a-48bd-4084-9c4e-854e8bf5545e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:21.689805 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-00fbbd0a-48bd-4084-9c4e-854e8bf5545e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:21.696440 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00fbbd0a-48bd-4084-9c4e-854e8bf5545e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:21.696891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00fbbd0a-48bd-4084-9c4e-854e8bf5545e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:21.698167 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00fbbd0a-48bd-4084-9c4e-854e8bf5545e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:21.698602 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00fbbd0a-48bd-4084-9c4e-854e8bf5545e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:21.764764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-00fbbd0a-48bd-4084-9c4e-854e8bf5545e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:21.772123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-00fbbd0a-48bd-4084-9c4e-854e8bf5545e tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 200 len: 1300 microversion: 2.1 time: 0.088940 Jul 21 22:29:21.772687 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1024/2170] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:21 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:22.789738 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e9632259-a62c-4cb1-9ae3-3ffa8e5af22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:22.791026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e9632259-a62c-4cb1-9ae3-3ffa8e5af22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:22.806669 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e9632259-a62c-4cb1-9ae3-3ffa8e5af22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:22.807277 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e9632259-a62c-4cb1-9ae3-3ffa8e5af22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:22.812707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e9632259-a62c-4cb1-9ae3-3ffa8e5af22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:22.813487 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e9632259-a62c-4cb1-9ae3-3ffa8e5af22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:22.957921 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e9632259-a62c-4cb1-9ae3-3ffa8e5af22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:22.965434 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e9632259-a62c-4cb1-9ae3-3ffa8e5af22a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 200 len: 1367 microversion: 2.1 time: 0.179597 Jul 21 22:29:22.967052 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1147/2171] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:22 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:23.006556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-cc4878bc-49ed-4312-b289-ae8129366062 req-5a9b6318-c173-48af-8637-083ca91caa17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17219362-2c3f-4b61-8ac8-1f2790b3529d", "tag": "e3802b8f-cf28-4908-a7ea-be6c1fa3879d"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:29:23.017670 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-cc4878bc-49ed-4312-b289-ae8129366062 req-5a9b6318-c173-48af-8637-083ca91caa17 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:23.018032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-cc4878bc-49ed-4312-b289-ae8129366062 req-5a9b6318-c173-48af-8637-083ca91caa17 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:23.033106 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-cc4878bc-49ed-4312-b289-ae8129366062 req-5a9b6318-c173-48af-8637-083ca91caa17 service nova] Creating event network-changed:e3802b8f-cf28-4908-a7ea-be6c1fa3879d for instance 17219362-2c3f-4b61-8ac8-1f2790b3529d on hv-cinder-82002 Jul 21 22:29:23.038509 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-cc4878bc-49ed-4312-b289-ae8129366062 req-5a9b6318-c173-48af-8637-083ca91caa17 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041929 Jul 21 22:29:23.039503 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1025/2172] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:29:23.982961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b8d6e152-1b48-4388-ba7a-b5259ff9eac1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:23.983608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b8d6e152-1b48-4388-ba7a-b5259ff9eac1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:23.990108 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b8d6e152-1b48-4388-ba7a-b5259ff9eac1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:23.990568 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b8d6e152-1b48-4388-ba7a-b5259ff9eac1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:23.991379 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b8d6e152-1b48-4388-ba7a-b5259ff9eac1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:23.991809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b8d6e152-1b48-4388-ba7a-b5259ff9eac1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:24.123741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b8d6e152-1b48-4388-ba7a-b5259ff9eac1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:24.131092 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b8d6e152-1b48-4388-ba7a-b5259ff9eac1 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 200 len: 1367 microversion: 2.1 time: 0.152397 Jul 21 22:29:24.131623 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1148/2173] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:23 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:25.148919 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0866237f-3ac1-408b-9002-efeeef34fd3a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:25.149646 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0866237f-3ac1-408b-9002-efeeef34fd3a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:25.156914 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0866237f-3ac1-408b-9002-efeeef34fd3a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:25.157366 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0866237f-3ac1-408b-9002-efeeef34fd3a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:25.158139 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0866237f-3ac1-408b-9002-efeeef34fd3a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:25.158580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0866237f-3ac1-408b-9002-efeeef34fd3a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:25.286738 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0866237f-3ac1-408b-9002-efeeef34fd3a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:25.294124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0866237f-3ac1-408b-9002-efeeef34fd3a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 200 len: 1367 microversion: 2.1 time: 0.149793 Jul 21 22:29:25.294706 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1026/2174] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:25 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:26.310957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b794b338-1e33-4db3-981f-ce38c9aba209 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:26.311520 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b794b338-1e33-4db3-981f-ce38c9aba209 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:26.317951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b794b338-1e33-4db3-981f-ce38c9aba209 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:26.318402 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b794b338-1e33-4db3-981f-ce38c9aba209 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:26.319200 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b794b338-1e33-4db3-981f-ce38c9aba209 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:26.319644 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b794b338-1e33-4db3-981f-ce38c9aba209 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:26.451155 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b794b338-1e33-4db3-981f-ce38c9aba209 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:26.458481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b794b338-1e33-4db3-981f-ce38c9aba209 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 200 len: 1367 microversion: 2.1 time: 0.151484 Jul 21 22:29:26.459066 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1149/2175] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:26 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:27.476219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7cbd32c4-3cb7-4b9d-94ad-df0705c3bb07 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:27.476875 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7cbd32c4-3cb7-4b9d-94ad-df0705c3bb07 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:27.484229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7cbd32c4-3cb7-4b9d-94ad-df0705c3bb07 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:27.484492 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7cbd32c4-3cb7-4b9d-94ad-df0705c3bb07 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:27.485271 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7cbd32c4-3cb7-4b9d-94ad-df0705c3bb07 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:27.485712 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7cbd32c4-3cb7-4b9d-94ad-df0705c3bb07 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:27.619510 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7cbd32c4-3cb7-4b9d-94ad-df0705c3bb07 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:27.627088 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7cbd32c4-3cb7-4b9d-94ad-df0705c3bb07 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 200 len: 1367 microversion: 2.1 time: 0.154747 Jul 21 22:29:27.627655 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1027/2176] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:27 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:28.099547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-d576fd69-7b66-46d3-a86e-19d3d68eb7e2 req-57369ee1-90c0-4101-928c-c86af5300fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17219362-2c3f-4b61-8ac8-1f2790b3529d", "name": "network-vif-plugged", "status": "completed", "tag": "e3802b8f-cf28-4908-a7ea-be6c1fa3879d"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:29:28.108406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-d576fd69-7b66-46d3-a86e-19d3d68eb7e2 req-57369ee1-90c0-4101-928c-c86af5300fa2 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:28.108880 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-d576fd69-7b66-46d3-a86e-19d3d68eb7e2 req-57369ee1-90c0-4101-928c-c86af5300fa2 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:28.120831 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-d576fd69-7b66-46d3-a86e-19d3d68eb7e2 req-57369ee1-90c0-4101-928c-c86af5300fa2 service nova] Creating event network-vif-plugged:e3802b8f-cf28-4908-a7ea-be6c1fa3879d for instance 17219362-2c3f-4b61-8ac8-1f2790b3529d on hv-cinder-82002 Jul 21 22:29:28.126328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-d576fd69-7b66-46d3-a86e-19d3d68eb7e2 req-57369ee1-90c0-4101-928c-c86af5300fa2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030495 Jul 21 22:29:28.126917 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1150/2177] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:29:28.643675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1cd3d7a9-8f27-4a4e-a463-bda3fb6cb809 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:28.644295 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1cd3d7a9-8f27-4a4e-a463-bda3fb6cb809 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:28.650757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1cd3d7a9-8f27-4a4e-a463-bda3fb6cb809 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:28.651248 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1cd3d7a9-8f27-4a4e-a463-bda3fb6cb809 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:28.652021 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1cd3d7a9-8f27-4a4e-a463-bda3fb6cb809 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:28.652457 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1cd3d7a9-8f27-4a4e-a463-bda3fb6cb809 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:28.782066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1cd3d7a9-8f27-4a4e-a463-bda3fb6cb809 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:28.789451 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1cd3d7a9-8f27-4a4e-a463-bda3fb6cb809 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 200 len: 1367 microversion: 2.1 time: 0.149619 Jul 21 22:29:28.790024 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1028/2178] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:28 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:29.807243 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ca536033-634c-42b4-88c3-19144b15c675 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:29.807944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ca536033-634c-42b4-88c3-19144b15c675 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:29.815505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ca536033-634c-42b4-88c3-19144b15c675 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:29.815958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ca536033-634c-42b4-88c3-19144b15c675 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:29.816719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ca536033-634c-42b4-88c3-19144b15c675 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:29.817150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ca536033-634c-42b4-88c3-19144b15c675 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:30.168266 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ca536033-634c-42b4-88c3-19144b15c675 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:29:30.177488 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ca536033-634c-42b4-88c3-19144b15c675 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 200 len: 1557 microversion: 2.1 time: 0.374963 Jul 21 22:29:30.178067 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1151/2179] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:29:29 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 1557 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:29:30.195474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-37916e9f-e47d-4cb6-9da4-50f9d0cc4913 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:29:30.196045 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-37916e9f-e47d-4cb6-9da4-50f9d0cc4913 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:29:30.202858 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-37916e9f-e47d-4cb6-9da4-50f9d0cc4913 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:30.203367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-37916e9f-e47d-4cb6-9da4-50f9d0cc4913 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:30.204138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-37916e9f-e47d-4cb6-9da4-50f9d0cc4913 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:30.204576 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-37916e9f-e47d-4cb6-9da4-50f9d0cc4913 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:30.280723 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-37916e9f-e47d-4cb6-9da4-50f9d0cc4913 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089073 Jul 21 22:29:30.281338 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1029/2180] 10.222.0.44 () {58 vars in 1274 bytes} [Thu Jul 21 22:29:30 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:29:31.229123 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-1156d5ff-3cfc-4b5f-987d-9120816788c0 req-be18f055-0e7c-4c57-8a0a-eb4a5de92c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17219362-2c3f-4b61-8ac8-1f2790b3529d", "tag": "e3802b8f-cf28-4908-a7ea-be6c1fa3879d"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:29:31.233930 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=6 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:29:31.240468 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-1156d5ff-3cfc-4b5f-987d-9120816788c0 req-be18f055-0e7c-4c57-8a0a-eb4a5de92c78 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:29:31.240919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-1156d5ff-3cfc-4b5f-987d-9120816788c0 req-be18f055-0e7c-4c57-8a0a-eb4a5de92c78 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:29:31.257608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-1156d5ff-3cfc-4b5f-987d-9120816788c0 req-be18f055-0e7c-4c57-8a0a-eb4a5de92c78 service nova] Creating event network-changed:e3802b8f-cf28-4908-a7ea-be6c1fa3879d for instance 17219362-2c3f-4b61-8ac8-1f2790b3529d on hv-cinder-82002 Jul 21 22:29:31.263437 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-1156d5ff-3cfc-4b5f-987d-9120816788c0 req-be18f055-0e7c-4c57-8a0a-eb4a5de92c78 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037275 Jul 21 22:29:31.264068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1152/2181] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:30:29.260013 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:30:29.260691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:30:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:30:46.231404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:46.234293 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:46.236728 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:46.237801 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:30:46.429751 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d0628ece-f66e-4c6f-b489-b8d05feb7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:30:46.430245 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d0628ece-f66e-4c6f-b489-b8d05feb7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:30:46.437100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d0628ece-f66e-4c6f-b489-b8d05feb7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:30:46.437556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d0628ece-f66e-4c6f-b489-b8d05feb7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:30:46.438348 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d0628ece-f66e-4c6f-b489-b8d05feb7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:30:46.438789 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d0628ece-f66e-4c6f-b489-b8d05feb7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:30:46.480599 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d0628ece-f66e-4c6f-b489-b8d05feb7ee2 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d/ips" status: 200 len: 149 microversion: 2.1 time: 0.251457 Jul 21 22:30:46.485684 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1030/2182] 10.222.0.44 () {58 vars in 1247 bytes} [Thu Jul 21 22:30:46 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d/ips => generated 149 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:31:46.548658 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1ea72114-1d1b-4719-8091-31de6bff38ad] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 22:31:46.549294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:46.550034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:46.554893 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ecb7c819-de04-47ef-867a-ca5a5531a129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:46.555529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ecb7c819-de04-47ef-867a-ca5a5531a129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:31:46.565659 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ecb7c819-de04-47ef-867a-ca5a5531a129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:46.566142 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ecb7c819-de04-47ef-867a-ca5a5531a129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:46.567055 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ecb7c819-de04-47ef-867a-ca5a5531a129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:46.567497 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ecb7c819-de04-47ef-867a-ca5a5531a129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:46.601253 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ecb7c819-de04-47ef-867a-ca5a5531a129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Going to try to terminate instance {{(pid=117979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:31:46.691271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ecb7c819-de04-47ef-867a-ca5a5531a129 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "DELETE /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 204 len: 0 microversion: 2.1 time: 0.143508 Jul 21 22:31:46.692422 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1153/2183] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:31:46 2022] DELETE /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:31:46.700673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:46.702369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:31:46.708929 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5ca034ee-d096-495d-982c-13138cd163d8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:46.709674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5ca034ee-d096-495d-982c-13138cd163d8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:31:46.718855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ca034ee-d096-495d-982c-13138cd163d8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:46.719369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ca034ee-d096-495d-982c-13138cd163d8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:46.720165 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ca034ee-d096-495d-982c-13138cd163d8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:46.720614 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5ca034ee-d096-495d-982c-13138cd163d8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:47.007771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5ca034ee-d096-495d-982c-13138cd163d8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:31:47.016744 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5ca034ee-d096-495d-982c-13138cd163d8 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 200 len: 1681 microversion: 2.1 time: 0.318420 Jul 21 22:31:47.017255 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1031/2184] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:31:46 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 1681 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:31:48.041559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e98122b4-0566-413f-a709-45355549a523 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:48.042640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e98122b4-0566-413f-a709-45355549a523 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:31:48.053198 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e98122b4-0566-413f-a709-45355549a523 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:48.053662 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e98122b4-0566-413f-a709-45355549a523 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:48.054513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e98122b4-0566-413f-a709-45355549a523 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:48.054977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e98122b4-0566-413f-a709-45355549a523 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:48.064707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] [1ea72114-1d1b-4719-8091-31de6bff38ad] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 36662. Jul 21 22:31:48.287181 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e98122b4-0566-413f-a709-45355549a523 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:31:48.296152 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e98122b4-0566-413f-a709-45355549a523 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 200 len: 1681 microversion: 2.1 time: 0.260956 Jul 21 22:31:48.297038 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1154/2185] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:31:48 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 1681 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:31:49.319606 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4be63354-b4b8-469e-b21e-926266317811 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:49.320730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4be63354-b4b8-469e-b21e-926266317811 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:31:49.328354 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4be63354-b4b8-469e-b21e-926266317811 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:49.328939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4be63354-b4b8-469e-b21e-926266317811 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:49.329749 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4be63354-b4b8-469e-b21e-926266317811 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:49.330193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4be63354-b4b8-469e-b21e-926266317811 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:49.437489 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4be63354-b4b8-469e-b21e-926266317811 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f068abea75404fb2829065a674aee4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47878d7ed9cb49adba1f84a2ffb2deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:31:49.447218 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4be63354-b4b8-469e-b21e-926266317811 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 200 len: 1614 microversion: 2.1 time: 0.132774 Jul 21 22:31:49.447929 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1032/2186] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:31:49 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 1614 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:31:49.858149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-3c83d835-1e6c-4386-b26a-ea7fd93ed764 req-d8d772dc-5130-420a-922f-c20b91d231c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17219362-2c3f-4b61-8ac8-1f2790b3529d", "name": "network-vif-deleted", "tag": "e3802b8f-cf28-4908-a7ea-be6c1fa3879d"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:31:49.871527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-3c83d835-1e6c-4386-b26a-ea7fd93ed764 req-d8d772dc-5130-420a-922f-c20b91d231c0 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:49.873156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-3c83d835-1e6c-4386-b26a-ea7fd93ed764 req-d8d772dc-5130-420a-922f-c20b91d231c0 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:49.912426 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-3c83d835-1e6c-4386-b26a-ea7fd93ed764 req-d8d772dc-5130-420a-922f-c20b91d231c0 service nova] Creating event network-vif-deleted:e3802b8f-cf28-4908-a7ea-be6c1fa3879d for instance 17219362-2c3f-4b61-8ac8-1f2790b3529d on hv-cinder-82002 Jul 21 22:31:49.922826 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-3c83d835-1e6c-4386-b26a-ea7fd93ed764 req-d8d772dc-5130-420a-922f-c20b91d231c0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201541 Jul 21 22:31:49.924795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1155/2187] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:31:50.471811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7299a88e-4242-4efe-be97-48755d97315a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:50.473224 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7299a88e-4242-4efe-be97-48755d97315a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:31:50.490899 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7299a88e-4242-4efe-be97-48755d97315a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:50.491701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7299a88e-4242-4efe-be97-48755d97315a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:50.493372 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7299a88e-4242-4efe-be97-48755d97315a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:50.493967 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7299a88e-4242-4efe-be97-48755d97315a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:50.509572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-7299a88e-4242-4efe-be97-48755d97315a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] HTTP exception thrown: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7299a88e-4242-4efe-be97-48755d97315a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Request method failure captured: Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d HTTP/1.1 Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwq5cO8Iqs9BNx6Mzryp9hZtqim1vH8HuegCxrBuP4XGTqM74Ohh4WW_J2xt7YkUUdtgarY1MbMXrA_UelMtrho4YuwAwHA1g3NEpX3Am91Bsh0TFHZTsHViUUwnnQ3b29fzazVBCaTklKontb6LNgtPxGazR2DvDr1xBxhj2kB17I Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:31:50.511346 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:31:50.520000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47878d7ed9cb49adba1f84a2ffb2deda", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:31:50.520000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:50.520000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:50.520000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:50.520000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:50.520000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:31:50.520000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:31:50.520000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 73f068abea75404fb2829065a674aee4 Jul 21 22:31:50.520000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:50.520000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:31:50.520000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:50.520000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': '17219362-2c3f-4b61-8ac8-1f2790b3529d'} Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:31:50.523745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:50.529027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:50.531978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7299a88e-4242-4efe-be97-48755d97315a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Returning 404 to user: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:31:50.531978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7299a88e-4242-4efe-be97-48755d97315a tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 404 len: 111 microversion: 2.1 time: 0.048873 Jul 21 22:31:50.531978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1033/2188] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:31:50 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:31:50.539278 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-452e7e23-8479-467b-aa36-b2498a890e6d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '.version_select at 0x7faca3149670>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:50.565709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-452e7e23-8479-467b-aa36-b2498a890e6d tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489390838" status: 202 len: 0 microversion: 2.1 time: 0.043402 Jul 21 22:31:50.566748 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1156/2189] 10.222.0.44 () {58 vars in 1220 bytes} [Thu Jul 21 22:31:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489390838 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:31:51.472177 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9847d790-4874-49e5-afc9-43c6ddc0dac4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:51.472771 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9847d790-4874-49e5-afc9-43c6ddc0dac4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:31:51.480783 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9847d790-4874-49e5-afc9-43c6ddc0dac4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:51.481291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9847d790-4874-49e5-afc9-43c6ddc0dac4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:51.482132 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9847d790-4874-49e5-afc9-43c6ddc0dac4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:51.482821 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9847d790-4874-49e5-afc9-43c6ddc0dac4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:51.500877 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-9847d790-4874-49e5-afc9-43c6ddc0dac4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] HTTP exception thrown: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9847d790-4874-49e5-afc9-43c6ddc0dac4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Request method failure captured: Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d HTTP/1.1 Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwq5cO8Iqs9BNx6Mzryp9hZtqim1vH8HuegCxrBuP4XGTqM74Ohh4WW_J2xt7YkUUdtgarY1MbMXrA_UelMtrho4YuwAwHA1g3NEpX3Am91Bsh0TFHZTsHViUUwnnQ3b29fzazVBCaTklKontb6LNgtPxGazR2DvDr1xBxhj2kB17I Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:31:51.502482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:31:51.505432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47878d7ed9cb49adba1f84a2ffb2deda", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:31:51.505432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.505432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:51.505432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.505432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:51.505432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:31:51.505432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:31:51.505432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 73f068abea75404fb2829065a674aee4 Jul 21 22:31:51.505432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:51.505432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:31:51.505432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:51.505432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': '17219362-2c3f-4b61-8ac8-1f2790b3529d'} Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:31:51.506991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:51.509611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.511924 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9847d790-4874-49e5-afc9-43c6ddc0dac4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Returning 404 to user: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:31:51.511924 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9847d790-4874-49e5-afc9-43c6ddc0dac4 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "DELETE /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 404 len: 111 microversion: 2.1 time: 0.038886 Jul 21 22:31:51.511924 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1034/2190] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:31:51 2022] DELETE /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:31:51.514962 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-93cc4e6d-11cf-4008-8618-7a1c86a72171 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:51.516215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-93cc4e6d-11cf-4008-8618-7a1c86a72171 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 17219362-2c3f-4b61-8ac8-1f2790b3529d] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:31:51.527388 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-93cc4e6d-11cf-4008-8618-7a1c86a72171 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:51.528138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-93cc4e6d-11cf-4008-8618-7a1c86a72171 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:51.529603 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-93cc4e6d-11cf-4008-8618-7a1c86a72171 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:51.530330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-93cc4e6d-11cf-4008-8618-7a1c86a72171 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:51.547728 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-93cc4e6d-11cf-4008-8618-7a1c86a72171 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] HTTP exception thrown: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-93cc4e6d-11cf-4008-8618-7a1c86a72171 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Request method failure captured: Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d HTTP/1.1 Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwq5cO8Iqs9BNx6Mzryp9hZtqim1vH8HuegCxrBuP4XGTqM74Ohh4WW_J2xt7YkUUdtgarY1MbMXrA_UelMtrho4YuwAwHA1g3NEpX3Am91Bsh0TFHZTsHViUUwnnQ3b29fzazVBCaTklKontb6LNgtPxGazR2DvDr1xBxhj2kB17I Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:31:51.549652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:31:51.551507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47878d7ed9cb49adba1f84a2ffb2deda", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:31:51.551507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.551507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:51.551507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.551507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:51.551507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:31:51.551507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:31:51.551507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 73f068abea75404fb2829065a674aee4 Jul 21 22:31:51.551507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:51.551507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:31:51.551507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:51.551507 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '17219362-2c3f-4b61-8ac8-1f2790b3529d'} Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:31:51.552656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. Jul 21 22:31:51.554300 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.555889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-93cc4e6d-11cf-4008-8618-7a1c86a72171 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Returning 404 to user: Instance 17219362-2c3f-4b61-8ac8-1f2790b3529d could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:31:51.555889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-93cc4e6d-11cf-4008-8618-7a1c86a72171 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d" status: 404 len: 111 microversion: 2.1 time: 0.042285 Jul 21 22:31:51.555889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1157/2191] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:31:51 2022] GET /compute/v2.1/servers/17219362-2c3f-4b61-8ac8-1f2790b3529d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:31:51.560888 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-184d4b0b-fd2a-4960-908b-5809decbb235 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:51.561393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-184d4b0b-fd2a-4960-908b-5809decbb235 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:31:51.568000 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-184d4b0b-fd2a-4960-908b-5809decbb235 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:51.568460 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-184d4b0b-fd2a-4960-908b-5809decbb235 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:51.569253 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-184d4b0b-fd2a-4960-908b-5809decbb235 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:51.569675 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-184d4b0b-fd2a-4960-908b-5809decbb235 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:51.586447 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-184d4b0b-fd2a-4960-908b-5809decbb235 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] HTTP exception thrown: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-184d4b0b-fd2a-4960-908b-5809decbb235 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Request method failure captured: Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c HTTP/1.1 Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwq5cO8Iqs9BNx6Mzryp9hZtqim1vH8HuegCxrBuP4XGTqM74Ohh4WW_J2xt7YkUUdtgarY1MbMXrA_UelMtrho4YuwAwHA1g3NEpX3Am91Bsh0TFHZTsHViUUwnnQ3b29fzazVBCaTklKontb6LNgtPxGazR2DvDr1xBxhj2kB17I Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:31:51.588535 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:31:51.590883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47878d7ed9cb49adba1f84a2ffb2deda", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:31:51.590883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.590883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:51.590883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.590883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:51.590883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:31:51.590883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:31:51.590883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 73f068abea75404fb2829065a674aee4 Jul 21 22:31:51.590883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:51.590883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:31:51.590883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:31:51.590883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': 'd3848999-7ff7-4b1c-932d-1bb4d9eaba0c'} Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:31:51.592487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:31:51.594983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.597765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-184d4b0b-fd2a-4960-908b-5809decbb235 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Returning 404 to user: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:31:51.597765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-184d4b0b-fd2a-4960-908b-5809decbb235 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 404 len: 111 microversion: 2.1 time: 0.033836 Jul 21 22:31:51.597765 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1035/2192] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:31:51 2022] DELETE /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:31:51.601339 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-58518a46-f137-4b34-b609-4987dd31f492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:51.602019 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-58518a46-f137-4b34-b609-4987dd31f492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: d3848999-7ff7-4b1c-932d-1bb4d9eaba0c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:31:51.608908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-58518a46-f137-4b34-b609-4987dd31f492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:51.609358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-58518a46-f137-4b34-b609-4987dd31f492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:51.610329 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-58518a46-f137-4b34-b609-4987dd31f492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:51.610892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-58518a46-f137-4b34-b609-4987dd31f492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:51.626004 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-58518a46-f137-4b34-b609-4987dd31f492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] HTTP exception thrown: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-58518a46-f137-4b34-b609-4987dd31f492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Request method failure captured: Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c HTTP/1.1 Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwq5cO8Iqs9BNx6Mzryp9hZtqim1vH8HuegCxrBuP4XGTqM74Ohh4WW_J2xt7YkUUdtgarY1MbMXrA_UelMtrho4YuwAwHA1g3NEpX3Am91Bsh0TFHZTsHViUUwnnQ3b29fzazVBCaTklKontb6LNgtPxGazR2DvDr1xBxhj2kB17I Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:31:51.627996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:31:51.630773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47878d7ed9cb49adba1f84a2ffb2deda", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:31:51.630773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.630773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:51.630773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.630773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:51.630773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:31:51.630773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:31:51.630773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 73f068abea75404fb2829065a674aee4 Jul 21 22:31:51.630773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:51.630773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:31:51.630773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:31:51.630773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': 'd3848999-7ff7-4b1c-932d-1bb4d9eaba0c'} Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:31:51.631860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. Jul 21 22:31:51.634356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.636006 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-58518a46-f137-4b34-b609-4987dd31f492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Returning 404 to user: Instance d3848999-7ff7-4b1c-932d-1bb4d9eaba0c could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:31:51.636006 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-58518a46-f137-4b34-b609-4987dd31f492 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c" status: 404 len: 111 microversion: 2.1 time: 0.034164 Jul 21 22:31:51.636006 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1158/2193] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:31:51 2022] GET /compute/v2.1/servers/d3848999-7ff7-4b1c-932d-1bb4d9eaba0c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:31:51.641323 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f27fc45a-f9dc-4102-b0fd-6c2e4a588cb5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:51.641818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f27fc45a-f9dc-4102-b0fd-6c2e4a588cb5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:31:51.648197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f27fc45a-f9dc-4102-b0fd-6c2e4a588cb5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:51.648652 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f27fc45a-f9dc-4102-b0fd-6c2e4a588cb5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:51.649427 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f27fc45a-f9dc-4102-b0fd-6c2e4a588cb5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:51.649874 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f27fc45a-f9dc-4102-b0fd-6c2e4a588cb5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:51.668209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-f27fc45a-f9dc-4102-b0fd-6c2e4a588cb5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] HTTP exception thrown: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f27fc45a-f9dc-4102-b0fd-6c2e4a588cb5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Request method failure captured: Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f HTTP/1.1 Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwq5cO8Iqs9BNx6Mzryp9hZtqim1vH8HuegCxrBuP4XGTqM74Ohh4WW_J2xt7YkUUdtgarY1MbMXrA_UelMtrho4YuwAwHA1g3NEpX3Am91Bsh0TFHZTsHViUUwnnQ3b29fzazVBCaTklKontb6LNgtPxGazR2DvDr1xBxhj2kB17I Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:31:51.670019 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:31:51.672840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47878d7ed9cb49adba1f84a2ffb2deda", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:31:51.672840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.672840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:51.672840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.672840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:51.672840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:31:51.672840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:31:51.672840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 73f068abea75404fb2829065a674aee4 Jul 21 22:31:51.672840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:51.672840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:31:51.672840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:31:51.672840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': 'c8cef302-505a-45dc-9113-668fb800106f'} Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:31:51.673923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:31:51.675754 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.677325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f27fc45a-f9dc-4102-b0fd-6c2e4a588cb5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Returning 404 to user: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:31:51.677325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f27fc45a-f9dc-4102-b0fd-6c2e4a588cb5 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "DELETE /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 404 len: 111 microversion: 2.1 time: 0.033829 Jul 21 22:31:51.677325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1036/2194] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:31:51 2022] DELETE /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:31:51.679844 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5676b472-f924-4111-85df-049562be2a43 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:31:51.681061 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5676b472-f924-4111-85df-049562be2a43 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: c8cef302-505a-45dc-9113-668fb800106f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:31:51.688406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5676b472-f924-4111-85df-049562be2a43 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:51.688862 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5676b472-f924-4111-85df-049562be2a43 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:51.689652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5676b472-f924-4111-85df-049562be2a43 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:31:51.690281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5676b472-f924-4111-85df-049562be2a43 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:31:51.704978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-5676b472-f924-4111-85df-049562be2a43 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] HTTP exception thrown: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5676b472-f924-4111-85df-049562be2a43 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Request method failure captured: Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f HTTP/1.1 Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwq5cO8Iqs9BNx6Mzryp9hZtqim1vH8HuegCxrBuP4XGTqM74Ohh4WW_J2xt7YkUUdtgarY1MbMXrA_UelMtrho4YuwAwHA1g3NEpX3Am91Bsh0TFHZTsHViUUwnnQ3b29fzazVBCaTklKontb6LNgtPxGazR2DvDr1xBxhj2kB17I Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:31:51.708761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:31:51.710615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47878d7ed9cb49adba1f84a2ffb2deda", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:31:51.710615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.710615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:31:51.710615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:31:51.710615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:51.710615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:31:51.710615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:31:51.710615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 73f068abea75404fb2829065a674aee4 Jul 21 22:31:51.710615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:31:51.710615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:31:51.710615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:31:51.710615 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': 'c8cef302-505a-45dc-9113-668fb800106f'} Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:31:51.711737 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. Jul 21 22:31:51.713259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:31:51.714685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5676b472-f924-4111-85df-049562be2a43 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Returning 404 to user: Instance c8cef302-505a-45dc-9113-668fb800106f could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:31:51.714685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5676b472-f924-4111-85df-049562be2a43 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f" status: 404 len: 111 microversion: 2.1 time: 0.032039 Jul 21 22:31:51.714685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1159/2195] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:31:51 2022] GET /compute/v2.1/servers/c8cef302-505a-45dc-9113-668fb800106f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:32:19.572389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:32:19.573305 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:32:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:32:31.209877 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:32:31.210769 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:32:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:32:31.586141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ceca5f3c-e9c0-4cf2-b149-deb58e6a597e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:31.587301 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ceca5f3c-e9c0-4cf2-b149-deb58e6a597e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:32:31.590871 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=12 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:31.591991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=20 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:31.603274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ceca5f3c-e9c0-4cf2-b149-deb58e6a597e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:32:31.603586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ceca5f3c-e9c0-4cf2-b149-deb58e6a597e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:32:31.604881 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ceca5f3c-e9c0-4cf2-b149-deb58e6a597e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:32:31.605324 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ceca5f3c-e9c0-4cf2-b149-deb58e6a597e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:32:31.629825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-ceca5f3c-e9c0-4cf2-b149-deb58e6a597e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] HTTP exception thrown: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ceca5f3c-e9c0-4cf2-b149-deb58e6a597e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Request method failure captured: Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b HTTP/1.1 Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwhZgP2lKPueRsocGvaeMq7ROSs_8wgYETfg7lnpeTphjU1mZBhgSWUCnPew9ATJxnZrdwROuYzDAxEYKfUoMY0z8OoM9keregwq9KJtQz6YeDH9JwkorofRQ47251yiOVRYTWxjeL63B-O49ANd9ZAyv-_JpV7cnuTmGDLsrRp3uM Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:32:31.632682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:32:31.634584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36a85f96959d48c5810ea0d38f65f22c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:32:31.634584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:32:31.634584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:32:31.634584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:32:31.634584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:32:31.634584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:32:31.634584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:32:31.634584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 1c86ce2899b6485da1517e3b5a1c64de Jul 21 22:32:31.634584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:32:31.634584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:32:31.634584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:32:31.634584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': '59867bfc-c5f4-4bd8-8b01-e3e622d5178b'} Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:32:31.635620 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:32:31.637392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:32:31.639256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ceca5f3c-e9c0-4cf2-b149-deb58e6a597e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Returning 404 to user: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:32:31.639256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ceca5f3c-e9c0-4cf2-b149-deb58e6a597e tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "DELETE /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 404 len: 111 microversion: 2.20 time: 0.054569 Jul 21 22:32:31.639256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1037/2196] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jul 21 22:32:31 2022] DELETE /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:32:31.645718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6eedac82-e334-450e-aebe-5aba33095639 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:32:31.646379 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6eedac82-e334-450e-aebe-5aba33095639 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 59867bfc-c5f4-4bd8-8b01-e3e622d5178b] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:32:31.648733 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:31.649384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:32:31.655540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6eedac82-e334-450e-aebe-5aba33095639 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:32:31.655992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6eedac82-e334-450e-aebe-5aba33095639 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:32:31.656768 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6eedac82-e334-450e-aebe-5aba33095639 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:32:31.657208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6eedac82-e334-450e-aebe-5aba33095639 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:32:31.674929 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-6eedac82-e334-450e-aebe-5aba33095639 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] HTTP exception thrown: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6eedac82-e334-450e-aebe-5aba33095639 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Request method failure captured: Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b HTTP/1.1 Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwhZgP2lKPueRsocGvaeMq7ROSs_8wgYETfg7lnpeTphjU1mZBhgSWUCnPew9ATJxnZrdwROuYzDAxEYKfUoMY0z8OoM9keregwq9KJtQz6YeDH9JwkorofRQ47251yiOVRYTWxjeL63B-O49ANd9ZAyv-_JpV7cnuTmGDLsrRp3uM Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:32:31.676523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:32:31.680726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36a85f96959d48c5810ea0d38f65f22c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:32:31.680726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:32:31.680726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:32:31.680726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:32:31.680726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:32:31.680726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:32:31.680726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:32:31.680726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 1c86ce2899b6485da1517e3b5a1c64de Jul 21 22:32:31.680726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:32:31.680726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:32:31.680726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:32:31.680726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '59867bfc-c5f4-4bd8-8b01-e3e622d5178b'} Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:32:31.682097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. Jul 21 22:32:31.684657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:32:31.686470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6eedac82-e334-450e-aebe-5aba33095639 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Returning 404 to user: Instance 59867bfc-c5f4-4bd8-8b01-e3e622d5178b could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:32:31.686470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6eedac82-e334-450e-aebe-5aba33095639 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b" status: 404 len: 111 microversion: 2.20 time: 0.037357 Jul 21 22:32:31.686470 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1160/2197] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:32:31 2022] GET /compute/v2.1/servers/59867bfc-c5f4-4bd8-8b01-e3e622d5178b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:32:38.590287 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:32:38.590887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:32:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:33:35.254090 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62186598-0719-47ae-9ec4-e5aa9f83c2b9] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 21 22:33:35.260166 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1452817546", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "networks": [{"uuid": "ceff7810-76a6-46bc-8ad4-81b09722a8db"}]}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:35.266991 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:35.267661 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:35.312135 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:35.312884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:35.317514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-894584ee-8ee8-40d4-9822-05d23beafd1e req-b620af1d-bcc8-4577-8fec-4afd05e54e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34275f2-dfb0-4cd8-bac0-3e182fcb2fca", "name": "network-vif-deleted", "tag": "67f04c76-8cac-4431-9345-83cef2ae8f77"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:35.327614 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-894584ee-8ee8-40d4-9822-05d23beafd1e req-b620af1d-bcc8-4577-8fec-4afd05e54e79 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:35.327614 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-894584ee-8ee8-40d4-9822-05d23beafd1e req-b620af1d-bcc8-4577-8fec-4afd05e54e79 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:35.341618 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-894584ee-8ee8-40d4-9822-05d23beafd1e req-b620af1d-bcc8-4577-8fec-4afd05e54e79 service nova] Creating event network-vif-deleted:67f04c76-8cac-4431-9345-83cef2ae8f77 for instance b34275f2-dfb0-4cd8-bac0-3e182fcb2fca on hv-cinder-82002 Jul 21 22:33:35.348904 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-894584ee-8ee8-40d4-9822-05d23beafd1e req-b620af1d-bcc8-4577-8fec-4afd05e54e79 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037873 Jul 21 22:33:35.349913 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1161/2198] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:33:35.352504 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] validate_networks() for [('ceff7810-76a6-46bc-8ad4-81b09722a8db', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:33:35.639897 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a2c715d9-36b4-4afd-a94f-1c56dc5f2246 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:35.641282 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a2c715d9-36b4-4afd-a94f-1c56dc5f2246 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:35.651802 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a2c715d9-36b4-4afd-a94f-1c56dc5f2246 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:35.652776 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a2c715d9-36b4-4afd-a94f-1c56dc5f2246 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:35.654032 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a2c715d9-36b4-4afd-a94f-1c56dc5f2246 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:35.654782 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a2c715d9-36b4-4afd-a94f-1c56dc5f2246 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:35.672016 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-a2c715d9-36b4-4afd-a94f-1c56dc5f2246 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] HTTP exception thrown: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a2c715d9-36b4-4afd-a94f-1c56dc5f2246 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Request method failure captured: Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: DELETE /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 HTTP/1.1 Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwhZgP2lKPueRsocGvaeMq7ROSs_8wgYETfg7lnpeTphjU1mZBhgSWUCnPew9ATJxnZrdwROuYzDAxEYKfUoMY0z8OoM9keregwq9KJtQz6YeDH9JwkorofRQ47251yiOVRYTWxjeL63B-O49ANd9ZAyv-_JpV7cnuTmGDLsrRp3uM Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:33:35.674063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:33:35.676891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36a85f96959d48c5810ea0d38f65f22c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:33:35.676891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:33:35.676891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:33:35.676891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:33:35.676891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:33:35.676891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:33:35.676891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:33:35.676891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 1c86ce2899b6485da1517e3b5a1c64de Jul 21 22:33:35.676891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:33:35.676891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:33:35.676891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:33:35.676891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '84e2efbe-11d4-4ecc-8825-11f420d36f03'} Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:33:35.677860 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:33:35.679741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:33:35.681501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a2c715d9-36b4-4afd-a94f-1c56dc5f2246 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Returning 404 to user: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:33:35.681501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a2c715d9-36b4-4afd-a94f-1c56dc5f2246 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "DELETE /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 404 len: 111 microversion: 2.20 time: 0.043410 Jul 21 22:33:35.681501 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1162/2199] 10.222.0.44 () {60 vars in 1279 bytes} [Thu Jul 21 22:33:35 2022] DELETE /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:33:35.689049 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7bdac174-f44b-4d7a-8ad2-dff4f5beaa08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:35.690006 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7bdac174-f44b-4d7a-8ad2-dff4f5beaa08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] [instance: 84e2efbe-11d4-4ecc-8825-11f420d36f03] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:35.697685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7bdac174-f44b-4d7a-8ad2-dff4f5beaa08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:35.698187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7bdac174-f44b-4d7a-8ad2-dff4f5beaa08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:35.698966 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7bdac174-f44b-4d7a-8ad2-dff4f5beaa08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:35.699960 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7bdac174-f44b-4d7a-8ad2-dff4f5beaa08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:35.714517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-7bdac174-f44b-4d7a-8ad2-dff4f5beaa08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] HTTP exception thrown: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7bdac174-f44b-4d7a-8ad2-dff4f5beaa08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Request method failure captured: Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 HTTP/1.1 Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwhZgP2lKPueRsocGvaeMq7ROSs_8wgYETfg7lnpeTphjU1mZBhgSWUCnPew9ATJxnZrdwROuYzDAxEYKfUoMY0z8OoM9keregwq9KJtQz6YeDH9JwkorofRQ47251yiOVRYTWxjeL63B-O49ANd9ZAyv-_JpV7cnuTmGDLsrRp3uM Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Openstack-Nova-Api-Version: 2.20 Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:33:35.716267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:33:35.726009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/36a85f96959d48c5810ea0d38f65f22c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_36a85f96959d48c5810ea0d38f65f22c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:33:35.726009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:33:35.726009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 36a85f96959d48c5810ea0d38f65f22c Jul 21 22:33:35.726009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1367342421 Jul 21 22:33:35.726009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:33:35.726009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:33:35.726009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:33:35.726009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 1c86ce2899b6485da1517e3b5a1c64de Jul 21 22:33:35.726009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1367342421-project Jul 21 22:33:35.726009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:33:35.726009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:33:35.726009 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '84e2efbe-11d4-4ecc-8825-11f420d36f03'} Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:33:35.727415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. Jul 21 22:33:35.729942 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:33:35.731601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7bdac174-f44b-4d7a-8ad2-dff4f5beaa08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] Returning 404 to user: Instance 84e2efbe-11d4-4ecc-8825-11f420d36f03 could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:33:35.731601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7bdac174-f44b-4d7a-8ad2-dff4f5beaa08 tempest-AttachVolumeShelveTestJSON-1367342421 tempest-AttachVolumeShelveTestJSON-1367342421-project] 10.222.0.44 "GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03" status: 404 len: 111 microversion: 2.20 time: 0.033506 Jul 21 22:33:35.731601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1163/2200] 10.222.0.44 () {60 vars in 1276 bytes} [Thu Jul 21 22:33:35 2022] GET /compute/v2.1/servers/84e2efbe-11d4-4ecc-8825-11f420d36f03 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 21 22:33:36.067029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:33:36.067607 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:33:36.068146 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:33:36.068624 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:33:36.069095 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:33:36.081234 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:36.082015 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:36.082876 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:36.083361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:36.104605 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Getting quotas for project fd46d5bdfd044627bcd71cd16b99649b. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:33:36.109291 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Getting quotas for user 17d33bb455874228bcc76644b24272de and project fd46d5bdfd044627bcd71cd16b99649b. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:33:36.126867 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:33:36.130849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:33:36.196060 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ff20641c-7bee-4c84-a560-9e16eaa1898b tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945091 Jul 21 22:33:36.196732 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1038/2201] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 22:33:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 22:33:36.213984 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-22317e5d-f22a-484c-86dc-dbb21c7653cf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:36.215617 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-22317e5d-f22a-484c-86dc-dbb21c7653cf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:36.345165 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-22317e5d-f22a-484c-86dc-dbb21c7653cf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:36.362153 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-22317e5d-f22a-484c-86dc-dbb21c7653cf tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1219 microversion: 2.1 time: 0.158247 Jul 21 22:33:36.364109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1164/2202] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:36 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1219 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:37.388735 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dbc9de3e-85ee-4a73-98c7-fd32887ae4e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:37.389791 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dbc9de3e-85ee-4a73-98c7-fd32887ae4e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:37.397744 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbc9de3e-85ee-4a73-98c7-fd32887ae4e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:37.398360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbc9de3e-85ee-4a73-98c7-fd32887ae4e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:37.399191 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbc9de3e-85ee-4a73-98c7-fd32887ae4e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:37.399523 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbc9de3e-85ee-4a73-98c7-fd32887ae4e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:37.406009 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] [62186598-0719-47ae-9ec4-e5aa9f83c2b9] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 36940. Jul 21 22:33:37.728669 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dbc9de3e-85ee-4a73-98c7-fd32887ae4e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:37.736575 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dbc9de3e-85ee-4a73-98c7-fd32887ae4e9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1223 microversion: 2.1 time: 0.355977 Jul 21 22:33:37.737145 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1039/2203] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:37 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1223 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:38.758532 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ee20de48-505e-4a29-b8c8-8b2a8f248f4c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:38.759564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ee20de48-505e-4a29-b8c8-8b2a8f248f4c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:38.773249 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ee20de48-505e-4a29-b8c8-8b2a8f248f4c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:38.774050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ee20de48-505e-4a29-b8c8-8b2a8f248f4c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:38.775449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ee20de48-505e-4a29-b8c8-8b2a8f248f4c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:38.776233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ee20de48-505e-4a29-b8c8-8b2a8f248f4c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:38.936161 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ee20de48-505e-4a29-b8c8-8b2a8f248f4c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:38.959746 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ee20de48-505e-4a29-b8c8-8b2a8f248f4c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1223 microversion: 2.1 time: 0.208032 Jul 21 22:33:38.960743 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1165/2204] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:38 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1223 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:39.986834 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-85584c36-1157-4945-8068-0c1a39c62dc3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:39.988115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-85584c36-1157-4945-8068-0c1a39c62dc3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:39.995053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-85584c36-1157-4945-8068-0c1a39c62dc3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:39.995509 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-85584c36-1157-4945-8068-0c1a39c62dc3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:39.996726 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-85584c36-1157-4945-8068-0c1a39c62dc3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:39.997459 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-85584c36-1157-4945-8068-0c1a39c62dc3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:40.082927 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-85584c36-1157-4945-8068-0c1a39c62dc3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:40.095211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-85584c36-1157-4945-8068-0c1a39c62dc3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1215 microversion: 2.1 time: 0.112953 Jul 21 22:33:40.095757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1040/2205] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:39 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1215 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:41.121682 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8abe0d7e-d587-4bec-8099-82fb0d208554 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:41.122279 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8abe0d7e-d587-4bec-8099-82fb0d208554 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:41.129827 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8abe0d7e-d587-4bec-8099-82fb0d208554 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:41.130430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8abe0d7e-d587-4bec-8099-82fb0d208554 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:41.131499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8abe0d7e-d587-4bec-8099-82fb0d208554 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:41.132060 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8abe0d7e-d587-4bec-8099-82fb0d208554 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:41.220521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8abe0d7e-d587-4bec-8099-82fb0d208554 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:41.230552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8abe0d7e-d587-4bec-8099-82fb0d208554 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1215 microversion: 2.1 time: 0.113140 Jul 21 22:33:41.231198 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1166/2206] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:41 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:42.258108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5021fd5b-cb8d-4b76-8740-e4c434e154c0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:42.263483 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5021fd5b-cb8d-4b76-8740-e4c434e154c0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:42.278527 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5021fd5b-cb8d-4b76-8740-e4c434e154c0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:42.284033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5021fd5b-cb8d-4b76-8740-e4c434e154c0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:42.284033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5021fd5b-cb8d-4b76-8740-e4c434e154c0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:42.284033 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5021fd5b-cb8d-4b76-8740-e4c434e154c0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:42.371439 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5021fd5b-cb8d-4b76-8740-e4c434e154c0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:42.380172 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5021fd5b-cb8d-4b76-8740-e4c434e154c0 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1277 microversion: 2.1 time: 0.129533 Jul 21 22:33:42.380759 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1041/2207] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:42 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:43.399477 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-01c88b09-6932-497e-8285-0b65fb32ae27 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:43.400849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-01c88b09-6932-497e-8285-0b65fb32ae27 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:43.412235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-01c88b09-6932-497e-8285-0b65fb32ae27 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:43.412954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-01c88b09-6932-497e-8285-0b65fb32ae27 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:43.414975 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-01c88b09-6932-497e-8285-0b65fb32ae27 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:43.416137 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-01c88b09-6932-497e-8285-0b65fb32ae27 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:43.682108 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-01c88b09-6932-497e-8285-0b65fb32ae27 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:43.698825 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-01c88b09-6932-497e-8285-0b65fb32ae27 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1319 microversion: 2.1 time: 0.304733 Jul 21 22:33:43.700805 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1167/2208] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:43 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:44.006038 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-a1fd7c6a-022e-4015-b0dc-a65e4ecd83e2 req-8f78e7d7-1d6f-4d31-a5b4-70df5196c919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb91553-be61-474e-8ed8-35274146101c", "tag": "d12a64b4-9da0-42fb-8966-01baa8484584"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:44.021885 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a1fd7c6a-022e-4015-b0dc-a65e4ecd83e2 req-8f78e7d7-1d6f-4d31-a5b4-70df5196c919 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:44.023055 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a1fd7c6a-022e-4015-b0dc-a65e4ecd83e2 req-8f78e7d7-1d6f-4d31-a5b4-70df5196c919 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:44.041809 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-a1fd7c6a-022e-4015-b0dc-a65e4ecd83e2 req-8f78e7d7-1d6f-4d31-a5b4-70df5196c919 service nova] Creating event network-changed:d12a64b4-9da0-42fb-8966-01baa8484584 for instance 5bb91553-be61-474e-8ed8-35274146101c on hv-cinder-82002 Jul 21 22:33:44.051937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-a1fd7c6a-022e-4015-b0dc-a65e4ecd83e2 req-8f78e7d7-1d6f-4d31-a5b4-70df5196c919 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051318 Jul 21 22:33:44.052937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1042/2209] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:33:44.720948 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a6990560-2482-4a4b-b9cc-df4b2ce445e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:44.722587 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a6990560-2482-4a4b-b9cc-df4b2ce445e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:44.734004 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a6990560-2482-4a4b-b9cc-df4b2ce445e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:44.734686 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a6990560-2482-4a4b-b9cc-df4b2ce445e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:44.736056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a6990560-2482-4a4b-b9cc-df4b2ce445e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:44.736983 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a6990560-2482-4a4b-b9cc-df4b2ce445e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:44.927984 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a6990560-2482-4a4b-b9cc-df4b2ce445e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:44.939915 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a6990560-2482-4a4b-b9cc-df4b2ce445e3 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1319 microversion: 2.1 time: 0.225922 Jul 21 22:33:44.945978 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1168/2210] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:44 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:45.972081 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e4260181-a2c2-4408-9a32-01d33f3efe8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:45.974381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e4260181-a2c2-4408-9a32-01d33f3efe8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:45.988308 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4260181-a2c2-4408-9a32-01d33f3efe8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:45.989329 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4260181-a2c2-4408-9a32-01d33f3efe8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:45.991176 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4260181-a2c2-4408-9a32-01d33f3efe8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:46.009283 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4260181-a2c2-4408-9a32-01d33f3efe8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:46.092686 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:46.118395 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:46.213938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e4260181-a2c2-4408-9a32-01d33f3efe8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:46.224546 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e4260181-a2c2-4408-9a32-01d33f3efe8e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1319 microversion: 2.1 time: 0.263348 Jul 21 22:33:46.225679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1043/2211] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:45 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:47.242261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-db6a4dd5-8dc0-4650-8b49-a2db1f23ce8c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:47.243822 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-db6a4dd5-8dc0-4650-8b49-a2db1f23ce8c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:47.246988 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:33:47.257112 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db6a4dd5-8dc0-4650-8b49-a2db1f23ce8c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:47.257965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db6a4dd5-8dc0-4650-8b49-a2db1f23ce8c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:47.259336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db6a4dd5-8dc0-4650-8b49-a2db1f23ce8c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:47.260140 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-db6a4dd5-8dc0-4650-8b49-a2db1f23ce8c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:47.473656 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-db6a4dd5-8dc0-4650-8b49-a2db1f23ce8c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:47.490015 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-db6a4dd5-8dc0-4650-8b49-a2db1f23ce8c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1319 microversion: 2.1 time: 0.251287 Jul 21 22:33:47.490798 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1169/2212] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:47 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:48.516846 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-95175b42-1fe2-428c-a385-9595e7490b4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:48.518842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-95175b42-1fe2-428c-a385-9595e7490b4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:48.527923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95175b42-1fe2-428c-a385-9595e7490b4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:48.528903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95175b42-1fe2-428c-a385-9595e7490b4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:48.530012 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95175b42-1fe2-428c-a385-9595e7490b4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:48.530656 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-95175b42-1fe2-428c-a385-9595e7490b4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:48.795552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-95175b42-1fe2-428c-a385-9595e7490b4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:48.805399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-95175b42-1fe2-428c-a385-9595e7490b4e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1319 microversion: 2.1 time: 0.294823 Jul 21 22:33:48.806252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1044/2213] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:48 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:49.269332 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:33:49.270014 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:33:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:33:49.782729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-6a447f1c-29ba-4bac-9491-9fc07b5b6812 req-96380295-1660-4c26-bd92-f8c171a10249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb91553-be61-474e-8ed8-35274146101c", "name": "network-vif-plugged", "status": "completed", "tag": "d12a64b4-9da0-42fb-8966-01baa8484584"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:49.797252 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-6a447f1c-29ba-4bac-9491-9fc07b5b6812 req-96380295-1660-4c26-bd92-f8c171a10249 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:49.798427 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-6a447f1c-29ba-4bac-9491-9fc07b5b6812 req-96380295-1660-4c26-bd92-f8c171a10249 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:49.822217 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-6a447f1c-29ba-4bac-9491-9fc07b5b6812 req-96380295-1660-4c26-bd92-f8c171a10249 service nova] Creating event network-vif-plugged:d12a64b4-9da0-42fb-8966-01baa8484584 for instance 5bb91553-be61-474e-8ed8-35274146101c on hv-cinder-82002 Jul 21 22:33:49.827860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7814de87-e47d-4936-aa65-cdee12aede00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:49.830216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7814de87-e47d-4936-aa65-cdee12aede00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:49.830677 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-6a447f1c-29ba-4bac-9491-9fc07b5b6812 req-96380295-1660-4c26-bd92-f8c171a10249 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.327403 Jul 21 22:33:49.832357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1170/2214] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:33:49.840358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7814de87-e47d-4936-aa65-cdee12aede00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:49.840964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7814de87-e47d-4936-aa65-cdee12aede00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:49.841869 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7814de87-e47d-4936-aa65-cdee12aede00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:49.842586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7814de87-e47d-4936-aa65-cdee12aede00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:50.126407 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7814de87-e47d-4936-aa65-cdee12aede00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:50.144167 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7814de87-e47d-4936-aa65-cdee12aede00 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1319 microversion: 2.1 time: 0.323580 Jul 21 22:33:50.146244 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1045/2215] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:49 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:51.162778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7936eaba-c670-470a-8f0c-a0997e2bd224 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:51.163762 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7936eaba-c670-470a-8f0c-a0997e2bd224 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:51.170485 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7936eaba-c670-470a-8f0c-a0997e2bd224 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:51.171271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7936eaba-c670-470a-8f0c-a0997e2bd224 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:51.172331 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7936eaba-c670-470a-8f0c-a0997e2bd224 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:51.172849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7936eaba-c670-470a-8f0c-a0997e2bd224 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:51.364292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7936eaba-c670-470a-8f0c-a0997e2bd224 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:51.372532 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7936eaba-c670-470a-8f0c-a0997e2bd224 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1319 microversion: 2.1 time: 0.214078 Jul 21 22:33:51.373741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1171/2216] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:51 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:52.395610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8cf7314c-795e-4566-a966-efe80432b4dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:52.396290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8cf7314c-795e-4566-a966-efe80432b4dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:52.403093 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8cf7314c-795e-4566-a966-efe80432b4dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:52.403543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8cf7314c-795e-4566-a966-efe80432b4dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:52.404312 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8cf7314c-795e-4566-a966-efe80432b4dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:52.404746 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8cf7314c-795e-4566-a966-efe80432b4dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:52.589540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8cf7314c-795e-4566-a966-efe80432b4dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:52.598508 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8cf7314c-795e-4566-a966-efe80432b4dd tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1319 microversion: 2.1 time: 0.207173 Jul 21 22:33:52.599129 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1046/2217] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:52 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:33:53.622130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bf1d1c0d-7903-46a8-875a-8b7ba9ecb314 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:53.622899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bf1d1c0d-7903-46a8-875a-8b7ba9ecb314 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:53.630075 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf1d1c0d-7903-46a8-875a-8b7ba9ecb314 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:53.630519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf1d1c0d-7903-46a8-875a-8b7ba9ecb314 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:53.631336 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf1d1c0d-7903-46a8-875a-8b7ba9ecb314 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:53.631780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf1d1c0d-7903-46a8-875a-8b7ba9ecb314 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:53.790216 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bf1d1c0d-7903-46a8-875a-8b7ba9ecb314 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:53.803213 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bf1d1c0d-7903-46a8-875a-8b7ba9ecb314 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1319 microversion: 2.1 time: 0.184941 Jul 21 22:33:53.804102 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1172/2218] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:53 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:54.821192 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-75334757-40a3-4684-be14-ee935a40750e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:54.822108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-75334757-40a3-4684-be14-ee935a40750e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:54.828529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-75334757-40a3-4684-be14-ee935a40750e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:54.829387 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-75334757-40a3-4684-be14-ee935a40750e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:54.830178 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-75334757-40a3-4684-be14-ee935a40750e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:54.830703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-75334757-40a3-4684-be14-ee935a40750e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:54.988251 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-75334757-40a3-4684-be14-ee935a40750e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:54.995937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-75334757-40a3-4684-be14-ee935a40750e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1319 microversion: 2.1 time: 0.178628 Jul 21 22:33:54.998234 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1047/2219] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:54 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:56.017484 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-04da29ab-0b29-4217-9891-2c2182a0d485 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:56.018695 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-04da29ab-0b29-4217-9891-2c2182a0d485 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:56.030951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04da29ab-0b29-4217-9891-2c2182a0d485 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:56.031639 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04da29ab-0b29-4217-9891-2c2182a0d485 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:56.032536 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04da29ab-0b29-4217-9891-2c2182a0d485 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:56.033064 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-04da29ab-0b29-4217-9891-2c2182a0d485 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:56.198460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-04da29ab-0b29-4217-9891-2c2182a0d485 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:56.212285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-04da29ab-0b29-4217-9891-2c2182a0d485 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1319 microversion: 2.1 time: 0.200144 Jul 21 22:33:56.212889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1173/2220] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:56 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:57.238097 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d6b1ae54-bf4f-4847-8fd8-d219dd158b24 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:33:57.238861 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d6b1ae54-bf4f-4847-8fd8-d219dd158b24 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:57.249311 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d6b1ae54-bf4f-4847-8fd8-d219dd158b24 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:57.249952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d6b1ae54-bf4f-4847-8fd8-d219dd158b24 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:57.251276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d6b1ae54-bf4f-4847-8fd8-d219dd158b24 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:57.251955 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d6b1ae54-bf4f-4847-8fd8-d219dd158b24 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:57.433011 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d6b1ae54-bf4f-4847-8fd8-d219dd158b24 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:33:57.443060 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d6b1ae54-bf4f-4847-8fd8-d219dd158b24 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1507 microversion: 2.1 time: 0.210392 Jul 21 22:33:57.443656 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1048/2221] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:33:57 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:33:57.463905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f57a994b-ec4a-4dcd-a491-efb8914107d9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a21d3586-c089-4f17-9d9e-9e3471f5ac15", "device": "/dev/sdb"}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:33:57.465124 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f57a994b-ec4a-4dcd-a491-efb8914107d9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:33:57.473473 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f57a994b-ec4a-4dcd-a491-efb8914107d9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:57.473925 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f57a994b-ec4a-4dcd-a491-efb8914107d9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:57.474753 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f57a994b-ec4a-4dcd-a491-efb8914107d9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:33:57.475271 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f57a994b-ec4a-4dcd-a491-efb8914107d9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:33:57.855551 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f57a994b-ec4a-4dcd-a491-efb8914107d9 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "POST /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.399702 Jul 21 22:33:57.856294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1174/2222] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 22:33:57 2022] POST /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:34:19.652949 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:34:19.654017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:34:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:34:22.633171 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:22.634253 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=58 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:22.640764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-191f072e-e66c-4786-8f84-bf4588731a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:22.640764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-191f072e-e66c-4786-8f84-bf4588731a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:22.649140 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-191f072e-e66c-4786-8f84-bf4588731a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:22.649600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-191f072e-e66c-4786-8f84-bf4588731a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:22.650381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-191f072e-e66c-4786-8f84-bf4588731a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:22.650817 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-191f072e-e66c-4786-8f84-bf4588731a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:22.750037 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-191f072e-e66c-4786-8f84-bf4588731a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lazy-loading 'services' on Instance uuid 5bb91553-be61-474e-8ed8-35274146101c {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:34:22.848711 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-191f072e-e66c-4786-8f84-bf4588731a6c tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c/os-volume_attachments/a21d3586-c089-4f17-9d9e-9e3471f5ac15" status: 202 len: 0 microversion: 2.1 time: 0.217087 Jul 21 22:34:22.849314 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1049/2223] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:34:22 2022] DELETE /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c/os-volume_attachments/a21d3586-c089-4f17-9d9e-9e3471f5ac15 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:34:37.818284 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dfda4144-dbb9-420a-899c-bbe5d3f8985e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:37.821400 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dfda4144-dbb9-420a-899c-bbe5d3f8985e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:37.832408 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=30 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:37.833701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:37.838452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dfda4144-dbb9-420a-899c-bbe5d3f8985e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:37.838902 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dfda4144-dbb9-420a-899c-bbe5d3f8985e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:37.840436 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dfda4144-dbb9-420a-899c-bbe5d3f8985e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:37.840888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-dfda4144-dbb9-420a-899c-bbe5d3f8985e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:37.878286 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dfda4144-dbb9-420a-899c-bbe5d3f8985e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Going to try to terminate instance {{(pid=117979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:34:37.987648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dfda4144-dbb9-420a-899c-bbe5d3f8985e tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 204 len: 0 microversion: 2.1 time: 0.178130 Jul 21 22:34:37.989967 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1175/2224] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:34:37 2022] DELETE /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:34:37.998815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:38.000695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:34:38.006829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b20ae58f-ccb6-4a01-8c1e-d28c4406742f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:38.007661 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b20ae58f-ccb6-4a01-8c1e-d28c4406742f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:38.018097 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b20ae58f-ccb6-4a01-8c1e-d28c4406742f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:38.018622 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b20ae58f-ccb6-4a01-8c1e-d28c4406742f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:38.019568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b20ae58f-ccb6-4a01-8c1e-d28c4406742f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:38.020077 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b20ae58f-ccb6-4a01-8c1e-d28c4406742f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:38.190450 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b20ae58f-ccb6-4a01-8c1e-d28c4406742f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:38.199050 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b20ae58f-ccb6-4a01-8c1e-d28c4406742f tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1513 microversion: 2.1 time: 0.202030 Jul 21 22:34:38.199934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1050/2225] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:37 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:39.217937 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-daa722ed-c558-438d-8d10-5399b97fcf88 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:39.218546 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-daa722ed-c558-438d-8d10-5399b97fcf88 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:39.225171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-daa722ed-c558-438d-8d10-5399b97fcf88 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:39.225621 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-daa722ed-c558-438d-8d10-5399b97fcf88 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:39.226398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-daa722ed-c558-438d-8d10-5399b97fcf88 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:39.226838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-daa722ed-c558-438d-8d10-5399b97fcf88 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:39.386241 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-daa722ed-c558-438d-8d10-5399b97fcf88 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:39.400393 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-daa722ed-c558-438d-8d10-5399b97fcf88 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1513 microversion: 2.1 time: 0.186611 Jul 21 22:34:39.401025 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1176/2226] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:39 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:40.418017 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dce0d50e-fcfe-4ed0-9e6a-47e074da7227 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:40.418665 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dce0d50e-fcfe-4ed0-9e6a-47e074da7227 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:40.427309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dce0d50e-fcfe-4ed0-9e6a-47e074da7227 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:40.428091 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dce0d50e-fcfe-4ed0-9e6a-47e074da7227 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:40.428933 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dce0d50e-fcfe-4ed0-9e6a-47e074da7227 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:40.429439 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dce0d50e-fcfe-4ed0-9e6a-47e074da7227 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:40.582768 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dce0d50e-fcfe-4ed0-9e6a-47e074da7227 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:40.591529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dce0d50e-fcfe-4ed0-9e6a-47e074da7227 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1513 microversion: 2.1 time: 0.177366 Jul 21 22:34:40.592120 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1051/2227] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:40 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:41.138567 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-2d4e7f52-5776-4b3e-a525-a7daad1b78e4 req-a3b1974e-49ba-425d-9b20-1163f1be4818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb91553-be61-474e-8ed8-35274146101c", "name": "network-vif-deleted", "tag": "d12a64b4-9da0-42fb-8966-01baa8484584"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:34:41.148147 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-2d4e7f52-5776-4b3e-a525-a7daad1b78e4 req-a3b1974e-49ba-425d-9b20-1163f1be4818 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:41.148593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-2d4e7f52-5776-4b3e-a525-a7daad1b78e4 req-a3b1974e-49ba-425d-9b20-1163f1be4818 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:41.161915 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-2d4e7f52-5776-4b3e-a525-a7daad1b78e4 req-a3b1974e-49ba-425d-9b20-1163f1be4818 service nova] Creating event network-vif-deleted:d12a64b4-9da0-42fb-8966-01baa8484584 for instance 5bb91553-be61-474e-8ed8-35274146101c on hv-cinder-82002 Jul 21 22:34:41.166969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-2d4e7f52-5776-4b3e-a525-a7daad1b78e4 req-a3b1974e-49ba-425d-9b20-1163f1be4818 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032091 Jul 21 22:34:41.168006 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1177/2228] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:34:41.613912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f37649a7-55b1-45df-80f3-c1a4bca33a22 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:41.614572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f37649a7-55b1-45df-80f3-c1a4bca33a22 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:41.621381 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f37649a7-55b1-45df-80f3-c1a4bca33a22 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:41.621839 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f37649a7-55b1-45df-80f3-c1a4bca33a22 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:41.622627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f37649a7-55b1-45df-80f3-c1a4bca33a22 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:41.623109 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f37649a7-55b1-45df-80f3-c1a4bca33a22 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:41.657627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f37649a7-55b1-45df-80f3-c1a4bca33a22 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:41.658091 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f37649a7-55b1-45df-80f3-c1a4bca33a22 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:41.658554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-f37649a7-55b1-45df-80f3-c1a4bca33a22 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lazy-loading 'fault' on Instance uuid 5bb91553-be61-474e-8ed8-35274146101c {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:34:41.708329 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f37649a7-55b1-45df-80f3-c1a4bca33a22 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d33bb455874228bcc76644b24272de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd46d5bdfd044627bcd71cd16b99649b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:34:41.717468 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f37649a7-55b1-45df-80f3-c1a4bca33a22 tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 200 len: 1309 microversion: 2.1 time: 0.107296 Jul 21 22:34:41.718080 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1052/2229] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:41 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:34:42.737333 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c2c7440a-8a08-4a63-a98d-21c25fd1eb0a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:34:42.738504 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c2c7440a-8a08-4a63-a98d-21c25fd1eb0a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] [instance: 5bb91553-be61-474e-8ed8-35274146101c] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:34:42.745321 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2c7440a-8a08-4a63-a98d-21c25fd1eb0a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:42.745771 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2c7440a-8a08-4a63-a98d-21c25fd1eb0a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:42.746548 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2c7440a-8a08-4a63-a98d-21c25fd1eb0a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:34:42.746982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2c7440a-8a08-4a63-a98d-21c25fd1eb0a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:34:42.761159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-c2c7440a-8a08-4a63-a98d-21c25fd1eb0a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] HTTP exception thrown: Instance 5bb91553-be61-474e-8ed8-35274146101c could not be found. Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c2c7440a-8a08-4a63-a98d-21c25fd1eb0a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Request method failure captured: Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c HTTP/1.1 Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cyyfh6OzSmSUrwRLZFLhgVmQoNJMml0oGVNixMorPt-hqraIXlaFCC5vjcaPfVaj-j8I9s2cQJh0zf2x5-fAV8ErGn8mmrGWv6Tb61L0FTcyD1Hew1PiITKJ47grW-glQXBviZ-OHHOuCR9Qb0zlqqY6UdO0BleJxusUbSMyntphvE Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:34:42.762828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:34:42.764816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fd46d5bdfd044627bcd71cd16b99649b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fd46d5bdfd044627bcd71cd16b99649b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:34:42.764816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:34:42.764816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: fd46d5bdfd044627bcd71cd16b99649b Jul 21 22:34:42.764816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1156487104 Jul 21 22:34:42.764816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:34:42.764816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:34:42.764816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:34:42.764816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 17d33bb455874228bcc76644b24272de Jul 21 22:34:42.764816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-VolumesSnapshotTestJSON-1156487104-project Jul 21 22:34:42.764816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:34:42.764816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 5bb91553-be61-474e-8ed8-35274146101c could not be found. Jul 21 22:34:42.764816 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '5bb91553-be61-474e-8ed8-35274146101c'} Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb91553-be61-474e-8ed8-35274146101c could not be found. Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:34:42.765987 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb91553-be61-474e-8ed8-35274146101c could not be found. Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb91553-be61-474e-8ed8-35274146101c could not be found. Jul 21 22:34:42.768072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:34:42.770071 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c2c7440a-8a08-4a63-a98d-21c25fd1eb0a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] Returning 404 to user: Instance 5bb91553-be61-474e-8ed8-35274146101c could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:34:42.770071 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c2c7440a-8a08-4a63-a98d-21c25fd1eb0a tempest-VolumesSnapshotTestJSON-1156487104 tempest-VolumesSnapshotTestJSON-1156487104-project] 10.222.0.44 "GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c" status: 404 len: 111 microversion: 2.1 time: 0.032856 Jul 21 22:34:42.770071 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1178/2230] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:34:42 2022] GET /compute/v2.1/servers/5bb91553-be61-474e-8ed8-35274146101c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:35:37.761344 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=8 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:37.762597 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=20 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:35:38.051664 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ca24f616-285e-4b12-9b44-32e55ad63b65 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Action: 'create', calling method: .version_select at 0x7faca1e4d160>, body: {"keypair": {"name": "tempest-TestShelveInstance-1341804417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1tKCnSniQ+rPD0ymuayC758U28p7tV9Q6wdV+N0c1GC0Om4xIuGxkx0pcl26MwNWiPeiFx1IMZsQkwDsuldp8hl5oxA3zkSTUtzIRk8CgI34AGC8lSIV+slR8r13FWsg=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:35:38.067823 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-ca24f616-285e-4b12-9b44-32e55ad63b65 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Getting quotas for project fe61021aacab4c0483f71c26b4955960. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:35:38.072378 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-ca24f616-285e-4b12-9b44-32e55ad63b65 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Getting quotas for user 15235d71dee14765aeab75e8f487169b and project fe61021aacab4c0483f71c26b4955960. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:35:38.086025 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ca24f616-285e-4b12-9b44-32e55ad63b65 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [3bce68d4-e69f-4ed8-9e06-d9decf9993c6] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 22:35:39.093740 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [None req-ca24f616-285e-4b12-9b44-32e55ad63b65 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [3bce68d4-e69f-4ed8-9e06-d9decf9993c6] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 39138. Jul 21 22:35:39.109507 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ca24f616-285e-4b12-9b44-32e55ad63b65 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.353116 Jul 21 22:35:39.110309 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1053/2231] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 22:35:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:35:58.600068 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:35:58.600879 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:35:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:36:15.778531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:15.779895 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:15.784714 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1781860790", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1341804417", "security_groups": [{"name": "tempest-secgroup-smoke-2066097826"}], "networks": [{"uuid": "b9615b32-4820-41ff-b95d-731203234ef5"}], "block_device_mapping_v2": [{"uuid": "1a22692f-1eee-4a41-9f85-755004cb8264", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:15.932452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.network.neutron [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] validate_networks() for [('b9615b32-4820-41ff-b95d-731203234ef5', None, None, None, None, None)] {{(pid=117979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:36:16.599433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Flavor limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:36:16.600206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Image limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:36:16.600772 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Flavor pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:36:16.601496 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Image pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:36:16.601992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:36:16.614401 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:16.614867 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:16.616552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:16.616552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:16.635641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Getting quotas for project fe61021aacab4c0483f71c26b4955960. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:36:16.641022 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Getting quotas for user 15235d71dee14765aeab75e8f487169b and project fe61021aacab4c0483f71c26b4955960. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:36:16.713741 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Going to run 1 instances... {{(pid=117979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:36:16.717122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a22692f-1eee-4a41-9f85-755004cb8264',volume_size=None,volume_type=None)] {{(pid=117979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:36:16.881310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ae59a989-8847-4f39-965d-65bdad2e8ce7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.105003 Jul 21 22:36:16.882306 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1179/2232] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 22:36:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:36:16.895569 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e19661ce-1fee-4cd3-a830-bccbc8186f4c tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:16.896702 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e19661ce-1fee-4cd3-a830-bccbc8186f4c tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:16.901432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:16.904108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:16.986303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e19661ce-1fee-4cd3-a830-bccbc8186f4c tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:16.999757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e19661ce-1fee-4cd3-a830-bccbc8186f4c tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1089 microversion: 2.1 time: 0.110141 Jul 21 22:36:17.000570 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1054/2233] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:16 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1089 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:18.029433 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-4e33d3b4-a751-48b4-846a-35c3721faaaf tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:18.030979 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-4e33d3b4-a751-48b4-846a-35c3721faaaf tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:18.037774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4e33d3b4-a751-48b4-846a-35c3721faaaf tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:18.038513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4e33d3b4-a751-48b4-846a-35c3721faaaf tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:18.038994 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4e33d3b4-a751-48b4-846a-35c3721faaaf tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:18.039462 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-4e33d3b4-a751-48b4-846a-35c3721faaaf tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:18.339103 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-4e33d3b4-a751-48b4-846a-35c3721faaaf tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:18.354464 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-4e33d3b4-a751-48b4-846a-35c3721faaaf tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1187 microversion: 2.1 time: 0.330194 Jul 21 22:36:18.361235 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1180/2234] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:18 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1187 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:19.382097 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-657856ad-f6a5-4879-9c6c-bf95df48fde3 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:19.383691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-657856ad-f6a5-4879-9c6c-bf95df48fde3 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:19.396586 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-657856ad-f6a5-4879-9c6c-bf95df48fde3 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:19.397474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-657856ad-f6a5-4879-9c6c-bf95df48fde3 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:19.398823 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-657856ad-f6a5-4879-9c6c-bf95df48fde3 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:19.399820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-657856ad-f6a5-4879-9c6c-bf95df48fde3 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:19.581497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-657856ad-f6a5-4879-9c6c-bf95df48fde3 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:19.589893 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-657856ad-f6a5-4879-9c6c-bf95df48fde3 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.218037 Jul 21 22:36:19.590481 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1055/2235] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:19 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:20.350993 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-c4ce16bb-1897-4a64-a510-b57a10ed54e9 req-55c6128b-132f-45e9-afe0-d8f182d956fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1916df-b8fd-41d0-9cbc-58bacf7829a8", "tag": "3b993736-2118-44f5-8d06-3196623a542e"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:20.366196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-c4ce16bb-1897-4a64-a510-b57a10ed54e9 req-55c6128b-132f-45e9-afe0-d8f182d956fd service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:20.367354 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-c4ce16bb-1897-4a64-a510-b57a10ed54e9 req-55c6128b-132f-45e9-afe0-d8f182d956fd service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:20.385223 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-c4ce16bb-1897-4a64-a510-b57a10ed54e9 req-55c6128b-132f-45e9-afe0-d8f182d956fd service nova] Creating event network-changed:3b993736-2118-44f5-8d06-3196623a542e for instance 4e1916df-b8fd-41d0-9cbc-58bacf7829a8 on hv-cinder-82002 Jul 21 22:36:20.393562 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-c4ce16bb-1897-4a64-a510-b57a10ed54e9 req-55c6128b-132f-45e9-afe0-d8f182d956fd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049887 Jul 21 22:36:20.394620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1181/2236] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:36:20.607911 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fab50d12-ca87-446c-9713-b6280ed53f0f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:20.609382 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fab50d12-ca87-446c-9713-b6280ed53f0f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:20.617074 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fab50d12-ca87-446c-9713-b6280ed53f0f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:20.617525 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fab50d12-ca87-446c-9713-b6280ed53f0f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:20.618318 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fab50d12-ca87-446c-9713-b6280ed53f0f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:20.618963 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fab50d12-ca87-446c-9713-b6280ed53f0f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:20.821693 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fab50d12-ca87-446c-9713-b6280ed53f0f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:20.830280 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fab50d12-ca87-446c-9713-b6280ed53f0f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.226941 Jul 21 22:36:20.831045 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1056/2237] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:20 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:21.847755 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-401b4740-6667-4efc-a8c4-b97a9394fb87 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:21.848291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-401b4740-6667-4efc-a8c4-b97a9394fb87 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:21.855766 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-401b4740-6667-4efc-a8c4-b97a9394fb87 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:21.856215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-401b4740-6667-4efc-a8c4-b97a9394fb87 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:21.856985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-401b4740-6667-4efc-a8c4-b97a9394fb87 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:21.857750 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-401b4740-6667-4efc-a8c4-b97a9394fb87 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:22.077327 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-401b4740-6667-4efc-a8c4-b97a9394fb87 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:22.085756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-401b4740-6667-4efc-a8c4-b97a9394fb87 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.242250 Jul 21 22:36:22.096938 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1182/2238] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:21 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:23.105382 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a2be53ce-3a18-47f8-b64b-3b9bf0fcb387 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:23.106233 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a2be53ce-3a18-47f8-b64b-3b9bf0fcb387 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:23.113399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a2be53ce-3a18-47f8-b64b-3b9bf0fcb387 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:23.113850 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a2be53ce-3a18-47f8-b64b-3b9bf0fcb387 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:23.114678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a2be53ce-3a18-47f8-b64b-3b9bf0fcb387 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:23.115164 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a2be53ce-3a18-47f8-b64b-3b9bf0fcb387 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:23.252779 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a2be53ce-3a18-47f8-b64b-3b9bf0fcb387 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:23.256421 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-449497833", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452"}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:23.261157 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a2be53ce-3a18-47f8-b64b-3b9bf0fcb387 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.160150 Jul 21 22:36:23.261703 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1057/2239] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:23 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:23.315204 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.network.neutron [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] validate_networks() for None {{(pid=117979) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:36:23.602962 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Flavor limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:36:23.603407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Image limits 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:36:23.603879 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Flavor pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:36:23.604286 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Image pref 0:0:0 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:36:23.605316 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.virt.hardware [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117979) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:36:23.618614 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:23.619455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:23.621571 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:23.622175 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:23.639395 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Getting quotas for project 6470e7bfe9ac4a80b7f18ba009dcfdf9. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:36:23.643380 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Getting quotas for user f6243309b58d420789350d8f935b7207 and project 6470e7bfe9ac4a80b7f18ba009dcfdf9. Resources: {'ram', 'cores', 'instances'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:36:23.660380 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Going to run 1 instances... {{(pid=117979) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:36:23.662653 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117979) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:36:23.706131 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-addf823a-af36-4173-a04e-34ff77aff371 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.453477 Jul 21 22:36:23.706776 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1183/2240] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 22:36:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 21 22:36:23.717043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b94c654d-4819-4fb7-8e40-fa36a65cc0dc tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:23.717701 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b94c654d-4819-4fb7-8e40-fa36a65cc0dc tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:23.777051 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b94c654d-4819-4fb7-8e40-fa36a65cc0dc tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:23.785250 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b94c654d-4819-4fb7-8e40-fa36a65cc0dc tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1214 microversion: 2.1 time: 0.072170 Jul 21 22:36:23.786151 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1058/2241] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:23 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:24.278643 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-75f1617b-cfd4-4d49-864b-c68db7665d2b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:24.279299 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-75f1617b-cfd4-4d49-864b-c68db7665d2b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:24.287505 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-75f1617b-cfd4-4d49-864b-c68db7665d2b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.287969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-75f1617b-cfd4-4d49-864b-c68db7665d2b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.288752 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-75f1617b-cfd4-4d49-864b-c68db7665d2b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.289196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-75f1617b-cfd4-4d49-864b-c68db7665d2b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.427742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-75f1617b-cfd4-4d49-864b-c68db7665d2b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:24.435967 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-75f1617b-cfd4-4d49-864b-c68db7665d2b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.162002 Jul 21 22:36:24.436538 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1184/2242] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:24 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:24.804519 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-93d72aec-318d-4275-97b5-a279bdb56ef1 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:24.804519 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-93d72aec-318d-4275-97b5-a279bdb56ef1 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:24.810373 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93d72aec-318d-4275-97b5-a279bdb56ef1 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.810843 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93d72aec-318d-4275-97b5-a279bdb56ef1 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.812528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93d72aec-318d-4275-97b5-a279bdb56ef1 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:24.812528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-93d72aec-318d-4275-97b5-a279bdb56ef1 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:24.883773 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-93d72aec-318d-4275-97b5-a279bdb56ef1 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:24.892068 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-93d72aec-318d-4275-97b5-a279bdb56ef1 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1284 microversion: 2.1 time: 0.094113 Jul 21 22:36:24.892772 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1059/2243] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:24 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:25.455114 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b47b4ab5-32b5-4048-bde8-8f402a7064c5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:25.456388 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b47b4ab5-32b5-4048-bde8-8f402a7064c5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:25.463540 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b47b4ab5-32b5-4048-bde8-8f402a7064c5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:25.464514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b47b4ab5-32b5-4048-bde8-8f402a7064c5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:25.465553 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b47b4ab5-32b5-4048-bde8-8f402a7064c5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:25.466191 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b47b4ab5-32b5-4048-bde8-8f402a7064c5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:25.611372 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b47b4ab5-32b5-4048-bde8-8f402a7064c5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:25.618740 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b47b4ab5-32b5-4048-bde8-8f402a7064c5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.167985 Jul 21 22:36:25.619386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1185/2244] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:25 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:25.909294 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1206019b-6b59-4111-8f6e-f13ff2db371b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:25.909861 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1206019b-6b59-4111-8f6e-f13ff2db371b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:25.916716 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1206019b-6b59-4111-8f6e-f13ff2db371b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:25.917200 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1206019b-6b59-4111-8f6e-f13ff2db371b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:25.917979 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1206019b-6b59-4111-8f6e-f13ff2db371b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:25.918404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1206019b-6b59-4111-8f6e-f13ff2db371b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:26.054553 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1206019b-6b59-4111-8f6e-f13ff2db371b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:26.062892 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1206019b-6b59-4111-8f6e-f13ff2db371b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1314 microversion: 2.1 time: 0.157482 Jul 21 22:36:26.064122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1060/2245] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:25 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:26.417401 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-7cdf0822-90e7-4270-8945-73bbf1be3333 req-85e7aafa-9977-4862-b10c-405e8334a899 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a1810c-fa8d-49ff-8589-caa16b02ffe6", "tag": "c3de465d-f682-46c3-8139-e64b9db20044"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:26.430090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-7cdf0822-90e7-4270-8945-73bbf1be3333 req-85e7aafa-9977-4862-b10c-405e8334a899 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:26.430899 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-7cdf0822-90e7-4270-8945-73bbf1be3333 req-85e7aafa-9977-4862-b10c-405e8334a899 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:26.453035 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-7cdf0822-90e7-4270-8945-73bbf1be3333 req-85e7aafa-9977-4862-b10c-405e8334a899 service nova] Creating event network-changed:c3de465d-f682-46c3-8139-e64b9db20044 for instance 61a1810c-fa8d-49ff-8589-caa16b02ffe6 on hv-cinder-82002 Jul 21 22:36:26.459886 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-7cdf0822-90e7-4270-8945-73bbf1be3333 req-85e7aafa-9977-4862-b10c-405e8334a899 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046374 Jul 21 22:36:26.460643 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1186/2246] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:26.635964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9c8f009b-53c5-4457-bc97-9f34875f0cf5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:26.636622 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9c8f009b-53c5-4457-bc97-9f34875f0cf5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:26.642709 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9c8f009b-53c5-4457-bc97-9f34875f0cf5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:26.643190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9c8f009b-53c5-4457-bc97-9f34875f0cf5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:26.643962 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9c8f009b-53c5-4457-bc97-9f34875f0cf5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:26.644406 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9c8f009b-53c5-4457-bc97-9f34875f0cf5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:26.784763 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9c8f009b-53c5-4457-bc97-9f34875f0cf5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:26.793002 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9c8f009b-53c5-4457-bc97-9f34875f0cf5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.160800 Jul 21 22:36:26.793589 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1061/2247] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:26 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:27.081163 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-66436bd1-dc74-4c25-ab36-3db5b8527fdd tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:27.081868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-66436bd1-dc74-4c25-ab36-3db5b8527fdd tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:27.088544 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66436bd1-dc74-4c25-ab36-3db5b8527fdd tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:27.089017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66436bd1-dc74-4c25-ab36-3db5b8527fdd tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:27.089813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66436bd1-dc74-4c25-ab36-3db5b8527fdd tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:27.090304 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-66436bd1-dc74-4c25-ab36-3db5b8527fdd tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:27.237950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-66436bd1-dc74-4c25-ab36-3db5b8527fdd tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:27.246854 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-66436bd1-dc74-4c25-ab36-3db5b8527fdd tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1314 microversion: 2.1 time: 0.170306 Jul 21 22:36:27.247466 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1187/2248] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:27 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:27.810653 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-43724936-f2c0-4840-b203-dd10090df43e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:27.811466 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-43724936-f2c0-4840-b203-dd10090df43e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:27.818943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43724936-f2c0-4840-b203-dd10090df43e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:27.819429 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43724936-f2c0-4840-b203-dd10090df43e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:27.820223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43724936-f2c0-4840-b203-dd10090df43e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:27.820659 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43724936-f2c0-4840-b203-dd10090df43e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:27.952965 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-43724936-f2c0-4840-b203-dd10090df43e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:27.962098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-43724936-f2c0-4840-b203-dd10090df43e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.155767 Jul 21 22:36:27.963103 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1062/2249] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:27 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:28.264486 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f836e0f5-ed9f-4ea2-9401-9a6d3093f55b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:28.265094 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f836e0f5-ed9f-4ea2-9401-9a6d3093f55b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:28.271652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f836e0f5-ed9f-4ea2-9401-9a6d3093f55b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:28.272142 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f836e0f5-ed9f-4ea2-9401-9a6d3093f55b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:28.272926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f836e0f5-ed9f-4ea2-9401-9a6d3093f55b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:28.273569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f836e0f5-ed9f-4ea2-9401-9a6d3093f55b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:28.410122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f836e0f5-ed9f-4ea2-9401-9a6d3093f55b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:28.417818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f836e0f5-ed9f-4ea2-9401-9a6d3093f55b tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1314 microversion: 2.1 time: 0.157698 Jul 21 22:36:28.418384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1188/2250] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:28 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:28.978686 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-98e22a54-c1b7-4a34-b3ae-efa462e4bd00 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:28.979816 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-98e22a54-c1b7-4a34-b3ae-efa462e4bd00 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:28.986289 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-98e22a54-c1b7-4a34-b3ae-efa462e4bd00 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:28.986741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-98e22a54-c1b7-4a34-b3ae-efa462e4bd00 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:28.987524 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-98e22a54-c1b7-4a34-b3ae-efa462e4bd00 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:28.987959 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-98e22a54-c1b7-4a34-b3ae-efa462e4bd00 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:29.126271 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-98e22a54-c1b7-4a34-b3ae-efa462e4bd00 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:29.133804 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-98e22a54-c1b7-4a34-b3ae-efa462e4bd00 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.159070 Jul 21 22:36:29.134386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1063/2251] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:28 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:29.433800 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d2ee85b2-ff30-49dd-9787-15e5b1692a6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:29.434626 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d2ee85b2-ff30-49dd-9787-15e5b1692a6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:29.441910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d2ee85b2-ff30-49dd-9787-15e5b1692a6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:29.442423 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d2ee85b2-ff30-49dd-9787-15e5b1692a6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:29.443419 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d2ee85b2-ff30-49dd-9787-15e5b1692a6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:29.443905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d2ee85b2-ff30-49dd-9787-15e5b1692a6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:29.578673 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d2ee85b2-ff30-49dd-9787-15e5b1692a6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:29.586877 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d2ee85b2-ff30-49dd-9787-15e5b1692a6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1314 microversion: 2.1 time: 0.156835 Jul 21 22:36:29.587469 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1189/2252] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:29 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:30.150466 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c4ac3c21-58ad-434b-a195-4dd50780c61d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:30.151611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c4ac3c21-58ad-434b-a195-4dd50780c61d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:30.158187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4ac3c21-58ad-434b-a195-4dd50780c61d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:30.158637 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4ac3c21-58ad-434b-a195-4dd50780c61d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:30.159432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4ac3c21-58ad-434b-a195-4dd50780c61d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:30.159869 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4ac3c21-58ad-434b-a195-4dd50780c61d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:30.306530 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c4ac3c21-58ad-434b-a195-4dd50780c61d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:30.316745 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c4ac3c21-58ad-434b-a195-4dd50780c61d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.170620 Jul 21 22:36:30.317334 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1064/2253] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:30 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:30.604794 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7ca4ac99-1909-4ffb-b13d-cc37eadcf54d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:30.605430 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7ca4ac99-1909-4ffb-b13d-cc37eadcf54d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:30.611896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ca4ac99-1909-4ffb-b13d-cc37eadcf54d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:30.612346 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ca4ac99-1909-4ffb-b13d-cc37eadcf54d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:30.613108 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ca4ac99-1909-4ffb-b13d-cc37eadcf54d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:30.613576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7ca4ac99-1909-4ffb-b13d-cc37eadcf54d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:30.750789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7ca4ac99-1909-4ffb-b13d-cc37eadcf54d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:30.758361 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7ca4ac99-1909-4ffb-b13d-cc37eadcf54d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1314 microversion: 2.1 time: 0.157740 Jul 21 22:36:30.758935 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1190/2254] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:30 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:31.333781 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0d1c8d16-07b9-49ec-8346-b0756b9fd6f6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:31.334370 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0d1c8d16-07b9-49ec-8346-b0756b9fd6f6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:31.341361 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d1c8d16-07b9-49ec-8346-b0756b9fd6f6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:31.341819 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d1c8d16-07b9-49ec-8346-b0756b9fd6f6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:31.342587 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d1c8d16-07b9-49ec-8346-b0756b9fd6f6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:31.343054 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d1c8d16-07b9-49ec-8346-b0756b9fd6f6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:31.478138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0d1c8d16-07b9-49ec-8346-b0756b9fd6f6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:31.487160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0d1c8d16-07b9-49ec-8346-b0756b9fd6f6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.157132 Jul 21 22:36:31.489072 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1065/2255] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:31 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:31.775026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-487e47ef-d785-4139-9c77-8c48ebafd13a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:31.775682 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-487e47ef-d785-4139-9c77-8c48ebafd13a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:31.782849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-487e47ef-d785-4139-9c77-8c48ebafd13a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:31.783324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-487e47ef-d785-4139-9c77-8c48ebafd13a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:31.784097 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-487e47ef-d785-4139-9c77-8c48ebafd13a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:31.784529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-487e47ef-d785-4139-9c77-8c48ebafd13a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:31.916467 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-487e47ef-d785-4139-9c77-8c48ebafd13a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:31.923850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-487e47ef-d785-4139-9c77-8c48ebafd13a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1314 microversion: 2.1 time: 0.152935 Jul 21 22:36:31.924431 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1191/2256] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:31 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:32.504133 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f6ed4d5d-d68b-456f-8e30-1743ed8f73e1 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:32.504757 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f6ed4d5d-d68b-456f-8e30-1743ed8f73e1 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:32.511493 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f6ed4d5d-d68b-456f-8e30-1743ed8f73e1 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:32.511947 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f6ed4d5d-d68b-456f-8e30-1743ed8f73e1 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:32.512716 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f6ed4d5d-d68b-456f-8e30-1743ed8f73e1 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:32.514806 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f6ed4d5d-d68b-456f-8e30-1743ed8f73e1 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:32.648717 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f6ed4d5d-d68b-456f-8e30-1743ed8f73e1 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:32.656673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f6ed4d5d-d68b-456f-8e30-1743ed8f73e1 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.157052 Jul 21 22:36:32.657261 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1066/2257] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:32 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:32.940554 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-81a1ca1d-7fd3-4c46-83c7-4f5c1d579759 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:32.941429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-81a1ca1d-7fd3-4c46-83c7-4f5c1d579759 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:32.948644 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81a1ca1d-7fd3-4c46-83c7-4f5c1d579759 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:32.948895 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81a1ca1d-7fd3-4c46-83c7-4f5c1d579759 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:32.949612 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81a1ca1d-7fd3-4c46-83c7-4f5c1d579759 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:32.950068 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-81a1ca1d-7fd3-4c46-83c7-4f5c1d579759 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:33.031285 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-f5ce1fad-e57b-463b-ba0c-34ff28005f7f req-47d57e73-b55b-4de8-9ae3-1b22c41ca214 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1916df-b8fd-41d0-9cbc-58bacf7829a8", "name": "network-vif-plugged", "status": "completed", "tag": "3b993736-2118-44f5-8d06-3196623a542e"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:33.045143 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f5ce1fad-e57b-463b-ba0c-34ff28005f7f req-47d57e73-b55b-4de8-9ae3-1b22c41ca214 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:33.046021 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f5ce1fad-e57b-463b-ba0c-34ff28005f7f req-47d57e73-b55b-4de8-9ae3-1b22c41ca214 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:33.067897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-f5ce1fad-e57b-463b-ba0c-34ff28005f7f req-47d57e73-b55b-4de8-9ae3-1b22c41ca214 service nova] Creating event network-vif-plugged:3b993736-2118-44f5-8d06-3196623a542e for instance 4e1916df-b8fd-41d0-9cbc-58bacf7829a8 on hv-cinder-82002 Jul 21 22:36:33.071747 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR oslo.messaging._drivers.impl_rabbit [req-f5ce1fad-e57b-463b-ba0c-34ff28005f7f req-47d57e73-b55b-4de8-9ae3-1b22c41ca214 service nova] [b1ffc7d7-0ead-4c66-babe-6bd07f51a5d4] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 22:36:33.134319 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-81a1ca1d-7fd3-4c46-83c7-4f5c1d579759 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:33.142791 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-81a1ca1d-7fd3-4c46-83c7-4f5c1d579759 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1314 microversion: 2.1 time: 0.206298 Jul 21 22:36:33.143415 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1192/2258] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:32 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:33.672790 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ed75828f-6540-4e65-b06e-2d0a6e243719 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:33.673405 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ed75828f-6540-4e65-b06e-2d0a6e243719 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:33.675404 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=4 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:33.676100 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=12 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:33.681927 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ed75828f-6540-4e65-b06e-2d0a6e243719 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:33.682910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ed75828f-6540-4e65-b06e-2d0a6e243719 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:33.683707 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ed75828f-6540-4e65-b06e-2d0a6e243719 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:33.684153 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ed75828f-6540-4e65-b06e-2d0a6e243719 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:33.782107 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:33.818523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ed75828f-6540-4e65-b06e-2d0a6e243719 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:33.826919 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ed75828f-6540-4e65-b06e-2d0a6e243719 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.157881 Jul 21 22:36:33.827514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1193/2259] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:33 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:34.080881 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [req-f5ce1fad-e57b-463b-ba0c-34ff28005f7f req-47d57e73-b55b-4de8-9ae3-1b22c41ca214 service nova] [b1ffc7d7-0ead-4c66-babe-6bd07f51a5d4] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 39942. Jul 21 22:36:34.084446 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-f5ce1fad-e57b-463b-ba0c-34ff28005f7f req-47d57e73-b55b-4de8-9ae3-1b22c41ca214 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.058680 Jul 21 22:36:34.085063 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1067/2260] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:34.161757 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f15546dd-1da6-4194-99f6-822be6f8000c tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:34.162466 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f15546dd-1da6-4194-99f6-822be6f8000c tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:34.170058 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f15546dd-1da6-4194-99f6-822be6f8000c tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:34.170594 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f15546dd-1da6-4194-99f6-822be6f8000c tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:34.171454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f15546dd-1da6-4194-99f6-822be6f8000c tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:34.171895 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f15546dd-1da6-4194-99f6-822be6f8000c tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:34.315133 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f15546dd-1da6-4194-99f6-822be6f8000c tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:34.322705 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f15546dd-1da6-4194-99f6-822be6f8000c tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1314 microversion: 2.1 time: 0.166041 Jul 21 22:36:34.323420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1194/2261] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:34 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:34.843901 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-555febf3-f495-4dec-b4a7-e653457a7634 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:34.844601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-555febf3-f495-4dec-b4a7-e653457a7634 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:34.850971 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-555febf3-f495-4dec-b4a7-e653457a7634 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:34.851681 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-555febf3-f495-4dec-b4a7-e653457a7634 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:34.852207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-555febf3-f495-4dec-b4a7-e653457a7634 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:34.852638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-555febf3-f495-4dec-b4a7-e653457a7634 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:34.996039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-555febf3-f495-4dec-b4a7-e653457a7634 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:35.003685 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-555febf3-f495-4dec-b4a7-e653457a7634 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1261 microversion: 2.1 time: 0.164419 Jul 21 22:36:35.004269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1068/2262] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:34 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:35.340397 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-52d8f9b9-3405-4499-b6d3-5475228afc8a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:35.341026 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-52d8f9b9-3405-4499-b6d3-5475228afc8a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:35.347460 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-52d8f9b9-3405-4499-b6d3-5475228afc8a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:35.347908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-52d8f9b9-3405-4499-b6d3-5475228afc8a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:35.348667 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-52d8f9b9-3405-4499-b6d3-5475228afc8a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:35.349129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-52d8f9b9-3405-4499-b6d3-5475228afc8a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:35.482740 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-52d8f9b9-3405-4499-b6d3-5475228afc8a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:35.490257 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-52d8f9b9-3405-4499-b6d3-5475228afc8a tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1314 microversion: 2.1 time: 0.154556 Jul 21 22:36:35.490813 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1195/2263] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:35 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:36.020843 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c6f9f4c0-cb1f-4dc8-87d6-1f19bbc6cc5d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:36.021391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c6f9f4c0-cb1f-4dc8-87d6-1f19bbc6cc5d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:36.028334 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c6f9f4c0-cb1f-4dc8-87d6-1f19bbc6cc5d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.028776 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c6f9f4c0-cb1f-4dc8-87d6-1f19bbc6cc5d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:36.029534 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c6f9f4c0-cb1f-4dc8-87d6-1f19bbc6cc5d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.029977 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c6f9f4c0-cb1f-4dc8-87d6-1f19bbc6cc5d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:36.099522 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-804ea55d-019a-4cd0-aaca-8ce18f444f7d req-fdfd14fc-67e7-4226-8133-c2522123b700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a1810c-fa8d-49ff-8589-caa16b02ffe6", "name": "network-vif-plugged", "status": "completed", "tag": "c3de465d-f682-46c3-8139-e64b9db20044"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:36.108132 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-804ea55d-019a-4cd0-aaca-8ce18f444f7d req-fdfd14fc-67e7-4226-8133-c2522123b700 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.108575 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-804ea55d-019a-4cd0-aaca-8ce18f444f7d req-fdfd14fc-67e7-4226-8133-c2522123b700 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:36.120233 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-804ea55d-019a-4cd0-aaca-8ce18f444f7d req-fdfd14fc-67e7-4226-8133-c2522123b700 service nova] Creating event network-vif-plugged:c3de465d-f682-46c3-8139-e64b9db20044 for instance 61a1810c-fa8d-49ff-8589-caa16b02ffe6 on hv-cinder-82002 Jul 21 22:36:36.125379 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-804ea55d-019a-4cd0-aaca-8ce18f444f7d req-fdfd14fc-67e7-4226-8133-c2522123b700 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029500 Jul 21 22:36:36.125986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1196/2264] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:36:36.163914 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c6f9f4c0-cb1f-4dc8-87d6-1f19bbc6cc5d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:36.171641 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c6f9f4c0-cb1f-4dc8-87d6-1f19bbc6cc5d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1444 microversion: 2.1 time: 0.154700 Jul 21 22:36:36.172213 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1069/2265] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:36 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:36.188559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-a8d47334-5abc-48bf-8ba5-86c7a405223d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:36.189270 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-a8d47334-5abc-48bf-8ba5-86c7a405223d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:36.195756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a8d47334-5abc-48bf-8ba5-86c7a405223d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.196161 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a8d47334-5abc-48bf-8ba5-86c7a405223d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:36.196944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a8d47334-5abc-48bf-8ba5-86c7a405223d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.197383 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-a8d47334-5abc-48bf-8ba5-86c7a405223d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:36.339709 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-a8d47334-5abc-48bf-8ba5-86c7a405223d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:36.348597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-a8d47334-5abc-48bf-8ba5-86c7a405223d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1444 microversion: 2.1 time: 0.164000 Jul 21 22:36:36.349226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1197/2266] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:36 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:36.507178 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8ef60122-8c5c-4d0e-b0e5-e776595db201 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:36.508150 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8ef60122-8c5c-4d0e-b0e5-e776595db201 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:36.514556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ef60122-8c5c-4d0e-b0e5-e776595db201 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.515112 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ef60122-8c5c-4d0e-b0e5-e776595db201 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:36.516217 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ef60122-8c5c-4d0e-b0e5-e776595db201 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:36.516460 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8ef60122-8c5c-4d0e-b0e5-e776595db201 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:36.649963 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8ef60122-8c5c-4d0e-b0e5-e776595db201 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:36.657593 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8ef60122-8c5c-4d0e-b0e5-e776595db201 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1314 microversion: 2.1 time: 0.154277 Jul 21 22:36:36.658160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1070/2267] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:36 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:37.674516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-555b6073-f798-422b-8213-f340747bcf6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:37.675171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-555b6073-f798-422b-8213-f340747bcf6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:37.681882 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-555b6073-f798-422b-8213-f340747bcf6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:37.682553 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-555b6073-f798-422b-8213-f340747bcf6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:37.683489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-555b6073-f798-422b-8213-f340747bcf6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:37.683922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-555b6073-f798-422b-8213-f340747bcf6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:37.821640 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-555b6073-f798-422b-8213-f340747bcf6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:37.827600 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:37.830581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-555b6073-f798-422b-8213-f340747bcf6e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1314 microversion: 2.1 time: 0.159758 Jul 21 22:36:37.831288 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1198/2268] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:37 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:38.391180 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-411bdca3-43e7-48d3-a3a4-dd9b8342be58 req-c52f9abf-e72b-4517-bcb8-c0e90d380c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1916df-b8fd-41d0-9cbc-58bacf7829a8", "tag": "3b993736-2118-44f5-8d06-3196623a542e"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:38.400269 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-411bdca3-43e7-48d3-a3a4-dd9b8342be58 req-c52f9abf-e72b-4517-bcb8-c0e90d380c37 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:38.400731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-411bdca3-43e7-48d3-a3a4-dd9b8342be58 req-c52f9abf-e72b-4517-bcb8-c0e90d380c37 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:38.412047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-411bdca3-43e7-48d3-a3a4-dd9b8342be58 req-c52f9abf-e72b-4517-bcb8-c0e90d380c37 service nova] Creating event network-changed:3b993736-2118-44f5-8d06-3196623a542e for instance 4e1916df-b8fd-41d0-9cbc-58bacf7829a8 on hv-cinder-82002 Jul 21 22:36:38.417062 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-411bdca3-43e7-48d3-a3a4-dd9b8342be58 req-c52f9abf-e72b-4517-bcb8-c0e90d380c37 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030653 Jul 21 22:36:38.417677 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1071/2269] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:38.849125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-288c304a-f614-443c-846c-43ca84754be3 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:38.849998 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-288c304a-f614-443c-846c-43ca84754be3 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:38.858523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-288c304a-f614-443c-846c-43ca84754be3 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:38.859268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-288c304a-f614-443c-846c-43ca84754be3 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:38.860268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-288c304a-f614-443c-846c-43ca84754be3 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:38.860871 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-288c304a-f614-443c-846c-43ca84754be3 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:39.036389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-288c304a-f614-443c-846c-43ca84754be3 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:39.044998 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-288c304a-f614-443c-846c-43ca84754be3 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1464 microversion: 2.1 time: 0.200637 Jul 21 22:36:39.045637 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1199/2270] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:38 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1464 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:36:39.086596 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b326276c-0eb2-458a-bbf7-308ca73fc16e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:39.087317 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b326276c-0eb2-458a-bbf7-308ca73fc16e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:39.094195 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b326276c-0eb2-458a-bbf7-308ca73fc16e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:39.094625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b326276c-0eb2-458a-bbf7-308ca73fc16e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:39.095458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b326276c-0eb2-458a-bbf7-308ca73fc16e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:39.095903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b326276c-0eb2-458a-bbf7-308ca73fc16e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:39.124617 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b326276c-0eb2-458a-bbf7-308ca73fc16e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:36:39.170044 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:36:39.221528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b326276c-0eb2-458a-bbf7-308ca73fc16e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "DELETE /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 204 len: 0 microversion: 2.1 time: 0.138999 Jul 21 22:36:39.222477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1072/2271] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:36:39 2022] DELETE /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:36:39.231541 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-fd629010-57b3-4f27-992c-f3badc8435d0 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:39.232177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-fd629010-57b3-4f27-992c-f3badc8435d0 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:39.239307 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fd629010-57b3-4f27-992c-f3badc8435d0 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:39.239793 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fd629010-57b3-4f27-992c-f3badc8435d0 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:39.240573 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fd629010-57b3-4f27-992c-f3badc8435d0 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:39.241013 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-fd629010-57b3-4f27-992c-f3badc8435d0 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:39.375399 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-fd629010-57b3-4f27-992c-f3badc8435d0 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:39.383360 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-fd629010-57b3-4f27-992c-f3badc8435d0 tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1470 microversion: 2.1 time: 0.156325 Jul 21 22:36:39.384413 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1200/2272] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:39 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:40.403329 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-00431bbc-bd1e-439e-aa2a-fcef129fdd6d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:40.404043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-00431bbc-bd1e-439e-aa2a-fcef129fdd6d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:40.410595 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00431bbc-bd1e-439e-aa2a-fcef129fdd6d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:40.411080 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00431bbc-bd1e-439e-aa2a-fcef129fdd6d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:40.411903 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00431bbc-bd1e-439e-aa2a-fcef129fdd6d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:40.412347 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00431bbc-bd1e-439e-aa2a-fcef129fdd6d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:40.558580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-00431bbc-bd1e-439e-aa2a-fcef129fdd6d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:40.566131 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-00431bbc-bd1e-439e-aa2a-fcef129fdd6d tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1470 microversion: 2.1 time: 0.168131 Jul 21 22:36:40.566784 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1073/2273] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:40 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:41.359905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-78c0faf9-a03f-403b-9937-124fc4a23a61 req-ae7b8e48-ad2c-4cc4-a91f-44ff0b3819c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a1810c-fa8d-49ff-8589-caa16b02ffe6", "name": "network-vif-deleted", "tag": "c3de465d-f682-46c3-8139-e64b9db20044"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:36:41.370545 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-78c0faf9-a03f-403b-9937-124fc4a23a61 req-ae7b8e48-ad2c-4cc4-a91f-44ff0b3819c1 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:41.370992 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-78c0faf9-a03f-403b-9937-124fc4a23a61 req-ae7b8e48-ad2c-4cc4-a91f-44ff0b3819c1 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:41.385807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-78c0faf9-a03f-403b-9937-124fc4a23a61 req-ae7b8e48-ad2c-4cc4-a91f-44ff0b3819c1 service nova] Creating event network-vif-deleted:c3de465d-f682-46c3-8139-e64b9db20044 for instance 61a1810c-fa8d-49ff-8589-caa16b02ffe6 on hv-cinder-82002 Jul 21 22:36:41.392043 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-78c0faf9-a03f-403b-9937-124fc4a23a61 req-ae7b8e48-ad2c-4cc4-a91f-44ff0b3819c1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035621 Jul 21 22:36:41.395201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1201/2274] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:36:41.584182 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ae413f9f-efc6-47c2-b57c-4b07546f0a7e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:41.584939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ae413f9f-efc6-47c2-b57c-4b07546f0a7e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:41.593699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ae413f9f-efc6-47c2-b57c-4b07546f0a7e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:41.594434 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ae413f9f-efc6-47c2-b57c-4b07546f0a7e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:41.595855 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ae413f9f-efc6-47c2-b57c-4b07546f0a7e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:41.596617 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ae413f9f-efc6-47c2-b57c-4b07546f0a7e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:41.631853 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ae413f9f-efc6-47c2-b57c-4b07546f0a7e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:41.632306 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ae413f9f-efc6-47c2-b57c-4b07546f0a7e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:41.632766 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-ae413f9f-efc6-47c2-b57c-4b07546f0a7e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lazy-loading 'fault' on Instance uuid 61a1810c-fa8d-49ff-8589-caa16b02ffe6 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:36:41.674962 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ae413f9f-efc6-47c2-b57c-4b07546f0a7e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6243309b58d420789350d8f935b7207', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6470e7bfe9ac4a80b7f18ba009dcfdf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:36:41.683055 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ae413f9f-efc6-47c2-b57c-4b07546f0a7e tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 200 len: 1304 microversion: 2.1 time: 0.102821 Jul 21 22:36:41.683674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1074/2275] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:41 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:36:42.701573 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e4107812-1766-43a0-9c9f-c8cf173fc63f tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:36:42.702277 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e4107812-1766-43a0-9c9f-c8cf173fc63f tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] [instance: 61a1810c-fa8d-49ff-8589-caa16b02ffe6] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:36:42.708613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e4107812-1766-43a0-9c9f-c8cf173fc63f tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:42.709063 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e4107812-1766-43a0-9c9f-c8cf173fc63f tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:42.709848 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e4107812-1766-43a0-9c9f-c8cf173fc63f tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:36:42.710291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e4107812-1766-43a0-9c9f-c8cf173fc63f tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:36:42.725130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-e4107812-1766-43a0-9c9f-c8cf173fc63f tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] HTTP exception thrown: Instance 61a1810c-fa8d-49ff-8589-caa16b02ffe6 could not be found. Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e4107812-1766-43a0-9c9f-c8cf173fc63f tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Request method failure captured: Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 HTTP/1.1 Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2dTlOXMRse4ESmAml_MVYvnr0qq3IX0LEuSBY0UPxz5REiSuozeFWo0DvehWVPBhRIDZiHrt2zzrlGQc7za9IsV4mR4X5dE1tjr5-_mRxwCnc7_MCAfRBcLxQtFzbhtC2bcvKeADvooIoNvwTz98nadugn9YrIL0jnGaggo44FwifA4 Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 6470e7bfe9ac4a80b7f18ba009dcfdf9 Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-VolumesNegativeTest-937884100 Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:36:42.726834 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:36:42.729443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6470e7bfe9ac4a80b7f18ba009dcfdf9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6470e7bfe9ac4a80b7f18ba009dcfdf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6470e7bfe9ac4a80b7f18ba009dcfdf9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6470e7bfe9ac4a80b7f18ba009dcfdf9", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:36:42.729443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-VolumesNegativeTest-937884100 Jul 21 22:36:42.729443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 6470e7bfe9ac4a80b7f18ba009dcfdf9 Jul 21 22:36:42.729443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-VolumesNegativeTest-937884100 Jul 21 22:36:42.729443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-VolumesNegativeTest-937884100-project Jul 21 22:36:42.729443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:36:42.729443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:36:42.729443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: f6243309b58d420789350d8f935b7207 Jul 21 22:36:42.729443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-VolumesNegativeTest-937884100-project Jul 21 22:36:42.729443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:36:42.729443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 61a1810c-fa8d-49ff-8589-caa16b02ffe6 could not be found. Jul 21 22:36:42.729443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '61a1810c-fa8d-49ff-8589-caa16b02ffe6'} Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a1810c-fa8d-49ff-8589-caa16b02ffe6 could not be found. Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:36:42.730537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a1810c-fa8d-49ff-8589-caa16b02ffe6 could not be found. Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a1810c-fa8d-49ff-8589-caa16b02ffe6 could not be found. Jul 21 22:36:42.732313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:36:42.733944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e4107812-1766-43a0-9c9f-c8cf173fc63f tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] Returning 404 to user: Instance 61a1810c-fa8d-49ff-8589-caa16b02ffe6 could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:36:42.733944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e4107812-1766-43a0-9c9f-c8cf173fc63f tempest-VolumesNegativeTest-937884100 tempest-VolumesNegativeTest-937884100-project] 10.222.0.44 "GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6" status: 404 len: 111 microversion: 2.1 time: 0.031533 Jul 21 22:36:42.733944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1202/2276] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:36:42 2022] GET /compute/v2.1/servers/61a1810c-fa8d-49ff-8589-caa16b02ffe6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:37:39.662833 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:37:39.663742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:37:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:38:31.152617 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:31.153391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:31.158145 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dc6b0ec4-0045-4766-9aed-6610173acfca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:31.158501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dc6b0ec4-0045-4766-9aed-6610173acfca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:31.167731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dc6b0ec4-0045-4766-9aed-6610173acfca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:31.168180 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dc6b0ec4-0045-4766-9aed-6610173acfca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:31.169027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dc6b0ec4-0045-4766-9aed-6610173acfca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:31.169463 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dc6b0ec4-0045-4766-9aed-6610173acfca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:31.188298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-dc6b0ec4-0045-4766-9aed-6610173acfca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] HTTP exception thrown: Instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 could not be found. Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dc6b0ec4-0045-4766-9aed-6610173acfca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Request method failure captured: Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 HTTP/1.1 Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwq5cO8Iqs9BNx6Mzryp9hZtqim1vH8HuegCxrBuP4XGTqM74Ohh4WW_J2xt7YkUUdtgarY1MbMXrA_UelMtrho4YuwAwHA1g3NEpX3Am91Bsh0TFHZTsHViUUwnnQ3b29fzazVBCaTklKontb6LNgtPxGazR2DvDr1xBxhj2kB17I Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:38:31.190032 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:38:31.193115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47878d7ed9cb49adba1f84a2ffb2deda", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:38:31.193115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:38:31.193115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:38:31.193115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:38:31.193115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:38:31.193115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:38:31.193115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:38:31.193115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 73f068abea75404fb2829065a674aee4 Jul 21 22:38:31.193115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:38:31.193115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:38:31.193115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 could not be found. Jul 21 22:38:31.193115 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': '7365f289-299d-4d2d-ba74-1ca18cf88e06'} Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 could not be found. Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:38:31.195842 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 could not be found. Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 could not be found. Jul 21 22:38:31.199098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.204345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dc6b0ec4-0045-4766-9aed-6610173acfca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Returning 404 to user: Instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:38:31.204345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dc6b0ec4-0045-4766-9aed-6610173acfca tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 404 len: 111 microversion: 2.1 time: 0.040870 Jul 21 22:38:31.204345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1075/2277] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:38:31 2022] DELETE /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:38:31.204733 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2017e6a6-e713-4798-9720-cf2a539d8109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:31.204733 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2017e6a6-e713-4798-9720-cf2a539d8109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] [instance: 7365f289-299d-4d2d-ba74-1ca18cf88e06] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:31.208161 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:31.209352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=16 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:31.218944 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2017e6a6-e713-4798-9720-cf2a539d8109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:31.219609 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2017e6a6-e713-4798-9720-cf2a539d8109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:31.220601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2017e6a6-e713-4798-9720-cf2a539d8109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:31.221149 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2017e6a6-e713-4798-9720-cf2a539d8109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:31.246481 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-2017e6a6-e713-4798-9720-cf2a539d8109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] HTTP exception thrown: Instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 could not be found. Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2017e6a6-e713-4798-9720-cf2a539d8109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Request method failure captured: Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 HTTP/1.1 Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwq5cO8Iqs9BNx6Mzryp9hZtqim1vH8HuegCxrBuP4XGTqM74Ohh4WW_J2xt7YkUUdtgarY1MbMXrA_UelMtrho4YuwAwHA1g3NEpX3Am91Bsh0TFHZTsHViUUwnnQ3b29fzazVBCaTklKontb6LNgtPxGazR2DvDr1xBxhj2kB17I Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:38:31.248315 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:38:31.251176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/47878d7ed9cb49adba1f84a2ffb2deda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_47878d7ed9cb49adba1f84a2ffb2deda", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:38:31.251176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:38:31.251176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 47878d7ed9cb49adba1f84a2ffb2deda Jul 21 22:38:31.251176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1366353288 Jul 21 22:38:31.251176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:38:31.251176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:38:31.251176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:38:31.251176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 73f068abea75404fb2829065a674aee4 Jul 21 22:38:31.251176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-AttachVolumeNegativeTest-1366353288-project Jul 21 22:38:31.251176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:38:31.251176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 could not be found. Jul 21 22:38:31.251176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '7365f289-299d-4d2d-ba74-1ca18cf88e06'} Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 could not be found. Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:38:31.252188 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 could not be found. Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 could not be found. Jul 21 22:38:31.255584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.259293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2017e6a6-e713-4798-9720-cf2a539d8109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] Returning 404 to user: Instance 7365f289-299d-4d2d-ba74-1ca18cf88e06 could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:38:31.259293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2017e6a6-e713-4798-9720-cf2a539d8109 tempest-AttachVolumeNegativeTest-1366353288 tempest-AttachVolumeNegativeTest-1366353288-project] 10.222.0.44 "GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06" status: 404 len: 111 microversion: 2.1 time: 0.051806 Jul 21 22:38:31.259293 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1203/2278] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:31 2022] GET /compute/v2.1/servers/7365f289-299d-4d2d-ba74-1ca18cf88e06 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:38:31.265907 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dfa9898a-6e7a-41ed-afef-9c3b7b024e58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:31.266406 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dfa9898a-6e7a-41ed-afef-9c3b7b024e58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:31.272887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dfa9898a-6e7a-41ed-afef-9c3b7b024e58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:31.273372 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dfa9898a-6e7a-41ed-afef-9c3b7b024e58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:31.274194 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dfa9898a-6e7a-41ed-afef-9c3b7b024e58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:31.274936 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dfa9898a-6e7a-41ed-afef-9c3b7b024e58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:31.290399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-dfa9898a-6e7a-41ed-afef-9c3b7b024e58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] HTTP exception thrown: Instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f could not be found. Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dfa9898a-6e7a-41ed-afef-9c3b7b024e58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Request method failure captured: Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f HTTP/1.1 Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2cwsFoQuFzo2FslExyVTADChaJIs6N9-o5VsNNOQT6SZ9p5oybpNMCsOCZlhpZABdWxKinYf5u4ZG1tARrF46oAgdhaQ5A2jaRTfL56kRa7dxhitIuKMLzZz4qYQ5ouY9PdmQ5B98yRhbQLMuSvyefpqsG0a5Zq3gCR9k5F79Ab1l6Y Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:38:31.292079 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:38:31.295458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_64e8fc83edda464e8ec9f7c2ee9c142c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:38:31.295458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:38:31.295458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:38:31.295458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:38:31.295458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:38:31.295458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:38:31.295458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:38:31.295458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 9f6537f0b9d44ba58cb5a5552f2c5b4e Jul 21 22:38:31.295458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:38:31.295458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:38:31.295458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f could not be found. Jul 21 22:38:31.295458 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': '8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f'} Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f could not be found. Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:38:31.297414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f could not be found. Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f could not be found. Jul 21 22:38:31.299826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.303294 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dfa9898a-6e7a-41ed-afef-9c3b7b024e58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Returning 404 to user: Instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:38:31.303294 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dfa9898a-6e7a-41ed-afef-9c3b7b024e58 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 404 len: 111 microversion: 2.1 time: 0.034233 Jul 21 22:38:31.303294 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1076/2279] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:38:31 2022] DELETE /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:38:31.307807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-aa30432b-b9f2-4b57-a847-687c14bbcc16 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:31.308784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-aa30432b-b9f2-4b57-a847-687c14bbcc16 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] [instance: 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:31.318177 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa30432b-b9f2-4b57-a847-687c14bbcc16 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:31.318735 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa30432b-b9f2-4b57-a847-687c14bbcc16 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:31.319840 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa30432b-b9f2-4b57-a847-687c14bbcc16 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:31.320423 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa30432b-b9f2-4b57-a847-687c14bbcc16 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:31.341714 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-aa30432b-b9f2-4b57-a847-687c14bbcc16 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] HTTP exception thrown: Instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f could not be found. Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-aa30432b-b9f2-4b57-a847-687c14bbcc16 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Request method failure captured: Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f HTTP/1.1 Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2cwsFoQuFzo2FslExyVTADChaJIs6N9-o5VsNNOQT6SZ9p5oybpNMCsOCZlhpZABdWxKinYf5u4ZG1tARrF46oAgdhaQ5A2jaRTfL56kRa7dxhitIuKMLzZz4qYQ5ouY9PdmQ5B98yRhbQLMuSvyefpqsG0a5Zq3gCR9k5F79Ab1l6Y Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:38:31.343850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:38:31.346167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/64e8fc83edda464e8ec9f7c2ee9c142c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_64e8fc83edda464e8ec9f7c2ee9c142c", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:38:31.346167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:38:31.346167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 64e8fc83edda464e8ec9f7c2ee9c142c Jul 21 22:38:31.346167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-AttachVolumeTestJSON-231004363 Jul 21 22:38:31.346167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:38:31.346167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:38:31.346167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:38:31.346167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 9f6537f0b9d44ba58cb5a5552f2c5b4e Jul 21 22:38:31.346167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-AttachVolumeTestJSON-231004363-project Jul 21 22:38:31.346167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:38:31.346167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f could not be found. Jul 21 22:38:31.346167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f'} Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f could not be found. Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:38:31.347090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f could not be found. Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f could not be found. Jul 21 22:38:31.349099 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:38:31.350345 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-aa30432b-b9f2-4b57-a847-687c14bbcc16 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] Returning 404 to user: Instance 8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:38:31.350345 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-aa30432b-b9f2-4b57-a847-687c14bbcc16 tempest-AttachVolumeTestJSON-231004363 tempest-AttachVolumeTestJSON-231004363-project] 10.222.0.44 "GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f" status: 404 len: 111 microversion: 2.1 time: 0.046439 Jul 21 22:38:31.350345 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1204/2280] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:31 2022] GET /compute/v2.1/servers/8e3ca1b9-3aa3-493e-b787-4c6ee9cf173f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:38:49.283591 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:38:49.284301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:38:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:38:52.436832 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-aaf16c77-4419-4268-83c3-80ad86b327a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:52.437414 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-aaf16c77-4419-4268-83c3-80ad86b327a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:52.439936 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62186598-0719-47ae-9ec4-e5aa9f83c2b9] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 21 22:38:52.440391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:52.441049 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:52.447413 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aaf16c77-4419-4268-83c3-80ad86b327a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:52.447864 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aaf16c77-4419-4268-83c3-80ad86b327a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:52.448635 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aaf16c77-4419-4268-83c3-80ad86b327a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:52.449069 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aaf16c77-4419-4268-83c3-80ad86b327a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:52.479103 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-aaf16c77-4419-4268-83c3-80ad86b327a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lazy-loading 'flavor' on Instance uuid 4e1916df-b8fd-41d0-9cbc-58bacf7829a8 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:38:52.557029 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-aaf16c77-4419-4268-83c3-80ad86b327a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "POST /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8/action" status: 202 len: 0 microversion: 2.1 time: 0.124470 Jul 21 22:38:52.557654 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1077/2281] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 22:38:52 2022] POST /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:38:52.566868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2590a25d-3b29-4027-b425-df187353d8b9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:52.567515 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-2590a25d-3b29-4027-b425-df187353d8b9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:52.569990 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1ea72114-1d1b-4719-8091-31de6bff38ad] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 21 22:38:52.570443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=4 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:52.571113 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=4 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:38:52.577718 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2590a25d-3b29-4027-b425-df187353d8b9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:52.578241 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2590a25d-3b29-4027-b425-df187353d8b9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:52.579208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2590a25d-3b29-4027-b425-df187353d8b9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:52.579648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-2590a25d-3b29-4027-b425-df187353d8b9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:52.811172 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-971473833", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "networks": [{"uuid": "a258c959-cec9-4efa-ad54-07ccbf3cec66"}]}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:52.852199 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-2590a25d-3b29-4027-b425-df187353d8b9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:52.859952 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2590a25d-3b29-4027-b425-df187353d8b9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.297053 Jul 21 22:38:52.860529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1205/2282] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:52 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:38:52.986629 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] validate_networks() for [('a258c959-cec9-4efa-ad54-07ccbf3cec66', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:38:53.449292 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:38:53.449937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:38:53.450181 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:38:53.450672 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:38:53.451186 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:38:53.458695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] [62186598-0719-47ae-9ec4-e5aa9f83c2b9] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 41322. Jul 21 22:38:53.467142 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:53.467610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:53.468501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:53.468887 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:53.489692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Getting quotas for project ef7039f35fa747d2bfceabbf3374d475. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:38:53.494730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Getting quotas for user 620de5d224e742aeb49e0c61e767d2de and project ef7039f35fa747d2bfceabbf3374d475. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:38:53.508619 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:38:53.511078 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:38:53.562220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c6a27f38-5136-4af1-903c-14ac59dfcb3b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755406 Jul 21 22:38:53.563083 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1078/2283] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 22:38:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:38:53.581261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-798cfcaf-f3da-4c69-a152-7fb332b45267 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:53.582850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-798cfcaf-f3da-4c69-a152-7fb332b45267 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:53.617104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] [1ea72114-1d1b-4719-8091-31de6bff38ad] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 41326. Jul 21 22:38:53.655242 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-798cfcaf-f3da-4c69-a152-7fb332b45267 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:53.662384 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-798cfcaf-f3da-4c69-a152-7fb332b45267 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1213 microversion: 2.1 time: 0.087090 Jul 21 22:38:53.662962 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1206/2284] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:53 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:53.877815 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-31645eed-6055-4ecb-b667-e02c0d8cb03a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:53.879256 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-31645eed-6055-4ecb-b667-e02c0d8cb03a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:53.886469 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-31645eed-6055-4ecb-b667-e02c0d8cb03a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:53.886922 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-31645eed-6055-4ecb-b667-e02c0d8cb03a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:53.887733 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-31645eed-6055-4ecb-b667-e02c0d8cb03a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:53.888193 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-31645eed-6055-4ecb-b667-e02c0d8cb03a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:54.063148 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-31645eed-6055-4ecb-b667-e02c0d8cb03a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:54.072517 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-31645eed-6055-4ecb-b667-e02c0d8cb03a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.198548 Jul 21 22:38:54.073172 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1079/2285] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:53 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:54.682231 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-35fa4930-559e-45b9-a701-e22db7d5b25a tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:54.682856 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-35fa4930-559e-45b9-a701-e22db7d5b25a tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:54.690139 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-35fa4930-559e-45b9-a701-e22db7d5b25a tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:54.690596 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-35fa4930-559e-45b9-a701-e22db7d5b25a tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:54.691413 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-35fa4930-559e-45b9-a701-e22db7d5b25a tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:54.691858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-35fa4930-559e-45b9-a701-e22db7d5b25a tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:54.757797 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-35fa4930-559e-45b9-a701-e22db7d5b25a tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:54.769964 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-35fa4930-559e-45b9-a701-e22db7d5b25a tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1217 microversion: 2.1 time: 0.092742 Jul 21 22:38:54.770598 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1207/2286] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:54 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1217 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:55.090042 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ee4a6546-13ca-425e-96a0-31e5b7ffd895 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:55.090594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ee4a6546-13ca-425e-96a0-31e5b7ffd895 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:55.097047 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee4a6546-13ca-425e-96a0-31e5b7ffd895 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:55.097497 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee4a6546-13ca-425e-96a0-31e5b7ffd895 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:55.098259 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee4a6546-13ca-425e-96a0-31e5b7ffd895 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:55.098696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee4a6546-13ca-425e-96a0-31e5b7ffd895 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:55.234199 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ee4a6546-13ca-425e-96a0-31e5b7ffd895 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:55.241718 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ee4a6546-13ca-425e-96a0-31e5b7ffd895 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.155656 Jul 21 22:38:55.242286 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1080/2287] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:55 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:55.787685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c49315c5-ef6f-4f12-9654-8e89e75c04fc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:55.788267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c49315c5-ef6f-4f12-9654-8e89e75c04fc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:55.795174 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c49315c5-ef6f-4f12-9654-8e89e75c04fc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:55.795635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c49315c5-ef6f-4f12-9654-8e89e75c04fc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:55.796449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c49315c5-ef6f-4f12-9654-8e89e75c04fc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:55.796922 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c49315c5-ef6f-4f12-9654-8e89e75c04fc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:55.865694 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c49315c5-ef6f-4f12-9654-8e89e75c04fc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:55.873195 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c49315c5-ef6f-4f12-9654-8e89e75c04fc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1217 microversion: 2.1 time: 0.090096 Jul 21 22:38:55.873791 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1208/2288] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:55 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:56.258645 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-458d46e8-92f6-4b5f-b318-1da67d43955d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:56.259313 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-458d46e8-92f6-4b5f-b318-1da67d43955d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:56.266166 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-458d46e8-92f6-4b5f-b318-1da67d43955d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:56.266619 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-458d46e8-92f6-4b5f-b318-1da67d43955d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:56.267442 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-458d46e8-92f6-4b5f-b318-1da67d43955d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:56.267912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-458d46e8-92f6-4b5f-b318-1da67d43955d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:56.412551 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-458d46e8-92f6-4b5f-b318-1da67d43955d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:56.420555 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-458d46e8-92f6-4b5f-b318-1da67d43955d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.165866 Jul 21 22:38:56.421133 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1081/2289] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:56 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:56.890053 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3dd6858c-b6c0-4ec4-836f-89f7f6a16e25 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:56.890664 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3dd6858c-b6c0-4ec4-836f-89f7f6a16e25 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:56.897483 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3dd6858c-b6c0-4ec4-836f-89f7f6a16e25 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:56.897947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3dd6858c-b6c0-4ec4-836f-89f7f6a16e25 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:56.898719 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3dd6858c-b6c0-4ec4-836f-89f7f6a16e25 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:56.899187 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3dd6858c-b6c0-4ec4-836f-89f7f6a16e25 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:56.969263 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3dd6858c-b6c0-4ec4-836f-89f7f6a16e25 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:56.978183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3dd6858c-b6c0-4ec4-836f-89f7f6a16e25 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1271 microversion: 2.1 time: 0.091923 Jul 21 22:38:56.978776 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1209/2290] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:56 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:57.437961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0bac5146-d964-478e-903f-34fca4d4cd89 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:57.438857 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0bac5146-d964-478e-903f-34fca4d4cd89 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:57.446275 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bac5146-d964-478e-903f-34fca4d4cd89 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:57.446627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bac5146-d964-478e-903f-34fca4d4cd89 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:57.447433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bac5146-d964-478e-903f-34fca4d4cd89 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:57.447873 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bac5146-d964-478e-903f-34fca4d4cd89 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:57.590934 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0bac5146-d964-478e-903f-34fca4d4cd89 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:57.600469 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0bac5146-d964-478e-903f-34fca4d4cd89 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.166663 Jul 21 22:38:57.601427 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1082/2291] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:57 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:57.996246 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3efeebc7-ac46-47a6-bc66-23537cbe13bd tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:57.996968 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3efeebc7-ac46-47a6-bc66-23537cbe13bd tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:58.003633 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3efeebc7-ac46-47a6-bc66-23537cbe13bd tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:58.004089 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3efeebc7-ac46-47a6-bc66-23537cbe13bd tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:58.004863 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3efeebc7-ac46-47a6-bc66-23537cbe13bd tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:58.005309 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3efeebc7-ac46-47a6-bc66-23537cbe13bd tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:58.178174 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-1073b18e-841b-4ffc-828f-faf81853e06b req-02d50a65-7b49-439b-a3e9-c7413bdc2b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5170db20-3d22-48b3-8ba2-3f989e80c362", "tag": "876d853e-c115-47b6-9f62-d41f0ce8d130"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:38:58.182787 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3efeebc7-ac46-47a6-bc66-23537cbe13bd tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:58.187657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-1073b18e-841b-4ffc-828f-faf81853e06b req-02d50a65-7b49-439b-a3e9-c7413bdc2b7f service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:58.188543 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-1073b18e-841b-4ffc-828f-faf81853e06b req-02d50a65-7b49-439b-a3e9-c7413bdc2b7f service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:58.190795 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3efeebc7-ac46-47a6-bc66-23537cbe13bd tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1313 microversion: 2.1 time: 0.198423 Jul 21 22:38:58.191484 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1210/2292] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:57 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:58.200953 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-1073b18e-841b-4ffc-828f-faf81853e06b req-02d50a65-7b49-439b-a3e9-c7413bdc2b7f service nova] Creating event network-changed:876d853e-c115-47b6-9f62-d41f0ce8d130 for instance 5170db20-3d22-48b3-8ba2-3f989e80c362 on hv-cinder-82002 Jul 21 22:38:58.207307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-1073b18e-841b-4ffc-828f-faf81853e06b req-02d50a65-7b49-439b-a3e9-c7413bdc2b7f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119042 Jul 21 22:38:58.208153 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1083/2293] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:38:58.617645 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c2e71c30-b60f-4f55-97b9-b2fee93dd8a2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:58.618791 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c2e71c30-b60f-4f55-97b9-b2fee93dd8a2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:58.626355 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2e71c30-b60f-4f55-97b9-b2fee93dd8a2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:58.626807 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2e71c30-b60f-4f55-97b9-b2fee93dd8a2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:58.627614 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2e71c30-b60f-4f55-97b9-b2fee93dd8a2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:58.628059 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c2e71c30-b60f-4f55-97b9-b2fee93dd8a2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:58.778312 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c2e71c30-b60f-4f55-97b9-b2fee93dd8a2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:58.786574 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c2e71c30-b60f-4f55-97b9-b2fee93dd8a2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.172718 Jul 21 22:38:58.787456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1211/2294] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:58 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:59.207610 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d82be3fa-157b-45de-ba83-91ce506a010e tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:59.208303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d82be3fa-157b-45de-ba83-91ce506a010e tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:59.216121 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d82be3fa-157b-45de-ba83-91ce506a010e tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:59.216581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d82be3fa-157b-45de-ba83-91ce506a010e tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:59.217386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d82be3fa-157b-45de-ba83-91ce506a010e tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:59.217825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d82be3fa-157b-45de-ba83-91ce506a010e tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:59.361132 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d82be3fa-157b-45de-ba83-91ce506a010e tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:59.369174 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d82be3fa-157b-45de-ba83-91ce506a010e tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1313 microversion: 2.1 time: 0.165804 Jul 21 22:38:59.369737 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1084/2295] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:59 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:38:59.804543 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-aa028ff4-5df5-4dc1-9832-42c8df73de34 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:38:59.805084 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-aa028ff4-5df5-4dc1-9832-42c8df73de34 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:38:59.811594 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa028ff4-5df5-4dc1-9832-42c8df73de34 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:59.812050 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa028ff4-5df5-4dc1-9832-42c8df73de34 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:59.812809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa028ff4-5df5-4dc1-9832-42c8df73de34 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:38:59.813247 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-aa028ff4-5df5-4dc1-9832-42c8df73de34 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:38:59.947143 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-aa028ff4-5df5-4dc1-9832-42c8df73de34 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:38:59.955053 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-aa028ff4-5df5-4dc1-9832-42c8df73de34 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.154971 Jul 21 22:38:59.955647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1212/2296] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:38:59 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:00.387204 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0740c24f-2713-47a2-bb1b-873bf658d9d5 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:00.387826 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0740c24f-2713-47a2-bb1b-873bf658d9d5 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:00.394362 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0740c24f-2713-47a2-bb1b-873bf658d9d5 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.394834 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0740c24f-2713-47a2-bb1b-873bf658d9d5 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.395674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0740c24f-2713-47a2-bb1b-873bf658d9d5 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.396166 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0740c24f-2713-47a2-bb1b-873bf658d9d5 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.539175 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0740c24f-2713-47a2-bb1b-873bf658d9d5 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:00.547727 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0740c24f-2713-47a2-bb1b-873bf658d9d5 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1313 microversion: 2.1 time: 0.164559 Jul 21 22:39:00.548335 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1085/2297] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:00 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:00.973799 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8cf413d6-69b3-4ff3-98aa-61bb1df6779e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:00.974411 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8cf413d6-69b3-4ff3-98aa-61bb1df6779e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:00.980999 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8cf413d6-69b3-4ff3-98aa-61bb1df6779e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.981451 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8cf413d6-69b3-4ff3-98aa-61bb1df6779e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:00.982229 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8cf413d6-69b3-4ff3-98aa-61bb1df6779e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:00.982670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8cf413d6-69b3-4ff3-98aa-61bb1df6779e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:01.123566 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8cf413d6-69b3-4ff3-98aa-61bb1df6779e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:01.132695 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8cf413d6-69b3-4ff3-98aa-61bb1df6779e tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.163481 Jul 21 22:39:01.133267 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1213/2298] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:00 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:01.571171 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9aefd9e9-2309-44b3-b77c-be818e23b53c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:01.571604 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9aefd9e9-2309-44b3-b77c-be818e23b53c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:01.579175 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9aefd9e9-2309-44b3-b77c-be818e23b53c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:01.579870 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9aefd9e9-2309-44b3-b77c-be818e23b53c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:01.580961 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9aefd9e9-2309-44b3-b77c-be818e23b53c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:01.581614 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9aefd9e9-2309-44b3-b77c-be818e23b53c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:01.804069 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9aefd9e9-2309-44b3-b77c-be818e23b53c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:01.821160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9aefd9e9-2309-44b3-b77c-be818e23b53c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1313 microversion: 2.1 time: 0.258841 Jul 21 22:39:01.822119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1086/2299] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:01 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:02.150685 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-e39cac37-eaa3-48bc-828f-ba61e9d11071 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:02.151337 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-e39cac37-eaa3-48bc-828f-ba61e9d11071 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:02.158353 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e39cac37-eaa3-48bc-828f-ba61e9d11071 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:02.158817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e39cac37-eaa3-48bc-828f-ba61e9d11071 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:02.159659 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e39cac37-eaa3-48bc-828f-ba61e9d11071 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:02.160101 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-e39cac37-eaa3-48bc-828f-ba61e9d11071 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:02.316606 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-e39cac37-eaa3-48bc-828f-ba61e9d11071 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:02.323965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-e39cac37-eaa3-48bc-828f-ba61e9d11071 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.178282 Jul 21 22:39:02.324745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1214/2300] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:02 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:39:02.840540 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8194f36e-2c38-4d2e-8860-11096e535132 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:02.841328 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8194f36e-2c38-4d2e-8860-11096e535132 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:02.849323 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8194f36e-2c38-4d2e-8860-11096e535132 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:02.849323 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8194f36e-2c38-4d2e-8860-11096e535132 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:02.849862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8194f36e-2c38-4d2e-8860-11096e535132 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:02.850298 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8194f36e-2c38-4d2e-8860-11096e535132 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:02.992678 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8194f36e-2c38-4d2e-8860-11096e535132 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:03.000635 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8194f36e-2c38-4d2e-8860-11096e535132 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1313 microversion: 2.1 time: 0.163940 Jul 21 22:39:03.001222 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1087/2301] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:02 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:03.342887 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3cf56943-74fa-4292-80d3-283eba9408c6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:03.343610 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3cf56943-74fa-4292-80d3-283eba9408c6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:03.352744 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3cf56943-74fa-4292-80d3-283eba9408c6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:03.353286 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3cf56943-74fa-4292-80d3-283eba9408c6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:03.354166 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3cf56943-74fa-4292-80d3-283eba9408c6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:03.354677 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3cf56943-74fa-4292-80d3-283eba9408c6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:03.517034 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3cf56943-74fa-4292-80d3-283eba9408c6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:03.528533 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3cf56943-74fa-4292-80d3-283eba9408c6 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.189531 Jul 21 22:39:03.529471 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1215/2302] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:03 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:03.700856 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:03.701631 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:03.865952 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-3bde6a76-d962-4d4d-ab84-20349f8c2dca req-dd28f073-5acb-473b-b296-9ae492818c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5170db20-3d22-48b3-8ba2-3f989e80c362", "name": "network-vif-plugged", "status": "completed", "tag": "876d853e-c115-47b6-9f62-d41f0ce8d130"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:03.874401 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-3bde6a76-d962-4d4d-ab84-20349f8c2dca req-dd28f073-5acb-473b-b296-9ae492818c18 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:03.875349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-3bde6a76-d962-4d4d-ab84-20349f8c2dca req-dd28f073-5acb-473b-b296-9ae492818c18 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:03.887602 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-3bde6a76-d962-4d4d-ab84-20349f8c2dca req-dd28f073-5acb-473b-b296-9ae492818c18 service nova] Creating event network-vif-plugged:876d853e-c115-47b6-9f62-d41f0ce8d130 for instance 5170db20-3d22-48b3-8ba2-3f989e80c362 on hv-cinder-82002 Jul 21 22:39:03.892627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-3bde6a76-d962-4d4d-ab84-20349f8c2dca req-dd28f073-5acb-473b-b296-9ae492818c18 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.196392 Jul 21 22:39:03.893236 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1088/2303] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:39:04.017527 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-d2945d44-de5e-4467-ac1b-a9c8b5d3d1dc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:04.018520 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-d2945d44-de5e-4467-ac1b-a9c8b5d3d1dc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:04.024932 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:04.027812 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d2945d44-de5e-4467-ac1b-a9c8b5d3d1dc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:04.028711 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d2945d44-de5e-4467-ac1b-a9c8b5d3d1dc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:04.029679 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d2945d44-de5e-4467-ac1b-a9c8b5d3d1dc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:04.030304 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-d2945d44-de5e-4467-ac1b-a9c8b5d3d1dc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:04.185220 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-d2945d44-de5e-4467-ac1b-a9c8b5d3d1dc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:04.194936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-d2945d44-de5e-4467-ac1b-a9c8b5d3d1dc tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1313 microversion: 2.1 time: 0.181663 Jul 21 22:39:04.195711 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1216/2304] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:04 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:04.548883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6a71d303-5516-4035-8cf0-d27bab2dc4a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:04.550111 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6a71d303-5516-4035-8cf0-d27bab2dc4a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:04.556397 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6a71d303-5516-4035-8cf0-d27bab2dc4a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:04.556856 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6a71d303-5516-4035-8cf0-d27bab2dc4a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:04.557748 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6a71d303-5516-4035-8cf0-d27bab2dc4a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:04.558201 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6a71d303-5516-4035-8cf0-d27bab2dc4a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:04.712960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6a71d303-5516-4035-8cf0-d27bab2dc4a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:04.720580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6a71d303-5516-4035-8cf0-d27bab2dc4a8 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.175882 Jul 21 22:39:04.721147 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1089/2305] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:04 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:05.212601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5136d78c-bbfa-4040-abd5-79cf4680eb12 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:05.213264 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5136d78c-bbfa-4040-abd5-79cf4680eb12 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:05.219805 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5136d78c-bbfa-4040-abd5-79cf4680eb12 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:05.220247 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5136d78c-bbfa-4040-abd5-79cf4680eb12 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:05.221011 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5136d78c-bbfa-4040-abd5-79cf4680eb12 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:05.222084 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5136d78c-bbfa-4040-abd5-79cf4680eb12 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:05.357952 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5136d78c-bbfa-4040-abd5-79cf4680eb12 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:05.365784 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5136d78c-bbfa-4040-abd5-79cf4680eb12 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1313 microversion: 2.1 time: 0.157173 Jul 21 22:39:05.366368 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1217/2306] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:05 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:05.738522 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8035695b-96a3-4b97-8907-0a43fa6abcd7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:05.739092 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8035695b-96a3-4b97-8907-0a43fa6abcd7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:05.745568 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8035695b-96a3-4b97-8907-0a43fa6abcd7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:05.746010 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8035695b-96a3-4b97-8907-0a43fa6abcd7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:05.746788 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8035695b-96a3-4b97-8907-0a43fa6abcd7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:05.747254 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8035695b-96a3-4b97-8907-0a43fa6abcd7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:05.898782 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8035695b-96a3-4b97-8907-0a43fa6abcd7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:05.907233 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8035695b-96a3-4b97-8907-0a43fa6abcd7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.173423 Jul 21 22:39:05.907818 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1090/2307] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:05 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:06.383562 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f6a7c308-93d8-48d3-9ffe-af8814cff25c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:06.385076 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f6a7c308-93d8-48d3-9ffe-af8814cff25c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:06.392044 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f6a7c308-93d8-48d3-9ffe-af8814cff25c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:06.392762 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f6a7c308-93d8-48d3-9ffe-af8814cff25c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:06.394109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f6a7c308-93d8-48d3-9ffe-af8814cff25c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:06.394560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f6a7c308-93d8-48d3-9ffe-af8814cff25c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:06.572742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f6a7c308-93d8-48d3-9ffe-af8814cff25c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:06.582489 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f6a7c308-93d8-48d3-9ffe-af8814cff25c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1496 microversion: 2.1 time: 0.202694 Jul 21 22:39:06.583116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1218/2308] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:06 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1496 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:06.925935 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d54a3ca1-767d-491a-b5d2-a3b01132fc07 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:06.926650 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d54a3ca1-767d-491a-b5d2-a3b01132fc07 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:06.933102 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d54a3ca1-767d-491a-b5d2-a3b01132fc07 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:06.933551 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d54a3ca1-767d-491a-b5d2-a3b01132fc07 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:06.934307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d54a3ca1-767d-491a-b5d2-a3b01132fc07 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:06.934738 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d54a3ca1-767d-491a-b5d2-a3b01132fc07 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:07.071974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d54a3ca1-767d-491a-b5d2-a3b01132fc07 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:07.079474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d54a3ca1-767d-491a-b5d2-a3b01132fc07 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.158238 Jul 21 22:39:07.080048 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1091/2309] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:06 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:07.116910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-72622351-27e7-486c-9b68-b132ec0af9e0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:07.117414 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-72622351-27e7-486c-9b68-b132ec0af9e0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:07.123449 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72622351-27e7-486c-9b68-b132ec0af9e0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:07.123909 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72622351-27e7-486c-9b68-b132ec0af9e0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:07.124675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72622351-27e7-486c-9b68-b132ec0af9e0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:07.125379 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-72622351-27e7-486c-9b68-b132ec0af9e0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:07.149513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-72622351-27e7-486c-9b68-b132ec0af9e0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Going to try to terminate instance {{(pid=117979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:39:07.207276 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR oslo.messaging._drivers.impl_rabbit [None req-72622351-27e7-486c-9b68-b132ec0af9e0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [bb3c0883-9b39-4b19-b380-33e8f769d134] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 21 22:39:08.096854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bb1b7632-84c2-4dab-bee1-58dcdecf49b2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:08.097469 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bb1b7632-84c2-4dab-bee1-58dcdecf49b2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:08.103908 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb1b7632-84c2-4dab-bee1-58dcdecf49b2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:08.104367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb1b7632-84c2-4dab-bee1-58dcdecf49b2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:08.105138 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb1b7632-84c2-4dab-bee1-58dcdecf49b2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:08.105579 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb1b7632-84c2-4dab-bee1-58dcdecf49b2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:08.216077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [None req-72622351-27e7-486c-9b68-b132ec0af9e0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [bb3c0883-9b39-4b19-b380-33e8f769d134] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 41564. Jul 21 22:39:08.238961 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-72622351-27e7-486c-9b68-b132ec0af9e0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 204 len: 0 microversion: 2.1 time: 1.126876 Jul 21 22:39:08.239523 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1219/2310] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:39:07 2022] DELETE /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 0 bytes in 1128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:39:08.247947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bd171846-b284-4929-b9ea-4b9a04e944d3 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:08.248643 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bd171846-b284-4929-b9ea-4b9a04e944d3 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:08.254425 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd171846-b284-4929-b9ea-4b9a04e944d3 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:08.254876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd171846-b284-4929-b9ea-4b9a04e944d3 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:08.255670 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd171846-b284-4929-b9ea-4b9a04e944d3 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:08.256179 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bd171846-b284-4929-b9ea-4b9a04e944d3 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:08.278776 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bb1b7632-84c2-4dab-bee1-58dcdecf49b2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:08.287667 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bb1b7632-84c2-4dab-bee1-58dcdecf49b2 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.194785 Jul 21 22:39:08.288482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1092/2311] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:08 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:39:08.433725 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bd171846-b284-4929-b9ea-4b9a04e944d3 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:08.437837 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:08.444888 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bd171846-b284-4929-b9ea-4b9a04e944d3 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1502 microversion: 2.1 time: 0.200869 Jul 21 22:39:08.454398 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1220/2312] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:08 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1502 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:39:09.305498 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6cbbe0db-c2ee-4797-b91a-e70923123f32 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:09.306117 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6cbbe0db-c2ee-4797-b91a-e70923123f32 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:09.312583 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6cbbe0db-c2ee-4797-b91a-e70923123f32 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:09.313053 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6cbbe0db-c2ee-4797-b91a-e70923123f32 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:09.313827 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6cbbe0db-c2ee-4797-b91a-e70923123f32 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:09.314270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6cbbe0db-c2ee-4797-b91a-e70923123f32 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:09.335615 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:09.456506 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6cbbe0db-c2ee-4797-b91a-e70923123f32 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:09.464794 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c73f213b-d31e-45b9-9b52-0a6b8c70b48b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:09.465413 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c73f213b-d31e-45b9-9b52-0a6b8c70b48b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:09.475121 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c73f213b-d31e-45b9-9b52-0a6b8c70b48b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:09.475593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c73f213b-d31e-45b9-9b52-0a6b8c70b48b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:09.475696 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6cbbe0db-c2ee-4797-b91a-e70923123f32 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.173780 Jul 21 22:39:09.476333 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1093/2313] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:09 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:09.476608 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c73f213b-d31e-45b9-9b52-0a6b8c70b48b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:09.477046 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c73f213b-d31e-45b9-9b52-0a6b8c70b48b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:09.633911 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c73f213b-d31e-45b9-9b52-0a6b8c70b48b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:09.645171 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c73f213b-d31e-45b9-9b52-0a6b8c70b48b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1502 microversion: 2.1 time: 0.185551 Jul 21 22:39:09.646439 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1221/2314] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:09 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1502 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:39:10.492679 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e954549b-4f6c-4f97-a4fc-151d3091969f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:10.493365 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e954549b-4f6c-4f97-a4fc-151d3091969f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:10.501289 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e954549b-4f6c-4f97-a4fc-151d3091969f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.502099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e954549b-4f6c-4f97-a4fc-151d3091969f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.503245 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e954549b-4f6c-4f97-a4fc-151d3091969f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.503983 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e954549b-4f6c-4f97-a4fc-151d3091969f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.517440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-60755871-99b9-4e0a-bc41-7f531101ebb2 req-d40feb49-c768-49be-bd75-442503ea1cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5170db20-3d22-48b3-8ba2-3f989e80c362", "name": "network-vif-deleted", "tag": "876d853e-c115-47b6-9f62-d41f0ce8d130"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:10.536083 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-60755871-99b9-4e0a-bc41-7f531101ebb2 req-d40feb49-c768-49be-bd75-442503ea1cd7 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.536571 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-60755871-99b9-4e0a-bc41-7f531101ebb2 req-d40feb49-c768-49be-bd75-442503ea1cd7 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.552958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-60755871-99b9-4e0a-bc41-7f531101ebb2 req-d40feb49-c768-49be-bd75-442503ea1cd7 service nova] Creating event network-vif-deleted:876d853e-c115-47b6-9f62-d41f0ce8d130 for instance 5170db20-3d22-48b3-8ba2-3f989e80c362 on hv-cinder-82002 Jul 21 22:39:10.559224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-60755871-99b9-4e0a-bc41-7f531101ebb2 req-d40feb49-c768-49be-bd75-442503ea1cd7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045066 Jul 21 22:39:10.560452 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1222/2315] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:39:10.665851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ecbc5c7d-4aba-4bec-b02b-12c14ef3842d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:10.666556 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ecbc5c7d-4aba-4bec-b02b-12c14ef3842d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:10.674175 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ecbc5c7d-4aba-4bec-b02b-12c14ef3842d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.674954 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ecbc5c7d-4aba-4bec-b02b-12c14ef3842d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.676017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ecbc5c7d-4aba-4bec-b02b-12c14ef3842d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.676651 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ecbc5c7d-4aba-4bec-b02b-12c14ef3842d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.687862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e954549b-4f6c-4f97-a4fc-151d3091969f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:10.698289 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e954549b-4f6c-4f97-a4fc-151d3091969f tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1509 microversion: 2.1 time: 0.208570 Jul 21 22:39:10.699265 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1094/2316] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:10 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:10.716345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f35aa664-a638-4490-90d2-7dfe1af6b36a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:10.717452 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f35aa664-a638-4490-90d2-7dfe1af6b36a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:10.720407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ecbc5c7d-4aba-4bec-b02b-12c14ef3842d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.721950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ecbc5c7d-4aba-4bec-b02b-12c14ef3842d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.722310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.objects.instance [None req-ecbc5c7d-4aba-4bec-b02b-12c14ef3842d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lazy-loading 'fault' on Instance uuid 5170db20-3d22-48b3-8ba2-3f989e80c362 {{(pid=117979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:39:10.725878 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f35aa664-a638-4490-90d2-7dfe1af6b36a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.726514 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f35aa664-a638-4490-90d2-7dfe1af6b36a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.727608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f35aa664-a638-4490-90d2-7dfe1af6b36a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.728250 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f35aa664-a638-4490-90d2-7dfe1af6b36a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.779856 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ecbc5c7d-4aba-4bec-b02b-12c14ef3842d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:10.788031 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ecbc5c7d-4aba-4bec-b02b-12c14ef3842d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 200 len: 1303 microversion: 2.1 time: 0.127590 Jul 21 22:39:10.788601 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1223/2317] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:10 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:39:10.851461 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f35aa664-a638-4490-90d2-7dfe1af6b36a tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "POST /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8/action" status: 202 len: 0 microversion: 2.1 time: 0.139768 Jul 21 22:39:10.852204 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1095/2318] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 22:39:10 2022] POST /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 21 22:39:10.862340 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-bf317351-6b24-4287-9212-927ff5025595 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:10.863437 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-bf317351-6b24-4287-9212-927ff5025595 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:10.870277 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf317351-6b24-4287-9212-927ff5025595 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.870761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf317351-6b24-4287-9212-927ff5025595 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:10.871859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf317351-6b24-4287-9212-927ff5025595 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:10.872004 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-bf317351-6b24-4287-9212-927ff5025595 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.047923 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-bf317351-6b24-4287-9212-927ff5025595 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:11.057818 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-bf317351-6b24-4287-9212-927ff5025595 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1517 microversion: 2.1 time: 0.200540 Jul 21 22:39:11.058843 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1224/2319] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:10 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1517 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:11.681607 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-a7913d51-d1a7-403c-8560-f7bd785a7a43 req-682cac78-03b9-4776-be8f-3caf2cbcae02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1916df-b8fd-41d0-9cbc-58bacf7829a8", "name": "network-vif-unplugged", "status": "completed", "tag": "3b993736-2118-44f5-8d06-3196623a542e"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:11.690475 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a7913d51-d1a7-403c-8560-f7bd785a7a43 req-682cac78-03b9-4776-be8f-3caf2cbcae02 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.690940 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a7913d51-d1a7-403c-8560-f7bd785a7a43 req-682cac78-03b9-4776-be8f-3caf2cbcae02 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.704360 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.compute.server_external_events [req-a7913d51-d1a7-403c-8560-f7bd785a7a43 req-682cac78-03b9-4776-be8f-3caf2cbcae02 service nova] Unable to find a host for instance 4e1916df-b8fd-41d0-9cbc-58bacf7829a8. Dropping event network-vif-unplugged {{(pid=117978) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 21 22:39:11.705502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-a7913d51-d1a7-403c-8560-f7bd785a7a43 req-682cac78-03b9-4776-be8f-3caf2cbcae02 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029055 Jul 21 22:39:11.706431 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1096/2320] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 21 22:39:11.807521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8d062e77-e3ac-4ce0-b2da-89914992676c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:11.808129 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8d062e77-e3ac-4ce0-b2da-89914992676c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 5170db20-3d22-48b3-8ba2-3f989e80c362] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:11.814857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8d062e77-e3ac-4ce0-b2da-89914992676c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.814857 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8d062e77-e3ac-4ce0-b2da-89914992676c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.816104 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8d062e77-e3ac-4ce0-b2da-89914992676c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:11.816472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8d062e77-e3ac-4ce0-b2da-89914992676c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:11.831154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-8d062e77-e3ac-4ce0-b2da-89914992676c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] HTTP exception thrown: Instance 5170db20-3d22-48b3-8ba2-3f989e80c362 could not be found. Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8d062e77-e3ac-4ce0-b2da-89914992676c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Request method failure captured: Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 HTTP/1.1 Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2dV6Iw9YxPxnJki28zRc54Siom59VfJuexXrCizCLa9yMaaHXfcQIQJGhZzgPj-j3a_VFHkjOa95Vc5CLYsIV0C6DoaekcVbXRia-l8Ud9-NmrxVcTvHT_PNmM3gDG5Id1QIIYDUv1thhGlRSoZa0BZjgm9eVA3mtIekd5tdK8CVlmg Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: ef7039f35fa747d2bfceabbf3374d475 Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-VolumesActionsTest-262030065 Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:39:11.833172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:39:11.834701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef7039f35fa747d2bfceabbf3374d475"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef7039f35fa747d2bfceabbf3374d475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ef7039f35fa747d2bfceabbf3374d475"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ef7039f35fa747d2bfceabbf3374d475", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:39:11.834701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-VolumesActionsTest-262030065 Jul 21 22:39:11.834701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: ef7039f35fa747d2bfceabbf3374d475 Jul 21 22:39:11.834701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-VolumesActionsTest-262030065 Jul 21 22:39:11.834701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-VolumesActionsTest-262030065-project Jul 21 22:39:11.834701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:39:11.834701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:39:11.834701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 620de5d224e742aeb49e0c61e767d2de Jul 21 22:39:11.834701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-VolumesActionsTest-262030065-project Jul 21 22:39:11.834701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:39:11.834701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 5170db20-3d22-48b3-8ba2-3f989e80c362 could not be found. Jul 21 22:39:11.834701 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '5170db20-3d22-48b3-8ba2-3f989e80c362'} Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5170db20-3d22-48b3-8ba2-3f989e80c362 could not be found. Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:11.835362 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5170db20-3d22-48b3-8ba2-3f989e80c362 could not be found. Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5170db20-3d22-48b3-8ba2-3f989e80c362 could not be found. Jul 21 22:39:11.836374 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:39:11.837214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8d062e77-e3ac-4ce0-b2da-89914992676c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Returning 404 to user: Instance 5170db20-3d22-48b3-8ba2-3f989e80c362 could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:11.837214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8d062e77-e3ac-4ce0-b2da-89914992676c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362" status: 404 len: 111 microversion: 2.1 time: 0.032086 Jul 21 22:39:11.837214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1225/2321] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:11 2022] GET /compute/v2.1/servers/5170db20-3d22-48b3-8ba2-3f989e80c362 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:39:11.942349 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-220283653", "imageRef": "a5f064d2-a110-4349-8c0e-c6a9918b5434", "flavorRef": "452", "networks": [{"uuid": "a258c959-cec9-4efa-ad54-07ccbf3cec66"}]}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:11.995705 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] validate_networks() for [('a258c959-cec9-4efa-ad54-07ccbf3cec66', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:39:12.075869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1dad9ace-ea03-4900-b3ef-0ec3896b00a9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:12.076485 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1dad9ace-ea03-4900-b3ef-0ec3896b00a9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:12.083184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1dad9ace-ea03-4900-b3ef-0ec3896b00a9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:12.083655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1dad9ace-ea03-4900-b3ef-0ec3896b00a9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:12.084743 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1dad9ace-ea03-4900-b3ef-0ec3896b00a9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:12.085201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1dad9ace-ea03-4900-b3ef-0ec3896b00a9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:12.323729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1dad9ace-ea03-4900-b3ef-0ec3896b00a9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:12.332307 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1dad9ace-ea03-4900-b3ef-0ec3896b00a9 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1519 microversion: 2.1 time: 0.260225 Jul 21 22:39:12.332896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1226/2322] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:12 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:39:12.706521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:39:12.706960 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:39:12.707504 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:39:12.708076 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:39:12.708499 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:39:12.719246 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:12.719821 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:12.721023 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:12.722066 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:12.741514 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Getting quotas for project ef7039f35fa747d2bfceabbf3374d475. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:39:12.745640 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Getting quotas for user 620de5d224e742aeb49e0c61e767d2de and project ef7039f35fa747d2bfceabbf3374d475. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:39:12.758567 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:39:12.760917 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a5f064d2-a110-4349-8c0e-c6a9918b5434',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:39:12.816393 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5700c9f6-4b82-4f06-b47d-4aae255eb09b tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877802 Jul 21 22:39:12.816873 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1097/2323] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 22:39:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:39:12.826886 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5e93ca43-f38f-4f9f-86fb-08c6acce0659 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:12.828071 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5e93ca43-f38f-4f9f-86fb-08c6acce0659 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:12.942221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5e93ca43-f38f-4f9f-86fb-08c6acce0659 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:12.950830 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5e93ca43-f38f-4f9f-86fb-08c6acce0659 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1213 microversion: 2.1 time: 0.127642 Jul 21 22:39:12.951659 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1227/2324] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:12 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:13.353764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1fa5f1ee-3c54-4bce-9a91-2ba06cf2d5f0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:13.354392 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1fa5f1ee-3c54-4bce-9a91-2ba06cf2d5f0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:13.360739 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fa5f1ee-3c54-4bce-9a91-2ba06cf2d5f0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:13.361196 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fa5f1ee-3c54-4bce-9a91-2ba06cf2d5f0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:13.362587 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fa5f1ee-3c54-4bce-9a91-2ba06cf2d5f0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:13.363248 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fa5f1ee-3c54-4bce-9a91-2ba06cf2d5f0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:13.511197 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1fa5f1ee-3c54-4bce-9a91-2ba06cf2d5f0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:13.519591 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1fa5f1ee-3c54-4bce-9a91-2ba06cf2d5f0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.171336 Jul 21 22:39:13.520185 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1098/2325] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:13 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:13.968722 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b0a1442a-5476-4752-9576-910142ec443d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:13.969346 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b0a1442a-5476-4752-9576-910142ec443d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:13.977127 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0a1442a-5476-4752-9576-910142ec443d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:13.977585 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0a1442a-5476-4752-9576-910142ec443d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:13.978386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0a1442a-5476-4752-9576-910142ec443d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:13.978824 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b0a1442a-5476-4752-9576-910142ec443d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:14.048742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b0a1442a-5476-4752-9576-910142ec443d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:14.057322 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b0a1442a-5476-4752-9576-910142ec443d tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1265 microversion: 2.1 time: 0.092005 Jul 21 22:39:14.057828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1228/2326] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:13 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:14.537188 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-34cadd10-93a7-4de6-bfb9-707e8e7c46ce tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:14.537798 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-34cadd10-93a7-4de6-bfb9-707e8e7c46ce tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:14.544359 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34cadd10-93a7-4de6-bfb9-707e8e7c46ce tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:14.544839 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34cadd10-93a7-4de6-bfb9-707e8e7c46ce tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:14.545599 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34cadd10-93a7-4de6-bfb9-707e8e7c46ce tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:14.546040 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34cadd10-93a7-4de6-bfb9-707e8e7c46ce tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:14.772190 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-34cadd10-93a7-4de6-bfb9-707e8e7c46ce tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:14.780528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-34cadd10-93a7-4de6-bfb9-707e8e7c46ce tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.247689 Jul 21 22:39:14.781283 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1099/2327] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:14 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:15.075655 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-739ec4ee-d236-4f69-89bb-d2594983a7ac tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:15.076259 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-739ec4ee-d236-4f69-89bb-d2594983a7ac tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:15.083411 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-739ec4ee-d236-4f69-89bb-d2594983a7ac tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.083891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-739ec4ee-d236-4f69-89bb-d2594983a7ac tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.084907 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-739ec4ee-d236-4f69-89bb-d2594983a7ac tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.085339 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-739ec4ee-d236-4f69-89bb-d2594983a7ac tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.219330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-739ec4ee-d236-4f69-89bb-d2594983a7ac tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:15.227281 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-739ec4ee-d236-4f69-89bb-d2594983a7ac tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1313 microversion: 2.1 time: 0.155584 Jul 21 22:39:15.227846 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1229/2328] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:15 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:15.798695 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-271e63e8-d51f-4ef8-988e-b8a05497d6a0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:15.800504 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-271e63e8-d51f-4ef8-988e-b8a05497d6a0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:15.809581 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-271e63e8-d51f-4ef8-988e-b8a05497d6a0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.810051 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-271e63e8-d51f-4ef8-988e-b8a05497d6a0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:15.811388 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-271e63e8-d51f-4ef8-988e-b8a05497d6a0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:15.811835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-271e63e8-d51f-4ef8-988e-b8a05497d6a0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:16.074494 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-271e63e8-d51f-4ef8-988e-b8a05497d6a0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:16.083394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-271e63e8-d51f-4ef8-988e-b8a05497d6a0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.288922 Jul 21 22:39:16.084812 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1100/2329] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:15 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:16.247519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-92df1235-fd18-47cc-bc5c-f64b025f3638 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:16.248579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-92df1235-fd18-47cc-bc5c-f64b025f3638 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:16.256109 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92df1235-fd18-47cc-bc5c-f64b025f3638 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:16.256560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92df1235-fd18-47cc-bc5c-f64b025f3638 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:16.257330 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92df1235-fd18-47cc-bc5c-f64b025f3638 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:16.258018 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92df1235-fd18-47cc-bc5c-f64b025f3638 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:16.349835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-aba0ddda-768b-4a80-a026-96076b444923 req-b870c406-79cd-4710-98fe-fd1a935e4117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89cd5d08-28f0-436b-811c-03d0c745780e", "tag": "297a352d-3453-4628-b657-eb70d1244af7"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:16.358880 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-aba0ddda-768b-4a80-a026-96076b444923 req-b870c406-79cd-4710-98fe-fd1a935e4117 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:16.367120 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-aba0ddda-768b-4a80-a026-96076b444923 req-b870c406-79cd-4710-98fe-fd1a935e4117 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:16.373638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-aba0ddda-768b-4a80-a026-96076b444923 req-b870c406-79cd-4710-98fe-fd1a935e4117 service nova] Creating event network-changed:297a352d-3453-4628-b657-eb70d1244af7 for instance 89cd5d08-28f0-436b-811c-03d0c745780e on hv-cinder-82002 Jul 21 22:39:16.380014 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-aba0ddda-768b-4a80-a026-96076b444923 req-b870c406-79cd-4710-98fe-fd1a935e4117 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120561 Jul 21 22:39:16.380640 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1101/2330] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:39:16.539033 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-92df1235-fd18-47cc-bc5c-f64b025f3638 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:16.548760 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-92df1235-fd18-47cc-bc5c-f64b025f3638 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1313 microversion: 2.1 time: 0.308347 Jul 21 22:39:16.549948 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1230/2331] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:16 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:17.103532 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-83c6fa72-8391-4dd6-a39b-dd0e0bf80a1c tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:17.104231 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-83c6fa72-8391-4dd6-a39b-dd0e0bf80a1c tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:17.110463 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83c6fa72-8391-4dd6-a39b-dd0e0bf80a1c tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:17.110915 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83c6fa72-8391-4dd6-a39b-dd0e0bf80a1c tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:17.111778 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83c6fa72-8391-4dd6-a39b-dd0e0bf80a1c tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:17.112213 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83c6fa72-8391-4dd6-a39b-dd0e0bf80a1c tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:17.246136 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-83c6fa72-8391-4dd6-a39b-dd0e0bf80a1c tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:17.253892 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-83c6fa72-8391-4dd6-a39b-dd0e0bf80a1c tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.155273 Jul 21 22:39:17.254510 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1102/2332] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:17 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:17.566295 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6a3f56dc-300d-424b-b28a-cfc3dc247bef tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:17.566909 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6a3f56dc-300d-424b-b28a-cfc3dc247bef tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:17.573613 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a3f56dc-300d-424b-b28a-cfc3dc247bef tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:17.574073 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a3f56dc-300d-424b-b28a-cfc3dc247bef tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:17.574850 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a3f56dc-300d-424b-b28a-cfc3dc247bef tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:17.575321 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6a3f56dc-300d-424b-b28a-cfc3dc247bef tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:17.719908 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6a3f56dc-300d-424b-b28a-cfc3dc247bef tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:17.727624 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6a3f56dc-300d-424b-b28a-cfc3dc247bef tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1313 microversion: 2.1 time: 0.165578 Jul 21 22:39:17.728214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1231/2333] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:17 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:18.270835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-11fdfd62-f780-468b-90e1-bc604376b3de tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:18.271611 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-11fdfd62-f780-468b-90e1-bc604376b3de tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:18.278112 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-11fdfd62-f780-468b-90e1-bc604376b3de tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:18.278574 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-11fdfd62-f780-468b-90e1-bc604376b3de tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:18.279395 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-11fdfd62-f780-468b-90e1-bc604376b3de tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:18.279840 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-11fdfd62-f780-468b-90e1-bc604376b3de tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:18.428806 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-11fdfd62-f780-468b-90e1-bc604376b3de tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:18.437155 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-11fdfd62-f780-468b-90e1-bc604376b3de tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.170060 Jul 21 22:39:18.437886 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1103/2334] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:18 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:18.744518 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-76c78487-c0e9-48da-a9f8-9c5ef16553e9 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:18.745350 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-76c78487-c0e9-48da-a9f8-9c5ef16553e9 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:18.751901 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-76c78487-c0e9-48da-a9f8-9c5ef16553e9 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:18.752358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-76c78487-c0e9-48da-a9f8-9c5ef16553e9 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:18.753677 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-76c78487-c0e9-48da-a9f8-9c5ef16553e9 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:18.753677 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-76c78487-c0e9-48da-a9f8-9c5ef16553e9 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:18.890594 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-76c78487-c0e9-48da-a9f8-9c5ef16553e9 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:18.898559 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-76c78487-c0e9-48da-a9f8-9c5ef16553e9 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1313 microversion: 2.1 time: 0.157970 Jul 21 22:39:18.899155 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1232/2335] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:18 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:19.454266 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6b06b1d6-2f65-4aee-b39b-241e789b0e88 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:19.456937 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6b06b1d6-2f65-4aee-b39b-241e789b0e88 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:19.467600 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6b06b1d6-2f65-4aee-b39b-241e789b0e88 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:19.474209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6b06b1d6-2f65-4aee-b39b-241e789b0e88 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:19.475123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6b06b1d6-2f65-4aee-b39b-241e789b0e88 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:19.475716 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6b06b1d6-2f65-4aee-b39b-241e789b0e88 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:19.615320 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6b06b1d6-2f65-4aee-b39b-241e789b0e88 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:19.623223 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6b06b1d6-2f65-4aee-b39b-241e789b0e88 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.172815 Jul 21 22:39:19.635189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1104/2336] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:19 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:19.915686 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3474f002-9b5b-409f-8765-30d6648ee4bb tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:19.916298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3474f002-9b5b-409f-8765-30d6648ee4bb tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:19.923174 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3474f002-9b5b-409f-8765-30d6648ee4bb tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:19.923686 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3474f002-9b5b-409f-8765-30d6648ee4bb tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:19.924968 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3474f002-9b5b-409f-8765-30d6648ee4bb tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:19.925404 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3474f002-9b5b-409f-8765-30d6648ee4bb tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:20.060411 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3474f002-9b5b-409f-8765-30d6648ee4bb tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:20.067777 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3474f002-9b5b-409f-8765-30d6648ee4bb tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1313 microversion: 2.1 time: 0.156333 Jul 21 22:39:20.068341 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1233/2337] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:19 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:20.641149 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-634a35bd-a243-4b23-ae37-70f0ebc5576b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:20.641862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-634a35bd-a243-4b23-ae37-70f0ebc5576b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:20.649290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-634a35bd-a243-4b23-ae37-70f0ebc5576b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:20.649741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-634a35bd-a243-4b23-ae37-70f0ebc5576b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:20.650517 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-634a35bd-a243-4b23-ae37-70f0ebc5576b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:20.650957 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-634a35bd-a243-4b23-ae37-70f0ebc5576b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:20.782341 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-634a35bd-a243-4b23-ae37-70f0ebc5576b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:20.789820 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-634a35bd-a243-4b23-ae37-70f0ebc5576b tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.153277 Jul 21 22:39:20.790382 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1105/2338] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:20 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:21.084570 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-87ccd4f9-8fc9-4c8a-805d-04e2df368950 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:21.085106 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-87ccd4f9-8fc9-4c8a-805d-04e2df368950 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:21.091668 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-87ccd4f9-8fc9-4c8a-805d-04e2df368950 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:21.092122 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-87ccd4f9-8fc9-4c8a-805d-04e2df368950 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:21.092889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-87ccd4f9-8fc9-4c8a-805d-04e2df368950 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:21.093328 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-87ccd4f9-8fc9-4c8a-805d-04e2df368950 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:21.223515 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-87ccd4f9-8fc9-4c8a-805d-04e2df368950 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:21.230982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-87ccd4f9-8fc9-4c8a-805d-04e2df368950 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1313 microversion: 2.1 time: 0.150632 Jul 21 22:39:21.231558 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1234/2339] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:21 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:21.807321 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7c556eb6-6cbf-4177-be47-84f818483def tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:21.807998 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7c556eb6-6cbf-4177-be47-84f818483def tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:21.814824 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c556eb6-6cbf-4177-be47-84f818483def tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:21.815419 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c556eb6-6cbf-4177-be47-84f818483def tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:21.816321 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c556eb6-6cbf-4177-be47-84f818483def tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:21.816764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7c556eb6-6cbf-4177-be47-84f818483def tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:21.948858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-aba9c3be-732c-4099-95bd-66d0830529ed req-13ce3a62-2368-464a-b9d2-4ca1010e365c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cd5d08-28f0-436b-811c-03d0c745780e", "name": "network-vif-plugged", "status": "completed", "tag": "297a352d-3453-4628-b657-eb70d1244af7"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:21.956188 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7c556eb6-6cbf-4177-be47-84f818483def tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:21.957926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-aba9c3be-732c-4099-95bd-66d0830529ed req-13ce3a62-2368-464a-b9d2-4ca1010e365c service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:21.958386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-aba9c3be-732c-4099-95bd-66d0830529ed req-13ce3a62-2368-464a-b9d2-4ca1010e365c service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:21.965774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7c556eb6-6cbf-4177-be47-84f818483def tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.162503 Jul 21 22:39:21.966371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1106/2340] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:21 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:21.976427 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-aba9c3be-732c-4099-95bd-66d0830529ed req-13ce3a62-2368-464a-b9d2-4ca1010e365c service nova] Creating event network-vif-plugged:297a352d-3453-4628-b657-eb70d1244af7 for instance 89cd5d08-28f0-436b-811c-03d0c745780e on hv-cinder-82002 Jul 21 22:39:21.981628 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-aba9c3be-732c-4099-95bd-66d0830529ed req-13ce3a62-2368-464a-b9d2-4ca1010e365c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036886 Jul 21 22:39:21.982455 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1235/2341] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:39:22.247608 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b3eb63b1-a533-4e5d-8382-2b370042f5f2 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:22.248216 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b3eb63b1-a533-4e5d-8382-2b370042f5f2 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:22.254582 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3eb63b1-a533-4e5d-8382-2b370042f5f2 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:22.255114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3eb63b1-a533-4e5d-8382-2b370042f5f2 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:22.255963 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3eb63b1-a533-4e5d-8382-2b370042f5f2 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:22.256405 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3eb63b1-a533-4e5d-8382-2b370042f5f2 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:22.394936 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b3eb63b1-a533-4e5d-8382-2b370042f5f2 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:22.402334 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b3eb63b1-a533-4e5d-8382-2b370042f5f2 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1313 microversion: 2.1 time: 0.158532 Jul 21 22:39:22.402904 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1107/2342] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:22 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:22.983782 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ccb9bdd5-91c3-4dd3-a1ab-313f6c444b23 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:22.984480 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ccb9bdd5-91c3-4dd3-a1ab-313f6c444b23 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:22.987537 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=2 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:22.988227 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:22.993896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccb9bdd5-91c3-4dd3-a1ab-313f6c444b23 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:22.994347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccb9bdd5-91c3-4dd3-a1ab-313f6c444b23 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:22.995145 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccb9bdd5-91c3-4dd3-a1ab-313f6c444b23 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:22.995584 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ccb9bdd5-91c3-4dd3-a1ab-313f6c444b23 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:23.126251 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ccb9bdd5-91c3-4dd3-a1ab-313f6c444b23 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:23.133911 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ccb9bdd5-91c3-4dd3-a1ab-313f6c444b23 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.154351 Jul 21 22:39:23.134487 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1236/2343] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:22 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:23.419900 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a7a3a5cc-856e-411a-99b6-441693ea1634 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:23.420509 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a7a3a5cc-856e-411a-99b6-441693ea1634 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:23.422428 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:23.423108 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:23.424386 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:23.431939 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a7a3a5cc-856e-411a-99b6-441693ea1634 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:23.432389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a7a3a5cc-856e-411a-99b6-441693ea1634 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:23.433160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a7a3a5cc-856e-411a-99b6-441693ea1634 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:23.433594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a7a3a5cc-856e-411a-99b6-441693ea1634 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:23.569342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a7a3a5cc-856e-411a-99b6-441693ea1634 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:23.576823 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a7a3a5cc-856e-411a-99b6-441693ea1634 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1313 microversion: 2.1 time: 0.160755 Jul 21 22:39:23.577384 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1108/2344] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:23 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:24.153161 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f094780b-b031-46cc-820b-d93029fce33d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:24.153780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f094780b-b031-46cc-820b-d93029fce33d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:24.160700 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f094780b-b031-46cc-820b-d93029fce33d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:24.161184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f094780b-b031-46cc-820b-d93029fce33d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:24.161957 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f094780b-b031-46cc-820b-d93029fce33d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:24.162392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f094780b-b031-46cc-820b-d93029fce33d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:24.296294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f094780b-b031-46cc-820b-d93029fce33d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:24.303866 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f094780b-b031-46cc-820b-d93029fce33d tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.154724 Jul 21 22:39:24.304429 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1237/2345] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:24 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:24.594243 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e7b3b37a-31cd-4fe0-90c4-3a9b2ea3878c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:24.594854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e7b3b37a-31cd-4fe0-90c4-3a9b2ea3878c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:24.601552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e7b3b37a-31cd-4fe0-90c4-3a9b2ea3878c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:24.602027 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e7b3b37a-31cd-4fe0-90c4-3a9b2ea3878c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:24.602793 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e7b3b37a-31cd-4fe0-90c4-3a9b2ea3878c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:24.603264 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e7b3b37a-31cd-4fe0-90c4-3a9b2ea3878c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:24.815928 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e7b3b37a-31cd-4fe0-90c4-3a9b2ea3878c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:24.823491 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e7b3b37a-31cd-4fe0-90c4-3a9b2ea3878c tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1313 microversion: 2.1 time: 0.232929 Jul 21 22:39:24.824086 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1109/2346] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:24 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:25.320981 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-501db83b-c7b7-45c2-929c-dc4b1699bb62 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:25.321585 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-501db83b-c7b7-45c2-929c-dc4b1699bb62 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:25.328224 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-501db83b-c7b7-45c2-929c-dc4b1699bb62 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:25.328668 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-501db83b-c7b7-45c2-929c-dc4b1699bb62 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:25.329443 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-501db83b-c7b7-45c2-929c-dc4b1699bb62 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:25.329875 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-501db83b-c7b7-45c2-929c-dc4b1699bb62 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:25.467562 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-501db83b-c7b7-45c2-929c-dc4b1699bb62 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:25.475947 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-501db83b-c7b7-45c2-929c-dc4b1699bb62 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.158771 Jul 21 22:39:25.476519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1238/2347] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:25 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:25.840489 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0b472a5c-4b59-4029-84da-7712d996e923 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:25.841107 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0b472a5c-4b59-4029-84da-7712d996e923 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:25.847638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b472a5c-4b59-4029-84da-7712d996e923 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:25.848090 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b472a5c-4b59-4029-84da-7712d996e923 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:25.848859 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b472a5c-4b59-4029-84da-7712d996e923 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:25.849299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0b472a5c-4b59-4029-84da-7712d996e923 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:25.977416 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0b472a5c-4b59-4029-84da-7712d996e923 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:25.984819 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0b472a5c-4b59-4029-84da-7712d996e923 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1313 microversion: 2.1 time: 0.148182 Jul 21 22:39:25.985394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1110/2348] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:25 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:26.493134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-34146705-e6b1-4311-9082-368d2e908662 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:26.493746 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-34146705-e6b1-4311-9082-368d2e908662 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:26.500406 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-34146705-e6b1-4311-9082-368d2e908662 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:26.500854 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-34146705-e6b1-4311-9082-368d2e908662 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:26.502647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-34146705-e6b1-4311-9082-368d2e908662 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:26.503119 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-34146705-e6b1-4311-9082-368d2e908662 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:26.634696 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-34146705-e6b1-4311-9082-368d2e908662 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:26.642253 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-34146705-e6b1-4311-9082-368d2e908662 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.152969 Jul 21 22:39:26.642821 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1239/2349] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:26 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:27.001544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-825b4189-4993-4873-bde0-06e712dfc5a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:27.002179 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-825b4189-4993-4873-bde0-06e712dfc5a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:27.009594 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-825b4189-4993-4873-bde0-06e712dfc5a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:27.010043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-825b4189-4993-4873-bde0-06e712dfc5a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:27.010817 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-825b4189-4993-4873-bde0-06e712dfc5a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:27.011274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-825b4189-4993-4873-bde0-06e712dfc5a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:27.015424 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:27.152158 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-825b4189-4993-4873-bde0-06e712dfc5a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:27.159552 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-825b4189-4993-4873-bde0-06e712dfc5a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1313 microversion: 2.1 time: 0.161869 Jul 21 22:39:27.160128 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1111/2350] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:26 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:27.659778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-49ace902-1c72-44ea-98da-0b21b1faa796 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:27.660389 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-49ace902-1c72-44ea-98da-0b21b1faa796 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:27.666849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49ace902-1c72-44ea-98da-0b21b1faa796 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:27.667329 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49ace902-1c72-44ea-98da-0b21b1faa796 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:27.668095 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49ace902-1c72-44ea-98da-0b21b1faa796 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:27.668529 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-49ace902-1c72-44ea-98da-0b21b1faa796 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:27.672517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=100 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:39:27.887407 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-49ace902-1c72-44ea-98da-0b21b1faa796 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:27.894901 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-49ace902-1c72-44ea-98da-0b21b1faa796 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.239673 Jul 21 22:39:27.895521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1240/2351] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:27 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:28.176730 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7fb13316-7480-4309-a45a-204f43ba64a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:28.177371 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7fb13316-7480-4309-a45a-204f43ba64a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:28.184075 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7fb13316-7480-4309-a45a-204f43ba64a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:28.184525 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7fb13316-7480-4309-a45a-204f43ba64a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:28.185286 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7fb13316-7480-4309-a45a-204f43ba64a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:28.185721 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7fb13316-7480-4309-a45a-204f43ba64a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:28.315067 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7fb13316-7480-4309-a45a-204f43ba64a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:28.323259 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7fb13316-7480-4309-a45a-204f43ba64a6 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1313 microversion: 2.1 time: 0.150928 Jul 21 22:39:28.323949 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1112/2352] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:28 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:28.398625 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-2d895527-5450-4b5a-836c-e065eb801ec3 req-90bf56ef-c7f7-4bdb-b136-66728a4a594a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1916df-b8fd-41d0-9cbc-58bacf7829a8", "name": "network-vif-plugged", "status": "completed", "tag": "3b993736-2118-44f5-8d06-3196623a542e"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:28.408472 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-2d895527-5450-4b5a-836c-e065eb801ec3 req-90bf56ef-c7f7-4bdb-b136-66728a4a594a service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:28.409544 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-2d895527-5450-4b5a-836c-e065eb801ec3 req-90bf56ef-c7f7-4bdb-b136-66728a4a594a service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:28.420983 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-2d895527-5450-4b5a-836c-e065eb801ec3 req-90bf56ef-c7f7-4bdb-b136-66728a4a594a service nova] Creating event network-vif-plugged:3b993736-2118-44f5-8d06-3196623a542e for instance 4e1916df-b8fd-41d0-9cbc-58bacf7829a8 on hv-cinder-82002 Jul 21 22:39:28.426059 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-2d895527-5450-4b5a-836c-e065eb801ec3 req-90bf56ef-c7f7-4bdb-b136-66728a4a594a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031148 Jul 21 22:39:28.426650 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1241/2353] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:39:28.911784 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f532b778-e575-4654-bee1-846a6a01e7d7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:28.912398 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f532b778-e575-4654-bee1-846a6a01e7d7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:28.918601 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f532b778-e575-4654-bee1-846a6a01e7d7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:28.919078 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f532b778-e575-4654-bee1-846a6a01e7d7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:28.919849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f532b778-e575-4654-bee1-846a6a01e7d7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:28.920285 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f532b778-e575-4654-bee1-846a6a01e7d7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:29.082284 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f532b778-e575-4654-bee1-846a6a01e7d7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:29.090317 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f532b778-e575-4654-bee1-846a6a01e7d7 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.182404 Jul 21 22:39:29.090918 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1113/2354] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:28 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:29.341385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6f42b882-0370-42f5-a9e9-ebcbebe57ab7 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:29.342208 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6f42b882-0370-42f5-a9e9-ebcbebe57ab7 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:29.349502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f42b882-0370-42f5-a9e9-ebcbebe57ab7 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:29.349959 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f42b882-0370-42f5-a9e9-ebcbebe57ab7 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:29.350729 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f42b882-0370-42f5-a9e9-ebcbebe57ab7 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:29.351289 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6f42b882-0370-42f5-a9e9-ebcbebe57ab7 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:29.483094 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6f42b882-0370-42f5-a9e9-ebcbebe57ab7 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:29.490746 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6f42b882-0370-42f5-a9e9-ebcbebe57ab7 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1496 microversion: 2.1 time: 0.153595 Jul 21 22:39:29.491390 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1242/2355] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:29 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1496 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:30.086881 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e8dd1070-51b4-456e-8312-c74b9f6084b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:30.087417 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e8dd1070-51b4-456e-8312-c74b9f6084b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:30.093854 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8dd1070-51b4-456e-8312-c74b9f6084b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:30.094297 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8dd1070-51b4-456e-8312-c74b9f6084b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:30.095814 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8dd1070-51b4-456e-8312-c74b9f6084b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:30.096264 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8dd1070-51b4-456e-8312-c74b9f6084b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:30.107868 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-92e48c6c-2a25-4f3c-a930-d509dbcc01b5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:30.108660 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-92e48c6c-2a25-4f3c-a930-d509dbcc01b5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:30.115720 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92e48c6c-2a25-4f3c-a930-d509dbcc01b5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:30.116175 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92e48c6c-2a25-4f3c-a930-d509dbcc01b5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:30.116986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92e48c6c-2a25-4f3c-a930-d509dbcc01b5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:30.117420 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-92e48c6c-2a25-4f3c-a930-d509dbcc01b5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:30.129210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e8dd1070-51b4-456e-8312-c74b9f6084b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:39:30.208839 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e8dd1070-51b4-456e-8312-c74b9f6084b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 204 len: 0 microversion: 2.1 time: 0.125554 Jul 21 22:39:30.209868 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1114/2356] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:39:30 2022] DELETE /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:39:30.219074 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a46eca4d-d3ee-4f1f-82bb-9c2c94fdb8b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:30.219863 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a46eca4d-d3ee-4f1f-82bb-9c2c94fdb8b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:30.226683 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a46eca4d-d3ee-4f1f-82bb-9c2c94fdb8b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:30.227303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a46eca4d-d3ee-4f1f-82bb-9c2c94fdb8b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:30.228178 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a46eca4d-d3ee-4f1f-82bb-9c2c94fdb8b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:30.228955 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a46eca4d-d3ee-4f1f-82bb-9c2c94fdb8b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:30.283167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-92e48c6c-2a25-4f3c-a930-d509dbcc01b5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:30.290952 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-92e48c6c-2a25-4f3c-a930-d509dbcc01b5 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.187825 Jul 21 22:39:30.291838 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1243/2357] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:30 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:39:30.373469 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a46eca4d-d3ee-4f1f-82bb-9c2c94fdb8b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:30.381781 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a46eca4d-d3ee-4f1f-82bb-9c2c94fdb8b8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1502 microversion: 2.1 time: 0.167370 Jul 21 22:39:30.382353 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1115/2358] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:30 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:31.307524 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b12e2628-2e5f-43d8-bfb2-dde90263d0b0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:31.308146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b12e2628-2e5f-43d8-bfb2-dde90263d0b0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:31.314662 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b12e2628-2e5f-43d8-bfb2-dde90263d0b0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:31.315180 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b12e2628-2e5f-43d8-bfb2-dde90263d0b0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:31.315958 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b12e2628-2e5f-43d8-bfb2-dde90263d0b0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:31.316402 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b12e2628-2e5f-43d8-bfb2-dde90263d0b0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:31.399172 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-08e11ed2-5776-42da-b39a-575b4b1beb48 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:31.399790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-08e11ed2-5776-42da-b39a-575b4b1beb48 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:31.406829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08e11ed2-5776-42da-b39a-575b4b1beb48 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:31.407315 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08e11ed2-5776-42da-b39a-575b4b1beb48 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:31.408849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08e11ed2-5776-42da-b39a-575b4b1beb48 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:31.409295 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08e11ed2-5776-42da-b39a-575b4b1beb48 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:31.457462 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b12e2628-2e5f-43d8-bfb2-dde90263d0b0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:31.465842 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b12e2628-2e5f-43d8-bfb2-dde90263d0b0 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1575 microversion: 2.1 time: 0.162157 Jul 21 22:39:31.466641 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1244/2359] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:31 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:31.546238 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-08e11ed2-5776-42da-b39a-575b4b1beb48 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:31.553974 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-08e11ed2-5776-42da-b39a-575b4b1beb48 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1502 microversion: 2.1 time: 0.158871 Jul 21 22:39:31.554577 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1116/2360] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:31 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:39:32.483480 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1bc0e1d0-37d0-458a-b673-0dbebfcbd880 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:32.484155 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1bc0e1d0-37d0-458a-b673-0dbebfcbd880 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:32.490499 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1bc0e1d0-37d0-458a-b673-0dbebfcbd880 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:32.490952 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1bc0e1d0-37d0-458a-b673-0dbebfcbd880 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:32.491754 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1bc0e1d0-37d0-458a-b673-0dbebfcbd880 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:32.492194 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1bc0e1d0-37d0-458a-b673-0dbebfcbd880 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:32.570891 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2368bb58-83a7-4d81-915e-c18de1622bb0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:32.571539 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2368bb58-83a7-4d81-915e-c18de1622bb0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:32.578445 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2368bb58-83a7-4d81-915e-c18de1622bb0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:32.578897 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2368bb58-83a7-4d81-915e-c18de1622bb0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:32.580274 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2368bb58-83a7-4d81-915e-c18de1622bb0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:32.580720 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2368bb58-83a7-4d81-915e-c18de1622bb0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:33.027896 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1bc0e1d0-37d0-458a-b673-0dbebfcbd880 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:33.033208 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2368bb58-83a7-4d81-915e-c18de1622bb0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620de5d224e742aeb49e0c61e767d2de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7039f35fa747d2bfceabbf3374d475', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:39:33.037662 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1bc0e1d0-37d0-458a-b673-0dbebfcbd880 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1562 microversion: 2.1 time: 0.557946 Jul 21 22:39:33.038331 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1245/2361] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:32 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1562 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:39:33.045060 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2368bb58-83a7-4d81-915e-c18de1622bb0 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 200 len: 1502 microversion: 2.1 time: 0.478017 Jul 21 22:39:33.045800 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1117/2362] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:32 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 1502 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:39:33.372940 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-0c8e681a-b913-441f-a0ee-63d672d58c8a req-0b016354-5194-4a4d-9f92-49995629717c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89cd5d08-28f0-436b-811c-03d0c745780e", "name": "network-vif-deleted", "tag": "297a352d-3453-4628-b657-eb70d1244af7"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:39:33.382691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-0c8e681a-b913-441f-a0ee-63d672d58c8a req-0b016354-5194-4a4d-9f92-49995629717c service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:33.383168 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-0c8e681a-b913-441f-a0ee-63d672d58c8a req-0b016354-5194-4a4d-9f92-49995629717c service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:33.394858 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-0c8e681a-b913-441f-a0ee-63d672d58c8a req-0b016354-5194-4a4d-9f92-49995629717c service nova] Creating event network-vif-deleted:297a352d-3453-4628-b657-eb70d1244af7 for instance 89cd5d08-28f0-436b-811c-03d0c745780e on hv-cinder-82002 Jul 21 22:39:33.400458 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-0c8e681a-b913-441f-a0ee-63d672d58c8a req-0b016354-5194-4a4d-9f92-49995629717c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030763 Jul 21 22:39:33.401283 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1246/2363] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:39:34.061688 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ac94ea44-4cd1-40e9-9fef-c1e2ca658fb8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:39:34.062207 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ac94ea44-4cd1-40e9-9fef-c1e2ca658fb8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] [instance: 89cd5d08-28f0-436b-811c-03d0c745780e] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:39:34.069404 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac94ea44-4cd1-40e9-9fef-c1e2ca658fb8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:34.069857 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac94ea44-4cd1-40e9-9fef-c1e2ca658fb8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:34.070627 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac94ea44-4cd1-40e9-9fef-c1e2ca658fb8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:39:34.071110 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac94ea44-4cd1-40e9-9fef-c1e2ca658fb8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:39:34.085128 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-ac94ea44-4cd1-40e9-9fef-c1e2ca658fb8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] HTTP exception thrown: Instance 89cd5d08-28f0-436b-811c-03d0c745780e could not be found. Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ac94ea44-4cd1-40e9-9fef-c1e2ca658fb8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Request method failure captured: Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e HTTP/1.1 Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept: application/json Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Connection: close Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Host: 10.222.0.44 Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABi2dV6Iw9YxPxnJki28zRc54Siom59VfJuexXrCizCLa9yMaaHXfcQIQJGhZzgPj-j3a_VFHkjOa95Vc5CLYsIV0C6DoaekcVbXRia-l8Ud9-NmrxVcTvHT_PNmM3gDG5Id1QIIYDUv1thhGlRSoZa0BZjgm9eVA3mtIekd5tdK8CVlmg Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Id: ef7039f35fa747d2bfceabbf3374d475 Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesActionsTest-262030065 Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jul 21 22:39:34.086767 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jul 21 22:39:34.087931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef7039f35fa747d2bfceabbf3374d475"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/ef7039f35fa747d2bfceabbf3374d475"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/ef7039f35fa747d2bfceabbf3374d475"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_ef7039f35fa747d2bfceabbf3374d475", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:39:34.087931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesActionsTest-262030065 Jul 21 22:39:34.087931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Id: ef7039f35fa747d2bfceabbf3374d475 Jul 21 22:39:34.087931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesActionsTest-262030065 Jul 21 22:39:34.087931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesActionsTest-262030065-project Jul 21 22:39:34.087931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jul 21 22:39:34.087931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jul 21 22:39:34.087931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Id: 620de5d224e742aeb49e0c61e767d2de Jul 21 22:39:34.087931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesActionsTest-262030065-project Jul 21 22:39:34.087931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: method: > Jul 21 22:39:34.087931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: exception: Instance 89cd5d08-28f0-436b-811c-03d0c745780e could not be found. Jul 21 22:39:34.087931 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: action_args: {'id': '89cd5d08-28f0-436b-811c-03d0c745780e'} Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89cd5d08-28f0-436b-811c-03d0c745780e could not be found. Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:39:34.088529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89cd5d08-28f0-436b-811c-03d0c745780e could not be found. Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89cd5d08-28f0-436b-811c-03d0c745780e could not be found. Jul 21 22:39:34.089477 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jul 21 22:39:34.090554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ac94ea44-4cd1-40e9-9fef-c1e2ca658fb8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] Returning 404 to user: Instance 89cd5d08-28f0-436b-811c-03d0c745780e could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:39:34.090554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ac94ea44-4cd1-40e9-9fef-c1e2ca658fb8 tempest-VolumesActionsTest-262030065 tempest-VolumesActionsTest-262030065-project] 10.222.0.44 "GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e" status: 404 len: 111 microversion: 2.1 time: 0.030415 Jul 21 22:39:34.090554 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1118/2364] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:39:34 2022] GET /compute/v2.1/servers/89cd5d08-28f0-436b-811c-03d0c745780e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:40:39.589198 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:40:39.589865 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:40:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:40:59.672673 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:40:59.673228 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:40:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:41:31.850431 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:31.853334 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=21 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:31.855842 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=32 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:31.856275 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:31.866841 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ab08f93b-9785-4873-8f62-c51e34402878 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:31.867479 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-442bbf6a-38a5-4ed1-b424-c075127b8535 req-3adb24ca-2352-4e14-8d4f-c0e5ab334e28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1916df-b8fd-41d0-9cbc-58bacf7829a8", "tag": "3b993736-2118-44f5-8d06-3196623a542e"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:31.872626 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ab08f93b-9785-4873-8f62-c51e34402878 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:31.886126 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ab08f93b-9785-4873-8f62-c51e34402878 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:31.888938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-442bbf6a-38a5-4ed1-b424-c075127b8535 req-3adb24ca-2352-4e14-8d4f-c0e5ab334e28 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:31.889652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ab08f93b-9785-4873-8f62-c51e34402878 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:31.890789 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ab08f93b-9785-4873-8f62-c51e34402878 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:31.891409 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ab08f93b-9785-4873-8f62-c51e34402878 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:31.892987 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-442bbf6a-38a5-4ed1-b424-c075127b8535 req-3adb24ca-2352-4e14-8d4f-c0e5ab334e28 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:31.924918 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-442bbf6a-38a5-4ed1-b424-c075127b8535 req-3adb24ca-2352-4e14-8d4f-c0e5ab334e28 service nova] Creating event network-changed:3b993736-2118-44f5-8d06-3196623a542e for instance 4e1916df-b8fd-41d0-9cbc-58bacf7829a8 on hv-cinder-82002 Jul 21 22:41:31.935474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-442bbf6a-38a5-4ed1-b424-c075127b8535 req-3adb24ca-2352-4e14-8d4f-c0e5ab334e28 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086491 Jul 21 22:41:31.939095 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1119/2365] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:31.950938 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ab08f93b-9785-4873-8f62-c51e34402878 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Going to try to terminate instance {{(pid=117979) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:41:32.084539 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ab08f93b-9785-4873-8f62-c51e34402878 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 204 len: 0 microversion: 2.1 time: 0.236003 Jul 21 22:41:32.085148 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1247/2366] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:41:31 2022] DELETE /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:41:32.094319 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e310f946-d0bf-4ce3-9f6e-9c398d187b50 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:32.095359 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e310f946-d0bf-4ce3-9f6e-9c398d187b50 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:32.103883 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e310f946-d0bf-4ce3-9f6e-9c398d187b50 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:32.104642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e310f946-d0bf-4ce3-9f6e-9c398d187b50 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:32.105697 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e310f946-d0bf-4ce3-9f6e-9c398d187b50 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:32.106155 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e310f946-d0bf-4ce3-9f6e-9c398d187b50 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:32.261938 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e310f946-d0bf-4ce3-9f6e-9c398d187b50 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:32.277811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e310f946-d0bf-4ce3-9f6e-9c398d187b50 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.187862 Jul 21 22:41:32.278153 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1120/2367] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:32 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:33.120425 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-2996783a-ac58-4331-8fa5-7a7c08b96634 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Action: 'create', calling method: .version_select at 0x7faca27590d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1605554493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTIEpsjWLOwdJGZPJDrTANdWHWYA2VGOY8bkl71ETvSvoXfiSfMN9G2CFUH8j8VnIhdGOelz+RuZfXiby9zTDoaS7Kokb3WPLhpsYHltC70ykjpL9V5VpwPn+43tbj9+A=="}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:33.137949 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-2996783a-ac58-4331-8fa5-7a7c08b96634 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Getting quotas for project 8713d695f460424cba952ad580aa2720. Resources: {'key_pairs'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:41:33.144742 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.quota [None req-2996783a-ac58-4331-8fa5-7a7c08b96634 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Getting quotas for user 9dbb287bb33740a2a08dcd76d156729f and project 8713d695f460424cba952ad580aa2720. Resources: {'key_pairs'} {{(pid=117979) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:41:33.172575 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-2996783a-ac58-4331-8fa5-7a7c08b96634 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056962 Jul 21 22:41:33.179745 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1248/2368] 10.222.0.44 () {60 vars in 1158 bytes} [Thu Jul 21 22:41:33 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:41:33.221924 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-9124619", "imageRef": "891de48a-f258-41e1-8c0a-64635bb1eb88", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1605554493", "networks": [{"uuid": "a6c5b594-8836-4834-a1c6-595ccbff7449"}]}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:33.277977 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] validate_networks() for [('a6c5b594-8836-4834-a1c6-595ccbff7449', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 21 22:41:33.293967 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3678ea4c-ce35-495f-9c1a-427412098bba tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:33.294706 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3678ea4c-ce35-495f-9c1a-427412098bba tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:33.301817 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3678ea4c-ce35-495f-9c1a-427412098bba tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:33.302277 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3678ea4c-ce35-495f-9c1a-427412098bba tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:33.303078 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3678ea4c-ce35-495f-9c1a-427412098bba tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:33.303571 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3678ea4c-ce35-495f-9c1a-427412098bba tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:33.548196 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3678ea4c-ce35-495f-9c1a-427412098bba tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:33.555885 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3678ea4c-ce35-495f-9c1a-427412098bba tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1568 microversion: 2.1 time: 0.265749 Jul 21 22:41:33.556476 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1249/2369] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:33 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:33.874432 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 21 22:41:33.874860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 21 22:41:33.875375 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 21 22:41:33.875786 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 21 22:41:33.876198 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 21 22:41:33.884906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:33.885359 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:33.886160 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:33.886598 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:33.903440 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Getting quotas for project 8713d695f460424cba952ad580aa2720. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 21 22:41:33.907387 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Getting quotas for user 9dbb287bb33740a2a08dcd76d156729f and project 8713d695f460424cba952ad580aa2720. Resources: {'ram', 'cores', 'instances'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 21 22:41:33.918702 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 21 22:41:33.920935 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='891de48a-f258-41e1-8c0a-64635bb1eb88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 21 22:41:33.966644 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7b09cb4b-4446-49eb-b0d7-2fbf71537995 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748432 Jul 21 22:41:33.967342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1121/2370] 10.222.0.44 () {60 vars in 1146 bytes} [Thu Jul 21 22:41:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 21 22:41:33.977595 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5c4b3619-ccc3-4ca6-aa66-6fc237d24d47 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:33.978201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5c4b3619-ccc3-4ca6-aa66-6fc237d24d47 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:34.031301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-5c4b3619-ccc3-4ca6-aa66-6fc237d24d47 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:34.038508 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5c4b3619-ccc3-4ca6-aa66-6fc237d24d47 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1256 microversion: 2.1 time: 0.064634 Jul 21 22:41:34.039347 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1250/2371] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:33 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1256 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:34.574303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4247a96d-d246-424c-a11b-46c59c35e3dc tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:34.574929 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4247a96d-d246-424c-a11b-46c59c35e3dc tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:34.581580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4247a96d-d246-424c-a11b-46c59c35e3dc tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:34.582039 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4247a96d-d246-424c-a11b-46c59c35e3dc tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:34.582825 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4247a96d-d246-424c-a11b-46c59c35e3dc tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:34.583474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4247a96d-d246-424c-a11b-46c59c35e3dc tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:34.656511 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4247a96d-d246-424c-a11b-46c59c35e3dc tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15235d71dee14765aeab75e8f487169b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe61021aacab4c0483f71c26b4955960', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:34.665010 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4247a96d-d246-424c-a11b-46c59c35e3dc tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 200 len: 1382 microversion: 2.1 time: 0.094696 Jul 21 22:41:34.665597 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1122/2372] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:34 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 1382 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:34.675085 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-c432cb1a-14f7-4320-b099-21ff748e3fea req-9a303f9e-ee42-478b-bb60-4ecc25c924fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1916df-b8fd-41d0-9cbc-58bacf7829a8", "name": "network-vif-deleted", "tag": "3b993736-2118-44f5-8d06-3196623a542e"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:34.686684 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-c432cb1a-14f7-4320-b099-21ff748e3fea req-9a303f9e-ee42-478b-bb60-4ecc25c924fb service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:34.687159 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-c432cb1a-14f7-4320-b099-21ff748e3fea req-9a303f9e-ee42-478b-bb60-4ecc25c924fb service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:34.699418 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-c432cb1a-14f7-4320-b099-21ff748e3fea req-9a303f9e-ee42-478b-bb60-4ecc25c924fb service nova] Creating event network-vif-deleted:3b993736-2118-44f5-8d06-3196623a542e for instance 4e1916df-b8fd-41d0-9cbc-58bacf7829a8 on hv-cinder-82002 Jul 21 22:41:34.704686 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-c432cb1a-14f7-4320-b099-21ff748e3fea req-9a303f9e-ee42-478b-bb60-4ecc25c924fb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033114 Jul 21 22:41:34.705607 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1251/2373] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:41:35.063867 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-75e74909-4a44-4d96-bef3-c854813c3942 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:35.065732 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-75e74909-4a44-4d96-bef3-c854813c3942 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:35.131137 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-75e74909-4a44-4d96-bef3-c854813c3942 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:35.138591 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-75e74909-4a44-4d96-bef3-c854813c3942 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1256 microversion: 2.1 time: 0.085664 Jul 21 22:41:35.139739 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1123/2374] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:35 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1256 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:35.683844 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c7b6541f-9d07-4ab5-9487-7dfeac952221 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:35.684534 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c7b6541f-9d07-4ab5-9487-7dfeac952221 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] [instance: 4e1916df-b8fd-41d0-9cbc-58bacf7829a8] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:35.691285 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c7b6541f-9d07-4ab5-9487-7dfeac952221 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:35.691732 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c7b6541f-9d07-4ab5-9487-7dfeac952221 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:35.692490 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c7b6541f-9d07-4ab5-9487-7dfeac952221 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:35.692925 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c7b6541f-9d07-4ab5-9487-7dfeac952221 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:35.706352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-c7b6541f-9d07-4ab5-9487-7dfeac952221 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] HTTP exception thrown: Instance 4e1916df-b8fd-41d0-9cbc-58bacf7829a8 could not be found. Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c7b6541f-9d07-4ab5-9487-7dfeac952221 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Request method failure captured: Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 HTTP/1.1 Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2dSyBo24QbjczndXncMrGBlBcT51K3HLViXhGEHVLrhueNm6S9pjj4zoozr0lotArnem6NUSu0kogO_fL-tAHA29YxYP2MCtHkDgY4k6i45rIRtaX2fGaRnuh2bF5sJSjN8nEwtKMo2i3We6bTnT_TY_RpBF7yc_J4rZeeZoTEpoy9g Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: fe61021aacab4c0483f71c26b4955960 Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-TestShelveInstance-1859106012 Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:41:35.707996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:41:35.709392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fe61021aacab4c0483f71c26b4955960"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fe61021aacab4c0483f71c26b4955960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fe61021aacab4c0483f71c26b4955960"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fe61021aacab4c0483f71c26b4955960", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:41:35.709392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-TestShelveInstance-1859106012 Jul 21 22:41:35.709392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: fe61021aacab4c0483f71c26b4955960 Jul 21 22:41:35.709392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-TestShelveInstance-1859106012 Jul 21 22:41:35.709392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-TestShelveInstance-1859106012-project Jul 21 22:41:35.709392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:41:35.709392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:41:35.709392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 15235d71dee14765aeab75e8f487169b Jul 21 22:41:35.709392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-TestShelveInstance-1859106012-project Jul 21 22:41:35.709392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:41:35.709392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 4e1916df-b8fd-41d0-9cbc-58bacf7829a8 could not be found. Jul 21 22:41:35.709392 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '4e1916df-b8fd-41d0-9cbc-58bacf7829a8'} Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1916df-b8fd-41d0-9cbc-58bacf7829a8 could not be found. Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:41:35.710531 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1916df-b8fd-41d0-9cbc-58bacf7829a8 could not be found. Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1916df-b8fd-41d0-9cbc-58bacf7829a8 could not be found. Jul 21 22:41:35.711950 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:41:35.713150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c7b6541f-9d07-4ab5-9487-7dfeac952221 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Returning 404 to user: Instance 4e1916df-b8fd-41d0-9cbc-58bacf7829a8 could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:41:35.713150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c7b6541f-9d07-4ab5-9487-7dfeac952221 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8" status: 404 len: 111 microversion: 2.1 time: 0.029728 Jul 21 22:41:35.713150 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1252/2375] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:35 2022] GET /compute/v2.1/servers/4e1916df-b8fd-41d0-9cbc-58bacf7829a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:41:35.868655 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c74a8937-ca80-479f-8932-2394a6e94676 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] Calling method '.version_select at 0x7faca1d47670>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:35.892130 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c74a8937-ca80-479f-8932-2394a6e94676 tempest-TestShelveInstance-1859106012 tempest-TestShelveInstance-1859106012-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1341804417" status: 202 len: 0 microversion: 2.1 time: 0.027741 Jul 21 22:41:35.896002 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1124/2376] 10.222.0.44 () {58 vars in 1253 bytes} [Thu Jul 21 22:41:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1341804417 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:41:36.156335 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-dccf8cf5-98da-4f54-a793-274d27ec703c tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:36.157039 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-dccf8cf5-98da-4f54-a793-274d27ec703c tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:36.232138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-dccf8cf5-98da-4f54-a793-274d27ec703c tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:36.239326 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-dccf8cf5-98da-4f54-a793-274d27ec703c tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1256 microversion: 2.1 time: 0.087024 Jul 21 22:41:36.239949 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1253/2377] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:36 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1256 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:37.257183 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-143074d4-77cd-4a83-9465-478d002cb3a1 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:37.258521 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-143074d4-77cd-4a83-9465-478d002cb3a1 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:37.319528 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-143074d4-77cd-4a83-9465-478d002cb3a1 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:37.326394 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-143074d4-77cd-4a83-9465-478d002cb3a1 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1256 microversion: 2.1 time: 0.073701 Jul 21 22:41:37.336811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1125/2378] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:37 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1256 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:38.343717 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9022c62d-b527-4bb5-bdee-70e92fe8e4ed tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:38.344333 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9022c62d-b527-4bb5-bdee-70e92fe8e4ed tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:38.351623 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9022c62d-b527-4bb5-bdee-70e92fe8e4ed tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:38.352134 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9022c62d-b527-4bb5-bdee-70e92fe8e4ed tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:38.352910 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9022c62d-b527-4bb5-bdee-70e92fe8e4ed tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:38.353344 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9022c62d-b527-4bb5-bdee-70e92fe8e4ed tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:38.445210 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9022c62d-b527-4bb5-bdee-70e92fe8e4ed tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:38.454352 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9022c62d-b527-4bb5-bdee-70e92fe8e4ed tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1260 microversion: 2.1 time: 0.114377 Jul 21 22:41:38.455461 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1254/2379] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:38 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1260 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:39.472874 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-accf688a-5efe-49ac-92ab-9ebc6b9cb01d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:39.474145 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-accf688a-5efe-49ac-92ab-9ebc6b9cb01d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:39.482625 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-accf688a-5efe-49ac-92ab-9ebc6b9cb01d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:39.483326 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-accf688a-5efe-49ac-92ab-9ebc6b9cb01d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:39.485061 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-accf688a-5efe-49ac-92ab-9ebc6b9cb01d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:39.485522 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-accf688a-5efe-49ac-92ab-9ebc6b9cb01d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:39.565005 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-accf688a-5efe-49ac-92ab-9ebc6b9cb01d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:39.574486 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-accf688a-5efe-49ac-92ab-9ebc6b9cb01d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1314 microversion: 2.1 time: 0.105485 Jul 21 22:41:39.575187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1126/2380] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:39 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1314 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:40.612012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-822546d8-7bbc-448d-b285-6b05fd9d3d33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:40.615226 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-822546d8-7bbc-448d-b285-6b05fd9d3d33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:40.635794 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-822546d8-7bbc-448d-b285-6b05fd9d3d33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:40.637732 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-822546d8-7bbc-448d-b285-6b05fd9d3d33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:40.638658 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-822546d8-7bbc-448d-b285-6b05fd9d3d33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:40.639324 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-822546d8-7bbc-448d-b285-6b05fd9d3d33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:40.820945 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-822546d8-7bbc-448d-b285-6b05fd9d3d33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:40.830980 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-822546d8-7bbc-448d-b285-6b05fd9d3d33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.242198 Jul 21 22:41:40.831535 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1255/2381] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:40 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:41.848642 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3d9aacf1-3a55-4653-b446-c3bb59b3e846 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:41.849273 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3d9aacf1-3a55-4653-b446-c3bb59b3e846 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:41.865979 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d9aacf1-3a55-4653-b446-c3bb59b3e846 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:41.872358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d9aacf1-3a55-4653-b446-c3bb59b3e846 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:41.874124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d9aacf1-3a55-4653-b446-c3bb59b3e846 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:41.875098 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d9aacf1-3a55-4653-b446-c3bb59b3e846 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:42.172828 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3d9aacf1-3a55-4653-b446-c3bb59b3e846 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:42.184904 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3d9aacf1-3a55-4653-b446-c3bb59b3e846 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.340734 Jul 21 22:41:42.185751 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1127/2382] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:41 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 21 22:41:43.210569 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-ef69b301-febc-4b4c-95b7-e90da26d28b7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:43.211268 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-ef69b301-febc-4b4c-95b7-e90da26d28b7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:43.227270 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ef69b301-febc-4b4c-95b7-e90da26d28b7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:43.232652 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ef69b301-febc-4b4c-95b7-e90da26d28b7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:43.233691 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ef69b301-febc-4b4c-95b7-e90da26d28b7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:43.234142 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-ef69b301-febc-4b4c-95b7-e90da26d28b7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:43.450138 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-ef69b301-febc-4b4c-95b7-e90da26d28b7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:43.475703 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-ef69b301-febc-4b4c-95b7-e90da26d28b7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.271814 Jul 21 22:41:43.477496 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1256/2383] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:43 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:44.495382 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2610ea3a-13c1-4f28-95e5-f4cccde1245f tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:44.496178 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2610ea3a-13c1-4f28-95e5-f4cccde1245f tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:44.499544 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:44.507682 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2610ea3a-13c1-4f28-95e5-f4cccde1245f tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:44.508437 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2610ea3a-13c1-4f28-95e5-f4cccde1245f tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:44.509399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2610ea3a-13c1-4f28-95e5-f4cccde1245f tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:44.515674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2610ea3a-13c1-4f28-95e5-f4cccde1245f tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:44.729082 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2610ea3a-13c1-4f28-95e5-f4cccde1245f tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:44.737357 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2610ea3a-13c1-4f28-95e5-f4cccde1245f tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.246008 Jul 21 22:41:44.737944 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1128/2384] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:44 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:45.755519 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-6bd7eb2f-c22d-438f-a51d-f21385135543 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:45.756301 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-6bd7eb2f-c22d-438f-a51d-f21385135543 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:45.763183 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6bd7eb2f-c22d-438f-a51d-f21385135543 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:45.763632 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6bd7eb2f-c22d-438f-a51d-f21385135543 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:45.764417 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6bd7eb2f-c22d-438f-a51d-f21385135543 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:45.764849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-6bd7eb2f-c22d-438f-a51d-f21385135543 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:45.908424 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-6bd7eb2f-c22d-438f-a51d-f21385135543 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:45.916555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-6bd7eb2f-c22d-438f-a51d-f21385135543 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.164835 Jul 21 22:41:45.925576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1257/2385] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:45 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:46.933187 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-79b9979f-835f-44b5-806c-a2f1763c7083 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:46.933829 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-79b9979f-835f-44b5-806c-a2f1763c7083 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:46.940643 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79b9979f-835f-44b5-806c-a2f1763c7083 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:46.941092 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79b9979f-835f-44b5-806c-a2f1763c7083 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:46.941975 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79b9979f-835f-44b5-806c-a2f1763c7083 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:46.942534 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79b9979f-835f-44b5-806c-a2f1763c7083 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:47.081878 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-79b9979f-835f-44b5-806c-a2f1763c7083 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:47.090807 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-79b9979f-835f-44b5-806c-a2f1763c7083 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.161502 Jul 21 22:41:47.091415 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1129/2386] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:46 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:48.107969 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f493b323-1299-4b8f-ab93-9e4500fd5912 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:48.108555 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f493b323-1299-4b8f-ab93-9e4500fd5912 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:48.110478 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell0:SELECT=8 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:48.117090 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f493b323-1299-4b8f-ab93-9e4500fd5912 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:48.117586 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f493b323-1299-4b8f-ab93-9e4500fd5912 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:48.118349 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f493b323-1299-4b8f-ab93-9e4500fd5912 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:48.118776 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f493b323-1299-4b8f-ab93-9e4500fd5912 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:48.251635 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f493b323-1299-4b8f-ab93-9e4500fd5912 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:48.259092 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f493b323-1299-4b8f-ab93-9e4500fd5912 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.155034 Jul 21 22:41:48.259658 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1258/2387] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:48 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:49.275257 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7376850e-bd23-45d3-b1b7-fb94092bd916 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:49.275870 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7376850e-bd23-45d3-b1b7-fb94092bd916 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:49.277706 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=10 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:41:49.283862 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7376850e-bd23-45d3-b1b7-fb94092bd916 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:49.284317 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7376850e-bd23-45d3-b1b7-fb94092bd916 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:49.285114 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7376850e-bd23-45d3-b1b7-fb94092bd916 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:49.285556 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7376850e-bd23-45d3-b1b7-fb94092bd916 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:49.413122 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7376850e-bd23-45d3-b1b7-fb94092bd916 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:49.421282 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7376850e-bd23-45d3-b1b7-fb94092bd916 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.149842 Jul 21 22:41:49.421851 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1130/2388] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:49 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:50.437889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1ab0d4d5-cca3-4c38-abf2-2ae239411911 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:50.438496 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1ab0d4d5-cca3-4c38-abf2-2ae239411911 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:50.446062 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1ab0d4d5-cca3-4c38-abf2-2ae239411911 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:50.446516 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1ab0d4d5-cca3-4c38-abf2-2ae239411911 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:50.447373 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1ab0d4d5-cca3-4c38-abf2-2ae239411911 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:50.447809 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1ab0d4d5-cca3-4c38-abf2-2ae239411911 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:50.606965 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1ab0d4d5-cca3-4c38-abf2-2ae239411911 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:50.614581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1ab0d4d5-cca3-4c38-abf2-2ae239411911 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.180594 Jul 21 22:41:50.615176 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1259/2389] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:50 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:51.631978 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-292e35e2-89fb-4ac5-ad44-8502aab5f624 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:51.633239 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-292e35e2-89fb-4ac5-ad44-8502aab5f624 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:51.640399 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-292e35e2-89fb-4ac5-ad44-8502aab5f624 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:51.640867 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-292e35e2-89fb-4ac5-ad44-8502aab5f624 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:51.641652 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-292e35e2-89fb-4ac5-ad44-8502aab5f624 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:51.642094 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-292e35e2-89fb-4ac5-ad44-8502aab5f624 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:51.772120 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-292e35e2-89fb-4ac5-ad44-8502aab5f624 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:51.782345 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-292e35e2-89fb-4ac5-ad44-8502aab5f624 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.154190 Jul 21 22:41:51.782919 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1131/2390] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:51 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:52.799221 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-8659ed2e-9e8f-4267-9d17-2ec49bb760a7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:52.799848 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-8659ed2e-9e8f-4267-9d17-2ec49bb760a7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:52.808663 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8659ed2e-9e8f-4267-9d17-2ec49bb760a7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:52.809125 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8659ed2e-9e8f-4267-9d17-2ec49bb760a7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:52.809924 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8659ed2e-9e8f-4267-9d17-2ec49bb760a7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:52.810366 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-8659ed2e-9e8f-4267-9d17-2ec49bb760a7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:52.958201 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-8659ed2e-9e8f-4267-9d17-2ec49bb760a7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:52.973210 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-69f82140-86da-4526-8eb1-33bd85e0f99b req-58f64a32-b865-4a06-907c-f2a223a5a210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1509b977-68c3-43b6-bc8b-d538c64abe10", "tag": "cd326164-dfd3-48d5-b9d3-d9af3ad152b1"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:52.979502 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-8659ed2e-9e8f-4267-9d17-2ec49bb760a7 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.184033 Jul 21 22:41:52.981313 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1260/2391] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:52 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:52.984686 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-69f82140-86da-4526-8eb1-33bd85e0f99b req-58f64a32-b865-4a06-907c-f2a223a5a210 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:52.985486 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-69f82140-86da-4526-8eb1-33bd85e0f99b req-58f64a32-b865-4a06-907c-f2a223a5a210 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:52.998487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-69f82140-86da-4526-8eb1-33bd85e0f99b req-58f64a32-b865-4a06-907c-f2a223a5a210 service nova] Creating event network-changed:cd326164-dfd3-48d5-b9d3-d9af3ad152b1 for instance 1509b977-68c3-43b6-bc8b-d538c64abe10 on hv-cinder-82002 Jul 21 22:41:53.008964 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-69f82140-86da-4526-8eb1-33bd85e0f99b req-58f64a32-b865-4a06-907c-f2a223a5a210 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039196 Jul 21 22:41:53.009590 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1132/2392] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:41:53.998280 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-62a9d2cb-67c0-4d83-8801-9c2bca9b8094 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:53.998884 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-62a9d2cb-67c0-4d83-8801-9c2bca9b8094 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:54.005442 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-62a9d2cb-67c0-4d83-8801-9c2bca9b8094 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:54.005891 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-62a9d2cb-67c0-4d83-8801-9c2bca9b8094 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:54.006661 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-62a9d2cb-67c0-4d83-8801-9c2bca9b8094 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:54.007154 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-62a9d2cb-67c0-4d83-8801-9c2bca9b8094 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:54.140077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-62a9d2cb-67c0-4d83-8801-9c2bca9b8094 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:54.148828 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-62a9d2cb-67c0-4d83-8801-9c2bca9b8094 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.153991 Jul 21 22:41:54.149456 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1261/2393] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:53 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:55.167331 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e676edfc-380d-446a-83ef-26cd7270875a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:55.168043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e676edfc-380d-446a-83ef-26cd7270875a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:55.174410 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e676edfc-380d-446a-83ef-26cd7270875a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:55.174866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e676edfc-380d-446a-83ef-26cd7270875a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:55.175670 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e676edfc-380d-446a-83ef-26cd7270875a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:55.176119 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e676edfc-380d-446a-83ef-26cd7270875a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:55.305043 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e676edfc-380d-446a-83ef-26cd7270875a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:55.312534 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e676edfc-380d-446a-83ef-26cd7270875a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.150660 Jul 21 22:41:55.313105 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1133/2394] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:55 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:56.329926 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c1980d2f-e005-494c-84f3-a0ebfed9c070 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:56.330484 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c1980d2f-e005-494c-84f3-a0ebfed9c070 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:56.337900 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1980d2f-e005-494c-84f3-a0ebfed9c070 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:56.338354 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1980d2f-e005-494c-84f3-a0ebfed9c070 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:56.339142 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1980d2f-e005-494c-84f3-a0ebfed9c070 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:56.339580 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c1980d2f-e005-494c-84f3-a0ebfed9c070 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:56.470096 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c1980d2f-e005-494c-84f3-a0ebfed9c070 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:56.477788 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c1980d2f-e005-494c-84f3-a0ebfed9c070 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.151828 Jul 21 22:41:56.478693 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1262/2395] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:56 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:57.495348 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1bd83b45-fa88-43cc-93b6-2906c624ef55 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:57.496219 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1bd83b45-fa88-43cc-93b6-2906c624ef55 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:57.502704 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bd83b45-fa88-43cc-93b6-2906c624ef55 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:57.503199 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bd83b45-fa88-43cc-93b6-2906c624ef55 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:57.503969 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bd83b45-fa88-43cc-93b6-2906c624ef55 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:57.504413 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bd83b45-fa88-43cc-93b6-2906c624ef55 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:57.632042 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1bd83b45-fa88-43cc-93b6-2906c624ef55 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:57.640677 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1bd83b45-fa88-43cc-93b6-2906c624ef55 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.149270 Jul 21 22:41:57.641255 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1134/2396] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:57 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:58.657956 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1837e996-536d-46a0-9c8c-2a70d8092818 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:58.658597 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1837e996-536d-46a0-9c8c-2a70d8092818 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:58.665756 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1837e996-536d-46a0-9c8c-2a70d8092818 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:58.666205 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1837e996-536d-46a0-9c8c-2a70d8092818 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:58.667410 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1837e996-536d-46a0-9c8c-2a70d8092818 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:58.667854 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1837e996-536d-46a0-9c8c-2a70d8092818 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:58.796073 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1837e996-536d-46a0-9c8c-2a70d8092818 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:58.803292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1837e996-536d-46a0-9c8c-2a70d8092818 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.149136 Jul 21 22:41:58.803851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1263/2397] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:58 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:41:59.821132 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d97a93c7-0535-4d9c-a173-e3699ae127bf tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:41:59.821737 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d97a93c7-0535-4d9c-a173-e3699ae127bf tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:41:59.828337 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d97a93c7-0535-4d9c-a173-e3699ae127bf tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:59.828794 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d97a93c7-0535-4d9c-a173-e3699ae127bf tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:59.829564 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d97a93c7-0535-4d9c-a173-e3699ae127bf tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:59.829998 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d97a93c7-0535-4d9c-a173-e3699ae127bf tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:59.839647 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-0b557c5b-078b-4a0f-8e15-7ea7bab97af8 req-9bba2083-79a5-4ab8-b148-dbe8a1dcf09e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1509b977-68c3-43b6-bc8b-d538c64abe10", "name": "network-vif-plugged", "status": "completed", "tag": "cd326164-dfd3-48d5-b9d3-d9af3ad152b1"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:41:59.850639 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-0b557c5b-078b-4a0f-8e15-7ea7bab97af8 req-9bba2083-79a5-4ab8-b148-dbe8a1dcf09e service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:41:59.852254 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-0b557c5b-078b-4a0f-8e15-7ea7bab97af8 req-9bba2083-79a5-4ab8-b148-dbe8a1dcf09e service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:41:59.865459 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-0b557c5b-078b-4a0f-8e15-7ea7bab97af8 req-9bba2083-79a5-4ab8-b148-dbe8a1dcf09e service nova] Creating event network-vif-plugged:cd326164-dfd3-48d5-b9d3-d9af3ad152b1 for instance 1509b977-68c3-43b6-bc8b-d538c64abe10 on hv-cinder-82002 Jul 21 22:41:59.871759 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-0b557c5b-078b-4a0f-8e15-7ea7bab97af8 req-9bba2083-79a5-4ab8-b148-dbe8a1dcf09e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036277 Jul 21 22:41:59.872976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1264/2398] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:41:59.975163 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d97a93c7-0535-4d9c-a173-e3699ae127bf tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:41:59.983517 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d97a93c7-0535-4d9c-a173-e3699ae127bf tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.166755 Jul 21 22:41:59.984103 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1135/2399] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:41:59 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:01.000761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9a00512a-2c07-4db6-afa2-fd47f90b28b5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:01.001473 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9a00512a-2c07-4db6-afa2-fd47f90b28b5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:01.008758 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a00512a-2c07-4db6-afa2-fd47f90b28b5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:01.009216 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a00512a-2c07-4db6-afa2-fd47f90b28b5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:01.009983 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a00512a-2c07-4db6-afa2-fd47f90b28b5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:01.010423 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9a00512a-2c07-4db6-afa2-fd47f90b28b5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:01.138265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-9a00512a-2c07-4db6-afa2-fd47f90b28b5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:01.145619 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9a00512a-2c07-4db6-afa2-fd47f90b28b5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1356 microversion: 2.1 time: 0.149179 Jul 21 22:42:01.146174 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1265/2400] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:00 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:02.162775 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2cefe9e7-4ad3-4025-b647-6632e76335ba tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:02.163439 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2cefe9e7-4ad3-4025-b647-6632e76335ba tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:02.165867 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:02.171326 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cefe9e7-4ad3-4025-b647-6632e76335ba tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.171788 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cefe9e7-4ad3-4025-b647-6632e76335ba tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.172565 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cefe9e7-4ad3-4025-b647-6632e76335ba tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.173004 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2cefe9e7-4ad3-4025-b647-6632e76335ba tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.178157 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=73 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:02.308242 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2cefe9e7-4ad3-4025-b647-6632e76335ba tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:02.317112 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2cefe9e7-4ad3-4025-b647-6632e76335ba tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1545 microversion: 2.1 time: 0.157518 Jul 21 22:42:02.317699 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1136/2401] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:02 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1545 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:02.333564 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-faa8d980-46d2-4d5a-a4c7-08ec4ec4558a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:02.334172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-faa8d980-46d2-4d5a-a4c7-08ec4ec4558a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:02.338648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:02.342549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-faa8d980-46d2-4d5a-a4c7-08ec4ec4558a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.343028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-faa8d980-46d2-4d5a-a4c7-08ec4ec4558a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.343774 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-faa8d980-46d2-4d5a-a4c7-08ec4ec4558a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.344206 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-faa8d980-46d2-4d5a-a4c7-08ec4ec4558a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.347579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:02.476599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-faa8d980-46d2-4d5a-a4c7-08ec4ec4558a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:02.485028 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-faa8d980-46d2-4d5a-a4c7-08ec4ec4558a tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1545 microversion: 2.1 time: 0.154852 Jul 21 22:42:02.496292 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1266/2402] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:02 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1545 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:02.500751 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9b68b5c9-941e-404c-9931-821545d66f7c tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:02.504280 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9b68b5c9-941e-404c-9931-821545d66f7c tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:02.505015 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9b68b5c9-941e-404c-9931-821545d66f7c tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Searching by: {'deleted': False, 'project_id': '8713d695f460424cba952ad580aa2720'} {{(pid=117978) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 21 22:42:02.512211 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9b68b5c9-941e-404c-9931-821545d66f7c tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.512667 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9b68b5c9-941e-404c-9931-821545d66f7c tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.513474 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9b68b5c9-941e-404c-9931-821545d66f7c tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.513923 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9b68b5c9-941e-404c-9931-821545d66f7c tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.605110 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.multi_cell_list [None req-9b68b5c9-941e-404c-9931-821545d66f7c tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117978) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 21 22:42:02.703758 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9b68b5c9-941e-404c-9931-821545d66f7c tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.206753 Jul 21 22:42:02.704358 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1137/2403] 10.222.0.44 () {58 vars in 1124 bytes} [Thu Jul 21 22:42:02 2022] GET /compute/v2.1/servers => generated 340 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:02.715204 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-3915faba-8228-460c-a3fd-77312c666247 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:02.715826 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-3915faba-8228-460c-a3fd-77312c666247 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:02.721970 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3915faba-8228-460c-a3fd-77312c666247 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.722428 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3915faba-8228-460c-a3fd-77312c666247 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.723247 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3915faba-8228-460c-a3fd-77312c666247 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:02.723692 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-3915faba-8228-460c-a3fd-77312c666247 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:02.850072 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-3915faba-8228-460c-a3fd-77312c666247 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:02.857511 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-3915faba-8228-460c-a3fd-77312c666247 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1545 microversion: 2.1 time: 0.146616 Jul 21 22:42:02.858075 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1267/2404] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:02 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1545 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:04.578433 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ce01c8d6-f2ff-4e03-b066-8c16398debef tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c067514d-a8a3-4ff8-9dfc-faf897140de5"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:42:04.579519 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ce01c8d6-f2ff-4e03-b066-8c16398debef tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:04.585942 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce01c8d6-f2ff-4e03-b066-8c16398debef tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.586391 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce01c8d6-f2ff-4e03-b066-8c16398debef tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.587435 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce01c8d6-f2ff-4e03-b066-8c16398debef tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:04.587873 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce01c8d6-f2ff-4e03-b066-8c16398debef tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:04.857055 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ce01c8d6-f2ff-4e03-b066-8c16398debef tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "POST /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282435 Jul 21 22:42:04.857772 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1138/2405] 10.222.0.44 () {60 vars in 1322 bytes} [Thu Jul 21 22:42:04 2022] POST /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:09.293849 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:42:09.294387 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:42:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:42:12.396644 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-7701a4be-80f8-4360-a3d5-f85ba4caa314 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:12.397234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-7701a4be-80f8-4360-a3d5-f85ba4caa314 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:12.404504 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7701a4be-80f8-4360-a3d5-f85ba4caa314 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:12.404951 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7701a4be-80f8-4360-a3d5-f85ba4caa314 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:12.405704 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7701a4be-80f8-4360-a3d5-f85ba4caa314 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:12.406135 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-7701a4be-80f8-4360-a3d5-f85ba4caa314 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:12.538012 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-7701a4be-80f8-4360-a3d5-f85ba4caa314 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:12.546073 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-7701a4be-80f8-4360-a3d5-f85ba4caa314 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1591 microversion: 2.1 time: 0.153197 Jul 21 22:42:12.546629 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1268/2406] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:12 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1591 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:14.596641 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:14.597395 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=5 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:42:14.602276 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-163633d5-ab06-473b-af1c-7ae2bd8b56d0 req-5cd0971d-e0fd-420c-9429-2e04ba801c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1509b977-68c3-43b6-bc8b-d538c64abe10", "tag": "cd326164-dfd3-48d5-b9d3-d9af3ad152b1"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:42:14.611492 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-163633d5-ab06-473b-af1c-7ae2bd8b56d0 req-5cd0971d-e0fd-420c-9429-2e04ba801c83 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:14.611943 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-163633d5-ab06-473b-af1c-7ae2bd8b56d0 req-5cd0971d-e0fd-420c-9429-2e04ba801c83 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:14.785502 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-163633d5-ab06-473b-af1c-7ae2bd8b56d0 req-5cd0971d-e0fd-420c-9429-2e04ba801c83 service nova] Creating event network-changed:cd326164-dfd3-48d5-b9d3-d9af3ad152b1 for instance 1509b977-68c3-43b6-bc8b-d538c64abe10 on hv-cinder-82002 Jul 21 22:42:14.798067 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-163633d5-ab06-473b-af1c-7ae2bd8b56d0 req-5cd0971d-e0fd-420c-9429-2e04ba801c83 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202668 Jul 21 22:42:14.798866 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1139/2407] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:42:15.635265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-9b8a609d-337b-467d-bcd8-27bbd2319ffb tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-966820280"}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:42:15.635823 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-9b8a609d-337b-467d-bcd8-27bbd2319ffb tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:15.642298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b8a609d-337b-467d-bcd8-27bbd2319ffb tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:15.642749 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b8a609d-337b-467d-bcd8-27bbd2319ffb tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:15.643558 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b8a609d-337b-467d-bcd8-27bbd2319ffb tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:15.643996 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-9b8a609d-337b-467d-bcd8-27bbd2319ffb tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:15.772753 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.network.security_group_api [None req-9b8a609d-337b-467d-bcd8-27bbd2319ffb tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Adding security group b536f9b8-87c5-4a5c-9281-65c52e08e855 to port cd326164-dfd3-48d5-b9d3-d9af3ad152b1 Jul 21 22:42:16.125894 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-9b8a609d-337b-467d-bcd8-27bbd2319ffb tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "POST /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/action" status: 202 len: 0 microversion: 2.1 time: 0.495157 Jul 21 22:42:16.129620 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1269/2408] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 22:42:15 2022] POST /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:42:16.135516 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f16c6f49-21d0-4a35-bff3-3f670a923fe5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:42:16.136214 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f16c6f49-21d0-4a35-bff3-3f670a923fe5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:42:16.142971 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f16c6f49-21d0-4a35-bff3-3f670a923fe5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.143925 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f16c6f49-21d0-4a35-bff3-3f670a923fe5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.145100 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f16c6f49-21d0-4a35-bff3-3f670a923fe5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.145533 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f16c6f49-21d0-4a35-bff3-3f670a923fe5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.323501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f16c6f49-21d0-4a35-bff3-3f670a923fe5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:42:16.332841 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f16c6f49-21d0-4a35-bff3-3f670a923fe5 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1755 microversion: 2.1 time: 0.201679 Jul 21 22:42:16.333529 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1140/2409] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:42:16 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:42:16.816064 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-8f9109a0-d08f-4c28-9012-2b91872ea1f5 req-18398bea-4478-420d-b7ba-3a747c4d6a21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1509b977-68c3-43b6-bc8b-d538c64abe10", "tag": "cd326164-dfd3-48d5-b9d3-d9af3ad152b1"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:42:16.824184 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-8f9109a0-d08f-4c28-9012-2b91872ea1f5 req-18398bea-4478-420d-b7ba-3a747c4d6a21 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:42:16.824626 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-8f9109a0-d08f-4c28-9012-2b91872ea1f5 req-18398bea-4478-420d-b7ba-3a747c4d6a21 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:42:16.836203 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-8f9109a0-d08f-4c28-9012-2b91872ea1f5 req-18398bea-4478-420d-b7ba-3a747c4d6a21 service nova] Creating event network-changed:cd326164-dfd3-48d5-b9d3-d9af3ad152b1 for instance 1509b977-68c3-43b6-bc8b-d538c64abe10 on hv-cinder-82002 Jul 21 22:42:16.841932 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-8f9109a0-d08f-4c28-9012-2b91872ea1f5 req-18398bea-4478-420d-b7ba-3a747c4d6a21 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029874 Jul 21 22:42:16.842560 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1270/2410] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 21 22:43:17.119428 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:17.120102 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:17.124199 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7eddea8d-3ccc-4142-9b4a-4ce3db54e0c1 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:43:17.125172 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7eddea8d-3ccc-4142-9b4a-4ce3db54e0c1 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:17.132209 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7eddea8d-3ccc-4142-9b4a-4ce3db54e0c1 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:17.132658 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7eddea8d-3ccc-4142-9b4a-4ce3db54e0c1 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:17.133420 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7eddea8d-3ccc-4142-9b4a-4ce3db54e0c1 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:17.133852 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7eddea8d-3ccc-4142-9b4a-4ce3db54e0c1 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:17.204558 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7eddea8d-3ccc-4142-9b4a-4ce3db54e0c1 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "POST /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/action" status: 202 len: 0 microversion: 2.1 time: 0.086712 Jul 21 22:43:17.207040 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1141/2411] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 22:43:17 2022] POST /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:43:17.212016 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=9 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:17.213394 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=23 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:43:17.218553 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-32f6403f-081b-44bc-ae1c-5c9b5cc4e803 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:17.219298 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-32f6403f-081b-44bc-ae1c-5c9b5cc4e803 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:17.226859 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32f6403f-081b-44bc-ae1c-5c9b5cc4e803 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:17.227335 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32f6403f-081b-44bc-ae1c-5c9b5cc4e803 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:17.228112 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32f6403f-081b-44bc-ae1c-5c9b5cc4e803 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:17.229169 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-32f6403f-081b-44bc-ae1c-5c9b5cc4e803 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:17.377907 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-32f6403f-081b-44bc-ae1c-5c9b5cc4e803 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:17.386086 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-32f6403f-081b-44bc-ae1c-5c9b5cc4e803 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1747 microversion: 2.1 time: 0.176440 Jul 21 22:43:17.386657 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1271/2412] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:17 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1747 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:18.404915 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-73f04dfc-e2e9-4222-8362-ab1ff88fbd22 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:18.405612 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-73f04dfc-e2e9-4222-8362-ab1ff88fbd22 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:18.411835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73f04dfc-e2e9-4222-8362-ab1ff88fbd22 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:18.412288 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73f04dfc-e2e9-4222-8362-ab1ff88fbd22 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:18.413050 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73f04dfc-e2e9-4222-8362-ab1ff88fbd22 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:18.413487 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73f04dfc-e2e9-4222-8362-ab1ff88fbd22 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:18.561849 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-73f04dfc-e2e9-4222-8362-ab1ff88fbd22 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:18.569774 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-73f04dfc-e2e9-4222-8362-ab1ff88fbd22 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.170130 Jul 21 22:43:18.570325 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1142/2413] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:18 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:19.588257 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-da7483b1-01e1-486d-a2ec-213c4048e866 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:19.588872 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-da7483b1-01e1-486d-a2ec-213c4048e866 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:19.595675 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-da7483b1-01e1-486d-a2ec-213c4048e866 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:19.596130 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-da7483b1-01e1-486d-a2ec-213c4048e866 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:19.596903 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-da7483b1-01e1-486d-a2ec-213c4048e866 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:19.597343 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-da7483b1-01e1-486d-a2ec-213c4048e866 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:19.737570 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-da7483b1-01e1-486d-a2ec-213c4048e866 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:19.746272 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-da7483b1-01e1-486d-a2ec-213c4048e866 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.161889 Jul 21 22:43:19.746841 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1272/2414] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:19 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:20.763764 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ee2d724b-a4ad-4c3c-b799-d129ce0a09cc tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:20.764305 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ee2d724b-a4ad-4c3c-b799-d129ce0a09cc tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:20.770638 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee2d724b-a4ad-4c3c-b799-d129ce0a09cc tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:20.771117 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee2d724b-a4ad-4c3c-b799-d129ce0a09cc tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:20.771873 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee2d724b-a4ad-4c3c-b799-d129ce0a09cc tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:20.772308 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ee2d724b-a4ad-4c3c-b799-d129ce0a09cc tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:20.917667 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ee2d724b-a4ad-4c3c-b799-d129ce0a09cc tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:20.925741 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ee2d724b-a4ad-4c3c-b799-d129ce0a09cc tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.166554 Jul 21 22:43:20.926299 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1143/2415] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:20 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:21.943261 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f900e748-2439-4372-a7af-c0d3ebadb9b4 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:21.943876 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f900e748-2439-4372-a7af-c0d3ebadb9b4 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:21.950892 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f900e748-2439-4372-a7af-c0d3ebadb9b4 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:21.951371 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f900e748-2439-4372-a7af-c0d3ebadb9b4 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:21.952146 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f900e748-2439-4372-a7af-c0d3ebadb9b4 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:21.952581 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f900e748-2439-4372-a7af-c0d3ebadb9b4 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:22.100539 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-f900e748-2439-4372-a7af-c0d3ebadb9b4 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:22.108805 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f900e748-2439-4372-a7af-c0d3ebadb9b4 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.169446 Jul 21 22:43:22.109386 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1273/2416] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:21 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:23.126080 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a93799a1-e9c4-475f-9d90-e23ad5629bc2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:23.126692 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a93799a1-e9c4-475f-9d90-e23ad5629bc2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:23.133284 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a93799a1-e9c4-475f-9d90-e23ad5629bc2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:23.133738 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a93799a1-e9c4-475f-9d90-e23ad5629bc2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:23.134506 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a93799a1-e9c4-475f-9d90-e23ad5629bc2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:23.135700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a93799a1-e9c4-475f-9d90-e23ad5629bc2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:23.278652 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a93799a1-e9c4-475f-9d90-e23ad5629bc2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:23.286738 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a93799a1-e9c4-475f-9d90-e23ad5629bc2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.164507 Jul 21 22:43:23.287327 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1144/2417] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:23 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:24.304459 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-604e1b31-7972-4275-be7a-3e3073d57e9b tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:24.305077 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-604e1b31-7972-4275-be7a-3e3073d57e9b tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:24.311358 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-604e1b31-7972-4275-be7a-3e3073d57e9b tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:24.311814 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-604e1b31-7972-4275-be7a-3e3073d57e9b tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:24.312587 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-604e1b31-7972-4275-be7a-3e3073d57e9b tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:24.313024 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-604e1b31-7972-4275-be7a-3e3073d57e9b tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:24.456976 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-604e1b31-7972-4275-be7a-3e3073d57e9b tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:24.464985 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-604e1b31-7972-4275-be7a-3e3073d57e9b tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.164605 Jul 21 22:43:24.465549 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1274/2418] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:24 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:25.482572 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e69a68c4-0cd9-4ea3-a892-4b9de1cf9860 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:25.483123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e69a68c4-0cd9-4ea3-a892-4b9de1cf9860 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:25.489640 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e69a68c4-0cd9-4ea3-a892-4b9de1cf9860 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:25.490092 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e69a68c4-0cd9-4ea3-a892-4b9de1cf9860 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:25.490896 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e69a68c4-0cd9-4ea3-a892-4b9de1cf9860 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:25.491356 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e69a68c4-0cd9-4ea3-a892-4b9de1cf9860 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:25.635835 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e69a68c4-0cd9-4ea3-a892-4b9de1cf9860 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:25.644423 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e69a68c4-0cd9-4ea3-a892-4b9de1cf9860 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.166577 Jul 21 22:43:25.645010 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1145/2419] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:25 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:26.662172 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b5a724e2-bde9-487f-88a3-e532498b5e33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:26.662778 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b5a724e2-bde9-487f-88a3-e532498b5e33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:26.670074 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b5a724e2-bde9-487f-88a3-e532498b5e33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:26.670526 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b5a724e2-bde9-487f-88a3-e532498b5e33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:26.671340 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b5a724e2-bde9-487f-88a3-e532498b5e33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:26.671780 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b5a724e2-bde9-487f-88a3-e532498b5e33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:26.818215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b5a724e2-bde9-487f-88a3-e532498b5e33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:26.826234 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b5a724e2-bde9-487f-88a3-e532498b5e33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.168025 Jul 21 22:43:26.826801 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1275/2420] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:26 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:27.843557 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-77cfc928-dcb6-41e9-a0ac-b64f2f6d3f51 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:27.844162 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-77cfc928-dcb6-41e9-a0ac-b64f2f6d3f51 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:27.850972 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77cfc928-dcb6-41e9-a0ac-b64f2f6d3f51 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:27.851456 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77cfc928-dcb6-41e9-a0ac-b64f2f6d3f51 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:27.852220 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77cfc928-dcb6-41e9-a0ac-b64f2f6d3f51 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:27.852657 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77cfc928-dcb6-41e9-a0ac-b64f2f6d3f51 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:27.993508 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-77cfc928-dcb6-41e9-a0ac-b64f2f6d3f51 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:28.002172 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-77cfc928-dcb6-41e9-a0ac-b64f2f6d3f51 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.162835 Jul 21 22:43:28.003107 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1146/2421] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:27 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:29.019889 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-c4c7ef34-f3a6-4437-a61c-58d9efe57cff tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:29.020498 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-c4c7ef34-f3a6-4437-a61c-58d9efe57cff tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:29.027570 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c4c7ef34-f3a6-4437-a61c-58d9efe57cff tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:29.027986 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c4c7ef34-f3a6-4437-a61c-58d9efe57cff tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:29.028761 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c4c7ef34-f3a6-4437-a61c-58d9efe57cff tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:29.029200 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-c4c7ef34-f3a6-4437-a61c-58d9efe57cff tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:29.174378 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-c4c7ef34-f3a6-4437-a61c-58d9efe57cff tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:29.182754 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-c4c7ef34-f3a6-4437-a61c-58d9efe57cff tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.166746 Jul 21 22:43:29.183348 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1276/2422] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:29 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:30.200258 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-83adaba6-cf55-4b02-8545-20c7d9b59909 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:30.200867 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-83adaba6-cf55-4b02-8545-20c7d9b59909 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:30.207367 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83adaba6-cf55-4b02-8545-20c7d9b59909 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:30.207821 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83adaba6-cf55-4b02-8545-20c7d9b59909 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:30.208584 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83adaba6-cf55-4b02-8545-20c7d9b59909 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:30.209020 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-83adaba6-cf55-4b02-8545-20c7d9b59909 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:30.350244 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-83adaba6-cf55-4b02-8545-20c7d9b59909 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:30.358189 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-83adaba6-cf55-4b02-8545-20c7d9b59909 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.162223 Jul 21 22:43:30.358762 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1147/2423] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:30 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:31.374658 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-027a7a1d-41e6-4baf-921d-8359d89c6447 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:31.375240 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-027a7a1d-41e6-4baf-921d-8359d89c6447 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:31.381723 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-027a7a1d-41e6-4baf-921d-8359d89c6447 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:31.382169 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-027a7a1d-41e6-4baf-921d-8359d89c6447 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:31.382925 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-027a7a1d-41e6-4baf-921d-8359d89c6447 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:31.383385 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-027a7a1d-41e6-4baf-921d-8359d89c6447 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:31.525494 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-027a7a1d-41e6-4baf-921d-8359d89c6447 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:31.533935 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-027a7a1d-41e6-4baf-921d-8359d89c6447 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.163372 Jul 21 22:43:31.534495 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1277/2424] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:31 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:32.550409 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-12320653-656b-4186-8dba-b7160c0f3a34 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:32.551030 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-12320653-656b-4186-8dba-b7160c0f3a34 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:32.558128 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-12320653-656b-4186-8dba-b7160c0f3a34 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:32.558576 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-12320653-656b-4186-8dba-b7160c0f3a34 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:32.559369 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-12320653-656b-4186-8dba-b7160c0f3a34 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:32.559808 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-12320653-656b-4186-8dba-b7160c0f3a34 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:32.702342 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-12320653-656b-4186-8dba-b7160c0f3a34 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:32.710463 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-12320653-656b-4186-8dba-b7160c0f3a34 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.163842 Jul 21 22:43:32.711081 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1148/2425] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:32 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:33.728320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-07fca799-dda8-486a-99bf-1bb708c97125 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:33.728936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-07fca799-dda8-486a-99bf-1bb708c97125 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:33.735552 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-07fca799-dda8-486a-99bf-1bb708c97125 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:33.735953 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-07fca799-dda8-486a-99bf-1bb708c97125 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:33.736727 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-07fca799-dda8-486a-99bf-1bb708c97125 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:33.737164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-07fca799-dda8-486a-99bf-1bb708c97125 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:33.878440 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-07fca799-dda8-486a-99bf-1bb708c97125 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:33.886521 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-07fca799-dda8-486a-99bf-1bb708c97125 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1752 microversion: 2.1 time: 0.162191 Jul 21 22:43:33.887107 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1278/2426] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:33 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:34.903906 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3622b2ab-e794-43e4-90b0-1cd6a92dc755 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:43:34.904520 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3622b2ab-e794-43e4-90b0-1cd6a92dc755 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:43:34.910984 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3622b2ab-e794-43e4-90b0-1cd6a92dc755 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:34.911465 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3622b2ab-e794-43e4-90b0-1cd6a92dc755 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:34.912232 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3622b2ab-e794-43e4-90b0-1cd6a92dc755 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:43:34.912674 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3622b2ab-e794-43e4-90b0-1cd6a92dc755 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:43:35.063811 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3622b2ab-e794-43e4-90b0-1cd6a92dc755 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:43:35.071700 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3622b2ab-e794-43e4-90b0-1cd6a92dc755 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1755 microversion: 2.1 time: 0.171666 Jul 21 22:43:35.072265 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1149/2427] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:43:34 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:43:59.597449 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:43:59.598099 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:43:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:44:18.614385 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:44:18.615130 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:44:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:44:19.681702 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:44:19.682357 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:44:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:44:29.879517 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-0601fa50-6592-41d4-9c03-cc6ff78d4d43 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-966820280"}} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:44:29.880156 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-0601fa50-6592-41d4-9c03-cc6ff78d4d43 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:29.882164 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_api:SELECT=16 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:29.882982 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG dbcounter [-] [117979] Writing DB stats nova_cell1:SELECT=48 {{(pid=117979) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:29.888779 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0601fa50-6592-41d4-9c03-cc6ff78d4d43 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:29.889236 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0601fa50-6592-41d4-9c03-cc6ff78d4d43 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:29.890007 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0601fa50-6592-41d4-9c03-cc6ff78d4d43 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:29.890447 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-0601fa50-6592-41d4-9c03-cc6ff78d4d43 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:30.143582 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.network.security_group_api [None req-0601fa50-6592-41d4-9c03-cc6ff78d4d43 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Removing security group b536f9b8-87c5-4a5c-9281-65c52e08e855 from port cd326164-dfd3-48d5-b9d3-d9af3ad152b1 Jul 21 22:44:30.500936 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-0601fa50-6592-41d4-9c03-cc6ff78d4d43 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "POST /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/action" status: 202 len: 0 microversion: 2.1 time: 0.624717 Jul 21 22:44:30.506773 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1279/2428] 10.222.0.44 () {60 vars in 1277 bytes} [Thu Jul 21 22:44:29 2022] POST /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/action => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:44:30.512460 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=18 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:30.514731 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 22:44:30.593087 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-1a5ab75f-8d4e-42da-bc36-e77c6d1fed17 req-a9606779-75cc-4a3d-8c98-3f82a28edfba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1509b977-68c3-43b6-bc8b-d538c64abe10", "tag": "cd326164-dfd3-48d5-b9d3-d9af3ad152b1"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:44:30.602644 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-1a5ab75f-8d4e-42da-bc36-e77c6d1fed17 req-a9606779-75cc-4a3d-8c98-3f82a28edfba service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:30.603107 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-1a5ab75f-8d4e-42da-bc36-e77c6d1fed17 req-a9606779-75cc-4a3d-8c98-3f82a28edfba service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:30.615694 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-1a5ab75f-8d4e-42da-bc36-e77c6d1fed17 req-a9606779-75cc-4a3d-8c98-3f82a28edfba service nova] Creating event network-changed:cd326164-dfd3-48d5-b9d3-d9af3ad152b1 for instance 1509b977-68c3-43b6-bc8b-d538c64abe10 on hv-cinder-82002 Jul 21 22:44:30.622320 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-1a5ab75f-8d4e-42da-bc36-e77c6d1fed17 req-a9606779-75cc-4a3d-8c98-3f82a28edfba service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118453 Jul 21 22:44:30.623451 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1150/2429] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:31.919500 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-eb3a0369-23f0-4f46-8b8f-7a1311c9f0d2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:31.920017 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-eb3a0369-23f0-4f46-8b8f-7a1311c9f0d2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:31.926070 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eb3a0369-23f0-4f46-8b8f-7a1311c9f0d2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:31.926514 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eb3a0369-23f0-4f46-8b8f-7a1311c9f0d2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:31.927294 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eb3a0369-23f0-4f46-8b8f-7a1311c9f0d2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:31.927726 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-eb3a0369-23f0-4f46-8b8f-7a1311c9f0d2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:32.010258 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.objects.instance [None req-eb3a0369-23f0-4f46-8b8f-7a1311c9f0d2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lazy-loading 'services' on Instance uuid 1509b977-68c3-43b6-bc8b-d538c64abe10 {{(pid=117979) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 21 22:44:32.089251 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-eb3a0369-23f0-4f46-8b8f-7a1311c9f0d2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/os-volume_attachments/c067514d-a8a3-4ff8-9dfc-faf897140de5" status: 202 len: 0 microversion: 2.1 time: 0.174398 Jul 21 22:44:32.089851 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1280/2430] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:44:31 2022] DELETE /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/os-volume_attachments/c067514d-a8a3-4ff8-9dfc-faf897140de5 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:44:32.098834 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b8d1d245-6468-4765-9ee3-b4e17fedda33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:32.101132 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b8d1d245-6468-4765-9ee3-b4e17fedda33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:32.108548 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8d1d245-6468-4765-9ee3-b4e17fedda33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:32.109290 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8d1d245-6468-4765-9ee3-b4e17fedda33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:32.110303 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8d1d245-6468-4765-9ee3-b4e17fedda33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:32.110970 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8d1d245-6468-4765-9ee3-b4e17fedda33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:32.142860 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b8d1d245-6468-4765-9ee3-b4e17fedda33 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048471 Jul 21 22:44:32.143593 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1151/2431] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:32 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:32.637214 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [req-f93f078a-12dc-4446-9e46-ff2f8063b202 req-8cdb4d85-d091-44d4-a5e7-9d7823325b55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1509b977-68c3-43b6-bc8b-d538c64abe10", "tag": "cd326164-dfd3-48d5-b9d3-d9af3ad152b1"}]} {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:44:32.662636 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-f93f078a-12dc-4446-9e46-ff2f8063b202 req-8cdb4d85-d091-44d4-a5e7-9d7823325b55 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:32.663121 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [req-f93f078a-12dc-4446-9e46-ff2f8063b202 req-8cdb4d85-d091-44d4-a5e7-9d7823325b55 service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:32.674855 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.compute.server_external_events [req-f93f078a-12dc-4446-9e46-ff2f8063b202 req-8cdb4d85-d091-44d4-a5e7-9d7823325b55 service nova] Creating event network-changed:cd326164-dfd3-48d5-b9d3-d9af3ad152b1 for instance 1509b977-68c3-43b6-bc8b-d538c64abe10 on hv-cinder-82002 Jul 21 22:44:32.679767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [req-f93f078a-12dc-4446-9e46-ff2f8063b202 req-8cdb4d85-d091-44d4-a5e7-9d7823325b55 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046582 Jul 21 22:44:32.680369 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1281/2432] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:33.156927 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7df6619c-54c4-42c2-9190-333989a0b696 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:33.157850 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7df6619c-54c4-42c2-9190-333989a0b696 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:33.165624 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7df6619c-54c4-42c2-9190-333989a0b696 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:33.166333 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7df6619c-54c4-42c2-9190-333989a0b696 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:33.167141 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7df6619c-54c4-42c2-9190-333989a0b696 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:33.167580 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7df6619c-54c4-42c2-9190-333989a0b696 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:33.199739 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7df6619c-54c4-42c2-9190-333989a0b696 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047733 Jul 21 22:44:33.200307 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1152/2433] 10.222.0.44 () {58 vars in 1301 bytes} [Thu Jul 21 22:44:33 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 21 22:44:33.211579 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f2097963-a2b0-4ae1-b916-54428e988a88 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:33.212136 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-f2097963-a2b0-4ae1-b916-54428e988a88 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:33.219646 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2097963-a2b0-4ae1-b916-54428e988a88 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:33.220091 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2097963-a2b0-4ae1-b916-54428e988a88 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:33.221116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2097963-a2b0-4ae1-b916-54428e988a88 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:33.221547 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-f2097963-a2b0-4ae1-b916-54428e988a88 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:33.297576 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-f2097963-a2b0-4ae1-b916-54428e988a88 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] HTTP exception thrown: Instance 1509b977-68c3-43b6-bc8b-d538c64abe10 is not attached to volume c067514d-a8a3-4ff8-9dfc-faf897140de5 Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f2097963-a2b0-4ae1-b916-54428e988a88 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Request method failure captured: Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: DELETE /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/os-volume_attachments/c067514d-a8a3-4ff8-9dfc-faf897140de5 HTTP/1.1 Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2dYNuU21iMiOAzLD0DZOmEm-PzKQMitRO-8sBYHDX_IVIJeRTW606Qx-xAzHaP_RWcV0DqC3IwHx257506UrwVPPHVhNIdM_h5mX9yEGi2FUKVaqYxwrMTJ2YxJieuhfEWj0uM1iWPLey4Qg80epu-MEk9J5GAPYSIgGitQY-FF3UxU Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 8713d695f460424cba952ad580aa2720 Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-TestMinimumBasicScenario-927152170 Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:44:33.299291 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:44:33.300781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8713d695f460424cba952ad580aa2720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8713d695f460424cba952ad580aa2720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8713d695f460424cba952ad580aa2720"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8713d695f460424cba952ad580aa2720", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:44:33.300781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-TestMinimumBasicScenario-927152170 Jul 21 22:44:33.300781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 8713d695f460424cba952ad580aa2720 Jul 21 22:44:33.300781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-TestMinimumBasicScenario-927152170 Jul 21 22:44:33.300781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-TestMinimumBasicScenario-927152170-project Jul 21 22:44:33.300781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:44:33.300781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:44:33.300781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 9dbb287bb33740a2a08dcd76d156729f Jul 21 22:44:33.300781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-TestMinimumBasicScenario-927152170-project Jul 21 22:44:33.300781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:44:33.300781 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 1509b977-68c3-43b6-bc8b-d538c64abe10 is not attached to volume c067514d-a8a3-4ff8-9dfc-faf897140de5 Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'server_id': '1509b977-68c3-43b6-bc8b-d538c64abe10', 'id': 'c067514d-a8a3-4ff8-9dfc-faf897140de5'} Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c067514d-a8a3-4ff8-9dfc-faf897140de5. Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:44:33.301599 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1509b977-68c3-43b6-bc8b-d538c64abe10 is not attached to volume c067514d-a8a3-4ff8-9dfc-faf897140de5 Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1509b977-68c3-43b6-bc8b-d538c64abe10 is not attached to volume c067514d-a8a3-4ff8-9dfc-faf897140de5 Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:44:33.302878 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-f2097963-a2b0-4ae1-b916-54428e988a88 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Returning 404 to user: Instance 1509b977-68c3-43b6-bc8b-d538c64abe10 is not attached to volume c067514d-a8a3-4ff8-9dfc-faf897140de5 {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:44:33.303905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-f2097963-a2b0-4ae1-b916-54428e988a88 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/os-volume_attachments/c067514d-a8a3-4ff8-9dfc-faf897140de5" status: 404 len: 154 microversion: 2.1 time: 0.094232 Jul 21 22:44:33.303905 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1282/2434] 10.222.0.44 () {58 vars in 1415 bytes} [Thu Jul 21 22:44:33 2022] DELETE /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10/os-volume_attachments/c067514d-a8a3-4ff8-9dfc-faf897140de5 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 21 22:44:34.437649 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-337730a9-a36c-442b-a3d6-ab88468f2e77 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:34.438169 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-337730a9-a36c-442b-a3d6-ab88468f2e77 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:34.444569 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-337730a9-a36c-442b-a3d6-ab88468f2e77 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:34.445022 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-337730a9-a36c-442b-a3d6-ab88468f2e77 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:34.445790 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-337730a9-a36c-442b-a3d6-ab88468f2e77 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:34.446229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-337730a9-a36c-442b-a3d6-ab88468f2e77 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:34.472912 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-337730a9-a36c-442b-a3d6-ab88468f2e77 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 21 22:44:34.546396 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-337730a9-a36c-442b-a3d6-ab88468f2e77 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 204 len: 0 microversion: 2.1 time: 0.112304 Jul 21 22:44:34.547113 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1153/2435] 10.222.0.44 () {58 vars in 1238 bytes} [Thu Jul 21 22:44:34 2022] DELETE /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 21 22:44:34.555422 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-1b027745-d878-4301-ac68-7f4d6a0b4277 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:34.556041 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-1b027745-d878-4301-ac68-7f4d6a0b4277 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:34.562767 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1b027745-d878-4301-ac68-7f4d6a0b4277 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:34.563265 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1b027745-d878-4301-ac68-7f4d6a0b4277 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:34.564116 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1b027745-d878-4301-ac68-7f4d6a0b4277 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:34.564563 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-1b027745-d878-4301-ac68-7f4d6a0b4277 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:34.697052 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-1b027745-d878-4301-ac68-7f4d6a0b4277 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:34.705061 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-1b027745-d878-4301-ac68-7f4d6a0b4277 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1551 microversion: 2.1 time: 0.153473 Jul 21 22:44:34.705622 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1283/2436] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:34 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:35.724389 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c9c1b025-64cb-4b26-bde4-beaf9878da3d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:35.725124 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c9c1b025-64cb-4b26-bde4-beaf9878da3d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:35.732229 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9c1b025-64cb-4b26-bde4-beaf9878da3d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:35.732691 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9c1b025-64cb-4b26-bde4-beaf9878da3d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:35.733467 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9c1b025-64cb-4b26-bde4-beaf9878da3d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:35.733966 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9c1b025-64cb-4b26-bde4-beaf9878da3d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:35.911501 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c9c1b025-64cb-4b26-bde4-beaf9878da3d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:35.919644 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c9c1b025-64cb-4b26-bde4-beaf9878da3d tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1551 microversion: 2.1 time: 0.199767 Jul 21 22:44:35.920221 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1154/2437] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:35 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1551 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:36.937118 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-b9a25d07-c7f8-491c-85a2-f5b85b1e41e8 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:36.937801 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-b9a25d07-c7f8-491c-85a2-f5b85b1e41e8 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:36.944320 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9a25d07-c7f8-491c-85a2-f5b85b1e41e8 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:36.944771 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9a25d07-c7f8-491c-85a2-f5b85b1e41e8 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:36.945542 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9a25d07-c7f8-491c-85a2-f5b85b1e41e8 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:36.945995 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-b9a25d07-c7f8-491c-85a2-f5b85b1e41e8 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:37.076056 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.policy [None req-b9a25d07-c7f8-491c-85a2-f5b85b1e41e8 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dbb287bb33740a2a08dcd76d156729f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8713d695f460424cba952ad580aa2720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117979) authorize /opt/stack/nova/nova/policy.py:199}} Jul 21 22:44:37.083771 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-b9a25d07-c7f8-491c-85a2-f5b85b1e41e8 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 200 len: 1551 microversion: 2.1 time: 0.151098 Jul 21 22:44:37.084356 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1284/2438] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:36 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 1551 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 21 22:44:37.263557 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-d4d22a4d-15ad-4530-8f87-e0611ded9650 req-bc095f76-494d-4c69-ab07-8d97c7c7a73d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1509b977-68c3-43b6-bc8b-d538c64abe10", "name": "network-vif-deleted", "tag": "cd326164-dfd3-48d5-b9d3-d9af3ad152b1"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 21 22:44:37.271848 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d4d22a4d-15ad-4530-8f87-e0611ded9650 req-bc095f76-494d-4c69-ab07-8d97c7c7a73d service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:37.272425 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d4d22a4d-15ad-4530-8f87-e0611ded9650 req-bc095f76-494d-4c69-ab07-8d97c7c7a73d service nova] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:37.284270 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-d4d22a4d-15ad-4530-8f87-e0611ded9650 req-bc095f76-494d-4c69-ab07-8d97c7c7a73d service nova] Creating event network-vif-deleted:cd326164-dfd3-48d5-b9d3-d9af3ad152b1 for instance 1509b977-68c3-43b6-bc8b-d538c64abe10 on hv-cinder-82002 Jul 21 22:44:37.289076 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-d4d22a4d-15ad-4530-8f87-e0611ded9650 req-bc095f76-494d-4c69-ab07-8d97c7c7a73d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087061 Jul 21 22:44:37.289732 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1155/2439] 10.222.0.44 () {64 vars in 1317 bytes} [Thu Jul 21 22:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 21 22:44:38.101270 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5b1ede51-9d52-4f71-b706-72fc4181a3f2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '>' {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:38.101869 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.compute.api [None req-5b1ede51-9d52-4f71-b706-72fc4181a3f2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] [instance: 1509b977-68c3-43b6-bc8b-d538c64abe10] Fetching instance by UUID {{(pid=117979) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 21 22:44:38.109010 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b1ede51-9d52-4f71-b706-72fc4181a3f2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:38.109454 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b1ede51-9d52-4f71-b706-72fc4181a3f2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:38.110215 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b1ede51-9d52-4f71-b706-72fc4181a3f2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 21 22:44:38.110648 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG oslo_concurrency.lockutils [None req-5b1ede51-9d52-4f71-b706-72fc4181a3f2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Lock "b65a2abd-7e6e-45a1-9259-5abe1cfa8ea0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117979) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 21 22:44:38.123977 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.wsgi [None req-5b1ede51-9d52-4f71-b706-72fc4181a3f2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] HTTP exception thrown: Instance 1509b977-68c3-43b6-bc8b-d538c64abe10 could not be found. Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5b1ede51-9d52-4f71-b706-72fc4181a3f2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Request method failure captured: Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: request: GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 HTTP/1.1 Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept: application/json Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Accept-Encoding: identity Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Connection: close Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Length: 0 Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Content-Type: application/json Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Host: 10.222.0.44 Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Openstack-System-Scope: None Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: User-Agent: python-urllib3/1.26.9 Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Auth-Token: gAAAAABi2dYNuU21iMiOAzLD0DZOmEm-PzKQMitRO-8sBYHDX_IVIJeRTW606Qx-xAzHaP_RWcV0DqC3IwHx257506UrwVPPHVhNIdM_h5mX9yEGi2FUKVaqYxwrMTJ2YxJieuhfEWj0uM1iWPLey4Qg80epu-MEk9J5GAPYSIgGitQY-FF3UxU Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Id: None Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Domain-Name: None Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Identity-Status: Confirmed Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Is-Admin-Project: True Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Id: default Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Domain-Name: Default Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Id: 8713d695f460424cba952ad580aa2720 Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Project-Name: tempest-TestMinimumBasicScenario-927152170 Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Role: reader,member Jul 21 22:44:38.125513 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Roles: reader,member Jul 21 22:44:38.126642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8713d695f460424cba952ad580aa2720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/8713d695f460424cba952ad580aa2720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/8713d695f460424cba952ad580aa2720"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_8713d695f460424cba952ad580aa2720", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}] Jul 21 22:44:38.126642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant: tempest-TestMinimumBasicScenario-927152170 Jul 21 22:44:38.126642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Id: 8713d695f460424cba952ad580aa2720 Jul 21 22:44:38.126642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-Tenant-Name: tempest-TestMinimumBasicScenario-927152170 Jul 21 22:44:38.126642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User: tempest-TestMinimumBasicScenario-927152170-project Jul 21 22:44:38.126642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Id: default Jul 21 22:44:38.126642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Domain-Name: Default Jul 21 22:44:38.126642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Id: 9dbb287bb33740a2a08dcd76d156729f Jul 21 22:44:38.126642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: X-User-Name: tempest-TestMinimumBasicScenario-927152170-project Jul 21 22:44:38.126642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: method: > Jul 21 22:44:38.126642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: exception: Instance 1509b977-68c3-43b6-bc8b-d538c64abe10 could not be found. Jul 21 22:44:38.126642 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: action_args: {'id': '1509b977-68c3-43b6-bc8b-d538c64abe10'} Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: {{(pid=117979) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1509b977-68c3-43b6-bc8b-d538c64abe10 could not be found. Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 21 22:44:38.127310 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1509b977-68c3-43b6-bc8b-d538c64abe10 could not be found. Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1509b977-68c3-43b6-bc8b-d538c64abe10 could not be found. Jul 21 22:44:38.128465 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: ERROR nova.api.openstack.wsgi Jul 21 22:44:38.129710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: DEBUG nova.api.openstack.wsgi [None req-5b1ede51-9d52-4f71-b706-72fc4181a3f2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Returning 404 to user: Instance 1509b977-68c3-43b6-bc8b-d538c64abe10 could not be found. {{(pid=117979) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 21 22:44:38.129710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO nova.api.openstack.requestlog [None req-5b1ede51-9d52-4f71-b706-72fc4181a3f2 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10" status: 404 len: 111 microversion: 2.1 time: 0.029780 Jul 21 22:44:38.129710 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: [pid: 117979|app: 0|req: 1285/2440] 10.222.0.44 () {58 vars in 1235 bytes} [Thu Jul 21 22:44:38 2022] GET /compute/v2.1/servers/1509b977-68c3-43b6-bc8b-d538c64abe10 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 21 22:44:38.136123 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0163728e-df22-4fcf-8833-55b6159fb214 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] Calling method '.version_select at 0x7faca6f7fa60>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 21 22:44:38.157673 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0163728e-df22-4fcf-8833-55b6159fb214 tempest-TestMinimumBasicScenario-927152170 tempest-TestMinimumBasicScenario-927152170-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1605554493" status: 202 len: 0 microversion: 2.1 time: 0.025699 Jul 21 22:44:38.158252 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1156/2441] 10.222.0.44 () {58 vars in 1271 bytes} [Thu Jul 21 22:44:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1605554493 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 21 22:45:29.303314 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:45:29.303931 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:45:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:47:19.605946 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:47:19.606482 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:47:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:47:38.622045 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:47:38.622686 dv-cinder-820027-15-iscsi devstack@n-api.service[117978]: Thu Jul 21 22:47:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:47:39.690593 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:47:39.691079 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:47:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:47:50.075167 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:47:50.075785 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:47:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 21 22:48:49.313382 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 21 22:48:49.314083 dv-cinder-820027-15-iscsi devstack@n-api.service[117979]: Thu Jul 21 22:48:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!